2024-09-12T01:37:24.990 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T01:37:25.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:37:25.119 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901570' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9uUNw42aF+zadDo3SdWmu3PTCdqTlpq+NHjzys9wRaoyp4rWNNVnpoHrwzEbZLDG3r20izc6yCiVaBFzCZzD0= smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBn9ukhpQygsFn8ja6pORnrHqTESqiaEsKDqmnAaeu0E/Wd0h7FV/23C403ND7CRoXiA9cAbOfgDUp/2ZWfW+/U= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9tdhE1PPiXamFdwxgo71R/y+5urzolfKheeJlMQuIAL5B8uLyznx7jULx3QMOSFoZzSckIdMDu34q8GmtOMvw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T01:37:25.119 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T01:37:25.120 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T01:37:25.120 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T01:37:25.122 INFO:teuthology.task.internal:Checking packages... 2024-09-12T01:37:25.146 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T01:37:25.146 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:37:25.147 INFO:teuthology.packaging:ref: None 2024-09-12T01:37:25.147 INFO:teuthology.packaging:tag: None 2024-09-12T01:37:25.147 INFO:teuthology.packaging:branch: squid 2024-09-12T01:37:25.147 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:37:25.147 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T01:37:25.357 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T01:37:25.359 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T01:37:25.365 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T01:37:25.365 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T01:37:25.371 INFO:teuthology.task.internal:Saving configuration 2024-09-12T01:37:25.391 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T01:37:25.399 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T01:37:25.436 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:32:28.966213', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9uUNw42aF+zadDo3SdWmu3PTCdqTlpq+NHjzys9wRaoyp4rWNNVnpoHrwzEbZLDG3r20izc6yCiVaBFzCZzD0='} 2024-09-12T01:37:25.466 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:32:28.964318', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBn9ukhpQygsFn8ja6pORnrHqTESqiaEsKDqmnAaeu0E/Wd0h7FV/23C403ND7CRoXiA9cAbOfgDUp/2ZWfW+/U='} 2024-09-12T01:37:25.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:32:28.967887', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9tdhE1PPiXamFdwxgo71R/y+5urzolfKheeJlMQuIAL5B8uLyznx7jULx3QMOSFoZzSckIdMDu34q8GmtOMvw='} 2024-09-12T01:37:25.493 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T01:37:25.500 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T01:37:25.500 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T01:37:25.500 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T01:37:25.500 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T01:37:25.615 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f527d4a7be0>, signals=[15]) 2024-09-12T01:37:25.615 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T01:37:25.621 INFO:teuthology.task.internal:Opening connections... 2024-09-12T01:37:25.621 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:37:25.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:37:25.706 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T01:37:25.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:37:25.808 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T01:37:25.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:37:25.897 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T01:37:25.920 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-09-12T01:37:25.939 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-09-12T01:37:25.939 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-09-12T01:37:25.997 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-09-12T01:37:25.997 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-09-12T01:37:25.997 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-09-12T01:37:25.997 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:37:25.997 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-09-12T01:37:25.997 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:37:25.997 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:37:25.998 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-09-12T01:37:25.998 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:37:25.998 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:37:25.998 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:37:25.998 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:37:25.998 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:37:25.998 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:37:25.999 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-09-12T01:37:26.029 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-09-12T01:37:26.047 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-09-12T01:37:26.047 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-09-12T01:37:26.105 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-09-12T01:37:26.105 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-09-12T01:37:26.105 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-09-12T01:37:26.105 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:37:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-09-12T01:37:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:37:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:37:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-09-12T01:37:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:37:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:37:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:37:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:37:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:37:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:37:26.106 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-09-12T01:37:26.137 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-09-12T01:37:26.156 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-09-12T01:37:26.156 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-09-12T01:37:26.214 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-09-12T01:37:26.214 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-09-12T01:37:26.214 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-09-12T01:37:26.214 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:37:26.214 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-09-12T01:37:26.214 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:37:26.215 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:37:26.215 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-09-12T01:37:26.215 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:37:26.215 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:37:26.215 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:37:26.215 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:37:26.215 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:37:26.215 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:37:26.215 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-09-12T01:37:26.245 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T01:37:26.263 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T01:37:26.274 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T01:37:26.274 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:37:26.277 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:37:26.279 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:37:26.295 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T01:37:26.307 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T01:37:26.307 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:37:26.334 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:37:26.336 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:37:26.363 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T01:37:26.465 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T01:37:26.483 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T01:37:26.483 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-12T01:37:26.483 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-12T01:37:26.483 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:37:26.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:37:26.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-12T01:37:26.694 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T01:37:26.694 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-12T01:37:26.695 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-09-12T01:37:26.713 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:37:26.714 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T01:37:26.714 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-12T01:37:26.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum upgrade -y linux-firmware 2024-09-12T01:37:29.388 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.2 MB 00:00 2024-09-12T01:37:33.680 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 20 MB 00:03 2024-09-12T01:37:38.706 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 6.5 MB 00:00 2024-09-12T01:37:40.502 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-12T01:37:41.261 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T01:37:46.908 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-12T01:37:49.077 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-09-12T01:37:49.078 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-09-12T01:37:49.078 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-09-12T01:37:49.173 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T01:37:49.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T01:37:49.333 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-12T01:37:49.333 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-12T01:37:49.336 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi062.front.sepia.ceph.com to complete... 2024-09-12T01:37:55.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12 01:37:55 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-12T01:37:55.649 INFO:teuthology.orchestra.run.smithi062.stderr:FINISHED --2024-09-12 01:37:55-- 2024-09-12T01:37:55.649 INFO:teuthology.orchestra.run.smithi062.stderr:Total wall clock time: 6.3s 2024-09-12T01:37:55.649 INFO:teuthology.orchestra.run.smithi062.stderr:Downloaded: 1 files, 343M in 6.0s (57.3 MB/s) 2024-09-12T01:37:55.652 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T01:37:55.652 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-12T01:37:57.854 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying... ######################################## 2024-09-12T01:37:57.985 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing... ######################################## 2024-09-12T01:37:58.101 INFO:teuthology.orchestra.run.smithi062.stdout:Updating / installing... 2024-09-12T01:38:06.490 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-12T01:38:46.631 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-12T01:38:46.631 DEBUG:teuthology.orchestra.run.smithi062:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-12T01:38:46.722 INFO:teuthology.orchestra.run.smithi062.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:38:46.722 INFO:teuthology.orchestra.run.smithi062.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:38:46.722 INFO:teuthology.orchestra.run.smithi062.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:38:46.722 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:38:46.722 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-12T01:38:46.722 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-12T01:38:46.722 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-12T01:38:46.723 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-12T01:38:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-12T01:38:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-12T01:38:46.726 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-12T01:38:46.727 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-12T01:38:46.728 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-12T01:38:46.729 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-12T01:38:46.730 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-12T01:38:46.731 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-12T01:38:46.732 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-12T01:38:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-12T01:38:46.734 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-12T01:38:46.735 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-12T01:38:46.736 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-12T01:38:46.737 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-12T01:38:46.738 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-12T01:38:46.739 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-12T01:38:46.740 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-12T01:38:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-12T01:38:46.742 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-12T01:38:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-12T01:38:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-12T01:38:46.745 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-12T01:38:46.746 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-12T01:38:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-12T01:38:46.748 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-12T01:38:46.749 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-12T01:38:46.750 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-12T01:38:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-12T01:38:46.752 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-12T01:38:46.753 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-12T01:38:46.754 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-12T01:38:46.755 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-12T01:38:46.756 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-12T01:38:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-12T01:38:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-12T01:38:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-12T01:38:46.760 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-12T01:38:46.761 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-12T01:38:46.762 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-12T01:38:46.763 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-12T01:38:46.764 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-12T01:38:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-12T01:38:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-12T01:38:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-12T01:38:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-12T01:38:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-12T01:38:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-12T01:38:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-12T01:38:46.772 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-12T01:38:46.773 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-12T01:38:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-12T01:38:46.775 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-12T01:38:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-12T01:38:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-12T01:38:46.778 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-12T01:38:46.779 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-12T01:38:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-12T01:38:46.781 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-12T01:38:46.782 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-12T01:38:46.783 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-12T01:38:46.784 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-12T01:38:46.785 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-12T01:38:46.786 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-12T01:38:46.787 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-12T01:38:46.788 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-12T01:38:46.789 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-12T01:38:46.790 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-12T01:38:46.791 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-12T01:38:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-12T01:38:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-12T01:38:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-12T01:38:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-12T01:38:46.801 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-12T01:38:46.806 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-12T01:38:46.807 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-12T01:38:46.809 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-12T01:38:46.810 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-12T01:38:46.812 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-12T01:38:46.812 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-12T01:38:46.813 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-12T01:38:46.814 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-12T01:38:46.815 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-12T01:38:46.815 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-12T01:38:46.815 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-12T01:38:46.815 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-12T01:38:46.815 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-12T01:38:46.815 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-12T01:38:46.815 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-12T01:38:46.815 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-12T01:38:46.815 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-12T01:38:46.815 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-12T01:38:46.816 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-12T01:38:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-12T01:38:46.818 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-12T01:38:46.819 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-12T01:38:46.820 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-12T01:38:46.821 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-12T01:38:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-12T01:38:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-12T01:38:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-12T01:38:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-12T01:38:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-12T01:38:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-12T01:38:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-12T01:38:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-12T01:38:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-12T01:38:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-12T01:38:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-12T01:38:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-12T01:38:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-12T01:38:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-12T01:38:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-12T01:38:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-12T01:38:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-12T01:38:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-12T01:38:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-12T01:38:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-12T01:38:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-12T01:38:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-12T01:38:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-12T01:38:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-12T01:38:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-12T01:38:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-12T01:38:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-12T01:38:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-12T01:38:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-12T01:38:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-12T01:38:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-12T01:38:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-12T01:38:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-12T01:38:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-12T01:38:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-12T01:38:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-12T01:38:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-12T01:38:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-12T01:38:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-12T01:38:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-12T01:38:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-12T01:38:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-12T01:38:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-12T01:38:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-12T01:38:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-12T01:38:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-12T01:38:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-12T01:38:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-12T01:38:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-12T01:38:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-12T01:38:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-12T01:38:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-12T01:38:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-12T01:38:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-12T01:38:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-12T01:38:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-12T01:38:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-12T01:38:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T01:38:46.875 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:38:46.875 DEBUG:teuthology.orchestra.run.smithi062:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-12T01:38:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:postinstall scriptlet (using /bin/sh): 2024-09-12T01:38:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T01:38:46.899 INFO:teuthology.orchestra.run.smithi062.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T01:38:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:fi 2024-09-12T01:38:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:for file in vmlinuz System.map config; do 2024-09-12T01:38:46.899 INFO:teuthology.orchestra.run.smithi062.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-12T01:38:46.899 INFO:teuthology.orchestra.run.smithi062.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T01:38:46.899 INFO:teuthology.orchestra.run.smithi062.stdout: fi 2024-09-12T01:38:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:done 2024-09-12T01:38:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:fi 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:fi 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:38:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:fi 2024-09-12T01:38:46.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2024-09-12T01:38:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2024-09-12T01:38:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2024-09-12T01:38:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.06 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 82.el9 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Group : Unspecified 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 8274670 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : builder@centos.org 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:38:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2024-09-12T01:38:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2024-09-12T01:38:46.984 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:38:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:38:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:38:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:38:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2024-09-12T01:38:46.984 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:38:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:38:46.985 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:38:46.985 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:38:46.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:38:47.600 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-09-12T01:38:49.015 INFO:teuthology.orchestra.run.smithi062.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:38:49.054 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-09-12T01:38:49.056 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-12T01:38:49.071 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.wSRwl6PyGR 2024-09-12T01:38:49.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wSRwl6PyGR 2024-09-12T01:38:49.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.wSRwl6PyGR 2024-09-12T01:38:49.271 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.wSRwl6PyGR is 6KB 2024-09-12T01:38:49.319 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.wSRwl6PyGR 2024-09-12T01:38:49.334 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:38:49.396 INFO:teuthology.orchestra.run.smithi062.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:38:49.396 INFO:teuthology.orchestra.run.smithi062.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:38:49.396 INFO:teuthology.orchestra.run.smithi062.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:38:49.396 INFO:teuthology.orchestra.run.smithi062.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-12T01:38:49.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:38:49.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-09-12T01:39:19.567 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T01:39:19.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T01:39:19.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:39:37.917 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-09-12T01:39:46.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T01:39:46.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:39:50.017 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-09-12T01:40:02.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T01:40:02.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:40:33.893 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-12T01:40:34.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T01:40:34.366 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-12T01:40:34.366 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-09-12T01:40:34.400 INFO:teuthology.orchestra.run.smithi062.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:40:34.400 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:40:34.400 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:40:34.401 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:40:35.401 DEBUG:teuthology.parallel:result is None 2024-09-12T01:40:35.402 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T01:40:35.409 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T01:40:35.409 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:40:35.413 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:40:35.416 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:40:35.443 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T01:40:35.449 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T01:40:35.459 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T01:40:35.460 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:40:35.485 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:40:35.487 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:40:35.596 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T01:40:35.603 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T01:40:35.603 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:40:35.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:35.620 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:40:35.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:35.637 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:40:35.641 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:40:35.662 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:40:35.715 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:35.733 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:35.739 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:35.770 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:35.852 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:35.964 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T01:40:35.972 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T01:40:35.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:40:35.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:40:35.978 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:40:36.028 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T01:40:36.037 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T01:40:36.037 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:40:36.041 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:40:36.049 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:40:36.072 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:36.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:36.248 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:36.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:36.382 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:40:36.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:40:36.531 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:36.585 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:36.627 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:36.721 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:36.756 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:40:36.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:40:36.827 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:36.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:37.131 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:37.184 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:37.219 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:40:37.219 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:40:37.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-09-12T01:40:37.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-09-12T01:40:37.292 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-09-12T01:40:37.334 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:40:37.363 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:40:37.376 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:40:37.751 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T01:40:37.758 INFO:teuthology.task.internal:Starting timer... 2024-09-12T01:40:37.758 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T01:40:37.770 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T01:40:37.779 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T01:40:37.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-09-12T01:40:37.906 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-09-12T01:40:37.910 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-09-12T01:40:37.977 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-09-12T01:40:37.979 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-09-12T01:40:38.038 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-09-12T01:40:38.041 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T01:40:38.041 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-09-12T01:40:38.083 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-09-12T01:40:38.084 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-09-12T01:40:38.112 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-09-12T01:40:38.112 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-09-12T01:40:38.139 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-09-12T01:40:38.139 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': 'permissive'} 2024-09-12T01:40:38.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:40:38.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:38.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:40:38.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:38.227 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:40:38.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:38.255 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T01:40:38.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:40:38.334 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:40:38.367 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:40:38.404 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T01:40:38.413 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T01:40:38.424 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T01:40:38.425 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi077.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T01:45:24.034 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2024-09-12T01:45:24.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T01:45:24.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:45:24.130 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-12T01:45:24.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T01:45:24.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-12T01:45:24.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:45:24.341 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-12T01:45:24.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-12T01:45:24.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T01:45:24.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:45:24.501 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-12T01:45:24.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T01:45:24.585 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T01:45:24.595 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T01:45:24.595 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:45:24.596 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:45:24.600 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:45:24.600 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:45:24.602 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:45:24.602 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:45:24.630 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:45:24.645 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:45:24.655 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:45:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:45:24.670 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:45:24.671 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-09-12T01:45:24.681 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-09-12T01:45:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:45:24.695 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-09-12T01:45:24.696 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:45:24.706 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-09-12T01:45:24.710 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:45:24.720 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:45:24.734 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:45:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-09-12T01:45:24.762 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-09-12T01:45:24.766 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:45:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:45:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-12T01:45:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.770 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.790 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:45:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:45:24.793 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:45:24.793 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-12T01:45:24.793 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.793 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.793 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.793 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:45:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:45:24.931 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:45:24.931 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-09-12T01:45:24.931 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.932 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.932 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.932 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:24.934 INFO:teuthology.run_tasks:Running task install... 2024-09-12T01:45:24.946 DEBUG:teuthology.task.install:project ceph 2024-09-12T01:45:24.946 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T01:45:24.946 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T01:45:24.947 INFO:teuthology.task.install:Using flavor: default 2024-09-12T01:45:24.957 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T01:45:24.958 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T01:45:24.958 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:45:24.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:45:24.962 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:45:24.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:45:24.963 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:45:24.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:45:25.115 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:45:25.116 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:45:25.130 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:45:25.131 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:45:25.131 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:45:25.132 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:45:25.236 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:45:25.236 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:45:25.236 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:45:25.246 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:45:25.246 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:45:25.246 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:45:25.258 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:45:25.258 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:45:25.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:45:25.272 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:45:25.272 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:45:25.284 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:45:25.284 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:45:25.292 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:45:25.292 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:45:25.337 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:45:25.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:45:25.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:45:25.413 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:45:25.425 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:45:25.469 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:45:25.477 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-09-12T01:45:25.478 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-09-12T01:45:25.489 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-09-12T01:45:25.491 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-09-12T01:45:25.524 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-09-12T01:45:25.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-09-12T01:45:25.704 INFO:teuthology.orchestra.run.smithi107.stdout:45 files removed 2024-09-12T01:45:25.718 INFO:teuthology.orchestra.run.smithi077.stdout:45 files removed 2024-09-12T01:45:25.731 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:45:25.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:45:25.803 INFO:teuthology.orchestra.run.smithi062.stdout:45 files removed 2024-09-12T01:45:25.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:45:26.271 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-12T01:45:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-12T01:45:26.555 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-12T01:45:26.558 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 283 kB/s | 84 kB 00:00 2024-09-12T01:45:26.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T01:45:26.822 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T01:45:26.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T01:45:26.859 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-12T01:45:27.151 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-12T01:45:27.817 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-12T01:45:28.588 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-12T01:45:29.633 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-12T01:45:29.727 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-12T01:45:30.573 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-12T01:45:31.484 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-12T01:45:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.5 MB 00:02 2024-09-12T01:45:36.564 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-12T01:45:37.696 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-12T01:45:37.992 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-12T01:45:38.500 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T01:45:38.843 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.5 MB 00:03 2024-09-12T01:45:39.163 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T01:45:41.277 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-12T01:45:42.039 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T01:45:44.585 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-12T01:45:45.256 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 9.8 kB/s | 1.7 kB 00:00 2024-09-12T01:45:46.864 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:46.865 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:46.878 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:45:46.879 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:45:46.880 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:45:46.881 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:45:46.883 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:45:46.885 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:45:46.886 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:45:46.948 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-12T01:45:46.966 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-12T01:45:46.966 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-12T01:45:46.966 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-12T01:45:46.966 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-12T01:45:46.966 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:45:46.966 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:45:46.967 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:45:46.968 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:45:46.969 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:45:46.970 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:45:46.971 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:45:46.972 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:45:46.973 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:45:46.974 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:45:46.975 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:45:46.976 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:45:46.978 INFO:teuthology.orchestra.run.smithi107.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:45:46.979 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:45:46.979 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:45:46.979 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-09-12T01:45:46.979 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:45:46.979 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:45:46.979 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-12T01:45:46.979 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-12T01:45:46.979 INFO:teuthology.orchestra.run.smithi107.stdout:Install 148 Packages 2024-09-12T01:45:46.979 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 8 Packages 2024-09-12T01:45:46.979 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:45:46.980 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 226 M 2024-09-12T01:45:46.980 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-12T01:45:47.520 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T01:45:47.686 INFO:teuthology.orchestra.run.smithi107.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 27 kB/s | 6.5 kB 00:00 2024-09-12T01:45:47.872 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:47.873 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:47.885 INFO:teuthology.orchestra.run.smithi062.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:45:47.887 INFO:teuthology.orchestra.run.smithi062.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:45:47.887 INFO:teuthology.orchestra.run.smithi062.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:45:47.889 INFO:teuthology.orchestra.run.smithi062.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:45:47.890 INFO:teuthology.orchestra.run.smithi062.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:45:47.893 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:45:47.894 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:45:47.966 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-09-12T01:45:47.983 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================== 2024-09-12T01:45:47.983 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-09-12T01:45:47.983 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================== 2024-09-12T01:45:47.983 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:45:47.984 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:45:47.985 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:45:47.986 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:45:47.987 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:45:47.988 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:45:47.988 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:45:47.988 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:45:47.989 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:45:47.990 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:45:47.991 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:45:47.992 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:45:47.993 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:45:47.994 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:45:47.995 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:45:47.996 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:45:47.997 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:45:47.997 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-09-12T01:45:47.997 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:45:47.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:45:47.997 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-09-12T01:45:47.997 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================== 2024-09-12T01:45:47.997 INFO:teuthology.orchestra.run.smithi062.stdout:Install 148 Packages 2024-09-12T01:45:47.997 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 8 Packages 2024-09-12T01:45:47.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:45:47.998 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 226 M 2024-09-12T01:45:47.998 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-09-12T01:45:48.079 INFO:teuthology.orchestra.run.smithi107.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.2 MB/s | 897 kB 00:00 2024-09-12T01:45:48.129 INFO:teuthology.orchestra.run.smithi107.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-12T01:45:48.362 INFO:teuthology.orchestra.run.smithi107.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 2.4 MB 00:00 2024-09-12T01:45:48.463 INFO:teuthology.orchestra.run.smithi107.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 5.3 MB/s | 5.4 MB 00:01 2024-09-12T01:45:48.555 INFO:teuthology.orchestra.run.smithi107.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 7.9 MB/s | 1.5 MB 00:00 2024-09-12T01:45:48.566 INFO:teuthology.orchestra.run.smithi062.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-12T01:45:48.830 INFO:teuthology.orchestra.run.smithi107.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-12T01:45:49.033 INFO:teuthology.orchestra.run.smithi062.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.9 MB/s | 897 kB 00:00 2024-09-12T01:45:49.166 INFO:teuthology.orchestra.run.smithi062.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.1 MB/s | 145 kB 00:00 2024-09-12T01:45:49.430 INFO:teuthology.orchestra.run.smithi107.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 21 MB 00:01 2024-09-12T01:45:49.464 INFO:teuthology.orchestra.run.smithi107.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 761 kB/s | 25 kB 00:00 2024-09-12T01:45:49.581 INFO:teuthology.orchestra.run.smithi107.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 14 MB/s | 11 MB 00:00 2024-09-12T01:45:49.650 INFO:teuthology.orchestra.run.smithi062.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 4.9 MB/s | 2.4 MB 00:00 2024-09-12T01:45:49.750 INFO:teuthology.orchestra.run.smithi062.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.1 MB/s | 5.4 MB 00:01 2024-09-12T01:45:49.765 INFO:teuthology.orchestra.run.smithi107.stdout:(11/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 14 MB/s | 17 MB 00:01 2024-09-12T01:45:49.790 INFO:teuthology.orchestra.run.smithi107.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.1 MB/s | 228 kB 00:00 2024-09-12T01:45:49.814 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:49.815 INFO:teuthology.orchestra.run.smithi107.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 541 kB/s | 27 kB 00:00 2024-09-12T01:45:49.815 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:49.826 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:45:49.827 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:45:49.827 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:45:49.828 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:45:49.830 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:45:49.832 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:45:49.833 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:45:49.840 INFO:teuthology.orchestra.run.smithi107.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 633 kB/s | 32 kB 00:00 2024-09-12T01:45:49.882 INFO:teuthology.orchestra.run.smithi107.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 752 kB 00:00 2024-09-12T01:45:49.892 INFO:teuthology.orchestra.run.smithi062.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 6.3 MB/s | 1.5 MB 00:00 2024-09-12T01:45:49.895 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-12T01:45:49.907 INFO:teuthology.orchestra.run.smithi107.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T01:45:49.912 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-09-12T01:45:49.912 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-12T01:45:49.912 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:45:49.913 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:45:49.914 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:45:49.915 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:45:49.916 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:45:49.917 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:45:49.918 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:45:49.919 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:45:49.920 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:45:49.920 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:45:49.920 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:45:49.920 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:45:49.920 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:45:49.920 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:45:49.920 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:45:49.920 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:45:49.920 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:45:49.920 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:45:49.921 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:45:49.922 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:45:49.923 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:45:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:45:49.925 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:45:49.926 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-12T01:45:49.926 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-09-12T01:45:49.926 INFO:teuthology.orchestra.run.smithi077.stdout:Install 148 Packages 2024-09-12T01:45:49.926 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 8 Packages 2024-09-12T01:45:49.926 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:45:49.926 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 226 M 2024-09-12T01:45:49.927 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-12T01:45:49.933 INFO:teuthology.orchestra.run.smithi107.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T01:45:49.975 INFO:teuthology.orchestra.run.smithi107.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-12T01:45:50.059 INFO:teuthology.orchestra.run.smithi107.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 541 kB/s | 45 kB 00:00 2024-09-12T01:45:50.159 INFO:teuthology.orchestra.run.smithi107.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.3 MB/s | 136 kB 00:00 2024-09-12T01:45:50.301 INFO:teuthology.orchestra.run.smithi107.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-12T01:45:50.326 INFO:teuthology.orchestra.run.smithi107.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 972 kB/s | 162 kB 00:00 2024-09-12T01:45:50.334 INFO:teuthology.orchestra.run.smithi062.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 8.1 MB/s | 4.7 MB 00:00 2024-09-12T01:45:50.360 INFO:teuthology.orchestra.run.smithi107.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-12T01:45:50.410 INFO:teuthology.orchestra.run.smithi107.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.5 MB/s | 301 kB 00:00 2024-09-12T01:45:50.444 INFO:teuthology.orchestra.run.smithi107.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.2 MB/s | 100 kB 00:00 2024-09-12T01:45:50.455 INFO:teuthology.orchestra.run.smithi077.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 26 kB/s | 6.5 kB 00:00 2024-09-12T01:45:50.511 INFO:teuthology.orchestra.run.smithi107.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 850 kB/s | 85 kB 00:00 2024-09-12T01:45:50.620 INFO:teuthology.orchestra.run.smithi107.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.5 MB/s | 171 kB 00:00 2024-09-12T01:45:50.720 INFO:teuthology.orchestra.run.smithi107.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 319 kB/s | 32 kB 00:00 2024-09-12T01:45:50.795 INFO:teuthology.orchestra.run.smithi107.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 3.1 MB 00:00 2024-09-12T01:45:50.820 INFO:teuthology.orchestra.run.smithi107.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.4 MB/s | 146 kB 00:00 2024-09-12T01:45:51.154 INFO:teuthology.orchestra.run.smithi107.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 9.9 MB/s | 3.6 MB 00:00 2024-09-12T01:45:51.222 INFO:teuthology.orchestra.run.smithi077.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.1 MB/s | 897 kB 00:00 2024-09-12T01:45:51.238 INFO:teuthology.orchestra.run.smithi107.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.9 MB/s | 249 kB 00:00 2024-09-12T01:45:51.296 INFO:teuthology.orchestra.run.smithi107.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 849 kB/s | 49 kB 00:00 2024-09-12T01:45:51.306 INFO:teuthology.orchestra.run.smithi077.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.7 MB/s | 145 kB 00:00 2024-09-12T01:45:51.396 INFO:teuthology.orchestra.run.smithi107.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-12T01:45:51.413 INFO:teuthology.orchestra.run.smithi107.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 140 kB/s | 16 kB 00:00 2024-09-12T01:45:51.434 INFO:teuthology.orchestra.run.smithi062.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 7.0 MB/s | 21 MB 00:03 2024-09-12T01:45:51.455 INFO:teuthology.orchestra.run.smithi107.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.7 MB/s | 285 kB 00:00 2024-09-12T01:45:51.498 INFO:teuthology.orchestra.run.smithi107.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 8.9 MB/s | 765 kB 00:00 2024-09-12T01:45:51.514 INFO:teuthology.orchestra.run.smithi107.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 312 kB/s | 18 kB 00:00 2024-09-12T01:45:51.534 INFO:teuthology.orchestra.run.smithi062.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 252 kB/s | 25 kB 00:00 2024-09-12T01:45:51.657 INFO:teuthology.orchestra.run.smithi107.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 503 kB/s | 80 kB 00:00 2024-09-12T01:45:51.740 INFO:teuthology.orchestra.run.smithi107.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T01:45:51.772 INFO:teuthology.orchestra.run.smithi077.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 5.1 MB/s | 2.4 MB 00:00 2024-09-12T01:45:51.845 INFO:teuthology.orchestra.run.smithi107.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-12T01:45:51.876 INFO:teuthology.orchestra.run.smithi062.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 6.9 MB/s | 11 MB 00:01 2024-09-12T01:45:51.878 INFO:teuthology.orchestra.run.smithi107.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-09-12T01:45:51.929 INFO:teuthology.orchestra.run.smithi107.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T01:45:51.931 INFO:teuthology.orchestra.run.smithi077.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 3.1 MB/s | 5.4 MB 00:01 2024-09-12T01:45:51.935 INFO:teuthology.orchestra.run.smithi062.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-12T01:45:51.981 INFO:teuthology.orchestra.run.smithi077.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-12T01:45:52.012 INFO:teuthology.orchestra.run.smithi107.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-12T01:45:52.027 INFO:teuthology.orchestra.run.smithi062.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 294 kB/s | 27 kB 00:00 2024-09-12T01:45:52.088 INFO:teuthology.orchestra.run.smithi107.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-12T01:45:52.102 INFO:teuthology.orchestra.run.smithi062.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 425 kB/s | 32 kB 00:00 2024-09-12T01:45:52.171 INFO:teuthology.orchestra.run.smithi107.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-12T01:45:52.239 INFO:teuthology.orchestra.run.smithi107.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-12T01:45:52.277 INFO:teuthology.orchestra.run.smithi062.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.2 MB/s | 752 kB 00:00 2024-09-12T01:45:52.347 INFO:teuthology.orchestra.run.smithi107.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-12T01:45:52.352 INFO:teuthology.orchestra.run.smithi062.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-12T01:45:52.389 INFO:teuthology.orchestra.run.smithi107.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-12T01:45:52.419 INFO:teuthology.orchestra.run.smithi062.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-12T01:45:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-09-12T01:45:52.456 INFO:teuthology.orchestra.run.smithi107.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-12T01:45:52.465 INFO:teuthology.orchestra.run.smithi077.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 8.8 MB/s | 4.7 MB 00:00 2024-09-12T01:45:52.482 INFO:teuthology.orchestra.run.smithi107.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-09-12T01:45:52.499 INFO:teuthology.orchestra.run.smithi107.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 774 kB/s | 33 kB 00:00 2024-09-12T01:45:52.520 INFO:teuthology.orchestra.run.smithi062.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.9 MB/s | 506 kB 00:00 2024-09-12T01:45:52.557 INFO:teuthology.orchestra.run.smithi107.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-09-12T01:45:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:(18/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 6.0 MB/s | 17 MB 00:02 2024-09-12T01:45:52.812 INFO:teuthology.orchestra.run.smithi062.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 453 kB/s | 45 kB 00:00 2024-09-12T01:45:52.896 INFO:teuthology.orchestra.run.smithi062.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.6 MB/s | 136 kB 00:00 2024-09-12T01:45:52.996 INFO:teuthology.orchestra.run.smithi062.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.6 MB/s | 162 kB 00:00 2024-09-12T01:45:53.000 INFO:teuthology.orchestra.run.smithi107.stdout:(55/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 14 MB/s | 49 MB 00:03 2024-09-12T01:45:53.025 INFO:teuthology.orchestra.run.smithi107.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-09-12T01:45:53.058 INFO:teuthology.orchestra.run.smithi107.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T01:45:53.117 INFO:teuthology.orchestra.run.smithi107.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.7 MB/s | 3.0 MB 00:00 2024-09-12T01:45:53.121 INFO:teuthology.orchestra.run.smithi062.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.5 MB/s | 321 kB 00:00 2024-09-12T01:45:53.142 INFO:teuthology.orchestra.run.smithi107.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-12T01:45:53.165 INFO:teuthology.orchestra.run.smithi077.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 15 MB/s | 11 MB 00:00 2024-09-12T01:45:53.176 INFO:teuthology.orchestra.run.smithi107.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-12T01:45:53.197 INFO:teuthology.orchestra.run.smithi062.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-12T01:45:53.209 INFO:teuthology.orchestra.run.smithi107.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-12T01:45:53.235 INFO:teuthology.orchestra.run.smithi107.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 265 kB/s | 24 kB 00:00 2024-09-12T01:45:53.247 INFO:teuthology.orchestra.run.smithi062.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 2.0 MB/s | 100 kB 00:00 2024-09-12T01:45:53.260 INFO:teuthology.orchestra.run.smithi107.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-12T01:45:53.285 INFO:teuthology.orchestra.run.smithi107.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T01:45:53.311 INFO:teuthology.orchestra.run.smithi107.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-12T01:45:53.332 INFO:teuthology.orchestra.run.smithi077.stdout:(9/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 17 MB 00:01 2024-09-12T01:45:53.336 INFO:teuthology.orchestra.run.smithi107.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-12T01:45:53.339 INFO:teuthology.orchestra.run.smithi062.stdout:(25/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 6.5 MB/s | 5.3 MB 00:00 2024-09-12T01:45:53.357 INFO:teuthology.orchestra.run.smithi077.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 131 kB/s | 25 kB 00:00 2024-09-12T01:45:53.364 INFO:teuthology.orchestra.run.smithi062.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 729 kB/s | 85 kB 00:00 2024-09-12T01:45:53.425 INFO:teuthology.orchestra.run.smithi077.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.3 MB/s | 228 kB 00:00 2024-09-12T01:45:53.428 INFO:teuthology.orchestra.run.smithi107.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-12T01:45:53.439 INFO:teuthology.orchestra.run.smithi062.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-12T01:45:53.475 INFO:teuthology.orchestra.run.smithi077.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 543 kB/s | 27 kB 00:00 2024-09-12T01:45:53.503 INFO:teuthology.orchestra.run.smithi107.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 23 MB/s | 4.9 MB 00:00 2024-09-12T01:45:53.540 INFO:teuthology.orchestra.run.smithi062.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 318 kB/s | 32 kB 00:00 2024-09-12T01:45:53.545 INFO:teuthology.orchestra.run.smithi107.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-12T01:45:53.558 INFO:teuthology.orchestra.run.smithi077.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 382 kB/s | 32 kB 00:00 2024-09-12T01:45:53.570 INFO:teuthology.orchestra.run.smithi107.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T01:45:53.598 INFO:teuthology.orchestra.run.smithi062.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.5 MB/s | 146 kB 00:00 2024-09-12T01:45:53.604 INFO:teuthology.orchestra.run.smithi107.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-12T01:45:53.646 INFO:teuthology.orchestra.run.smithi107.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-12T01:45:53.650 INFO:teuthology.orchestra.run.smithi077.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.0 MB/s | 752 kB 00:00 2024-09-12T01:45:53.671 INFO:teuthology.orchestra.run.smithi107.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-12T01:45:53.734 INFO:teuthology.orchestra.run.smithi077.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.9 MB/s | 163 kB 00:00 2024-09-12T01:45:53.738 INFO:teuthology.orchestra.run.smithi107.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 920 kB/s | 61 kB 00:00 2024-09-12T01:45:53.809 INFO:teuthology.orchestra.run.smithi077.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.6 MB/s | 127 kB 00:00 2024-09-12T01:45:53.814 INFO:teuthology.orchestra.run.smithi107.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-12T01:45:53.832 INFO:teuthology.orchestra.run.smithi062.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 6.3 MB/s | 3.1 MB 00:00 2024-09-12T01:45:53.839 INFO:teuthology.orchestra.run.smithi107.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T01:45:53.873 INFO:teuthology.orchestra.run.smithi107.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-12T01:45:53.898 INFO:teuthology.orchestra.run.smithi107.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-12T01:45:53.909 INFO:teuthology.orchestra.run.smithi077.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.0 MB/s | 506 kB 00:00 2024-09-12T01:45:53.923 INFO:teuthology.orchestra.run.smithi107.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-12T01:45:53.949 INFO:teuthology.orchestra.run.smithi107.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-12T01:45:53.974 INFO:teuthology.orchestra.run.smithi107.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 689 kB/s | 35 kB 00:00 2024-09-12T01:45:54.057 INFO:teuthology.orchestra.run.smithi107.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-12T01:45:54.091 INFO:teuthology.orchestra.run.smithi107.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-12T01:45:54.117 INFO:teuthology.orchestra.run.smithi107.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T01:45:54.142 INFO:teuthology.orchestra.run.smithi107.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T01:45:54.159 INFO:teuthology.orchestra.run.smithi107.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-12T01:45:54.192 INFO:teuthology.orchestra.run.smithi107.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-12T01:45:54.218 INFO:teuthology.orchestra.run.smithi107.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-12T01:45:54.243 INFO:teuthology.orchestra.run.smithi107.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T01:45:54.268 INFO:teuthology.orchestra.run.smithi107.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T01:45:54.293 INFO:teuthology.orchestra.run.smithi107.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T01:45:54.377 INFO:teuthology.orchestra.run.smithi107.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T01:45:54.401 INFO:teuthology.orchestra.run.smithi077.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-12T01:45:54.402 INFO:teuthology.orchestra.run.smithi107.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-12T01:45:54.428 INFO:teuthology.orchestra.run.smithi107.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-12T01:45:54.449 INFO:teuthology.orchestra.run.smithi062.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 4.2 MB/s | 3.6 MB 00:00 2024-09-12T01:45:54.452 INFO:teuthology.orchestra.run.smithi077.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 903 kB/s | 45 kB 00:00 2024-09-12T01:45:54.461 INFO:teuthology.orchestra.run.smithi107.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T01:45:54.487 INFO:teuthology.orchestra.run.smithi107.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-12T01:45:54.512 INFO:teuthology.orchestra.run.smithi107.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-12T01:45:54.527 INFO:teuthology.orchestra.run.smithi077.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-12T01:45:54.537 INFO:teuthology.orchestra.run.smithi107.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T01:45:54.563 INFO:teuthology.orchestra.run.smithi107.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T01:45:54.565 INFO:teuthology.orchestra.run.smithi062.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.1 MB/s | 249 kB 00:00 2024-09-12T01:45:54.588 INFO:teuthology.orchestra.run.smithi107.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T01:45:54.602 INFO:teuthology.orchestra.run.smithi077.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 162 kB 00:00 2024-09-12T01:45:54.613 INFO:teuthology.orchestra.run.smithi107.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T01:45:54.639 INFO:teuthology.orchestra.run.smithi107.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-12T01:45:54.658 INFO:teuthology.orchestra.run.smithi062.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 537 kB/s | 49 kB 00:00 2024-09-12T01:45:54.677 INFO:teuthology.orchestra.run.smithi077.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.2 MB/s | 321 kB 00:00 2024-09-12T01:45:54.742 INFO:teuthology.orchestra.run.smithi062.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 197 kB/s | 16 kB 00:00 2024-09-12T01:45:54.753 INFO:teuthology.orchestra.run.smithi077.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-12T01:45:54.837 INFO:teuthology.orchestra.run.smithi077.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.2 MB/s | 100 kB 00:00 2024-09-12T01:45:54.858 INFO:teuthology.orchestra.run.smithi062.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.4 MB/s | 285 kB 00:00 2024-09-12T01:45:54.864 INFO:teuthology.orchestra.run.smithi107.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-12T01:45:54.889 INFO:teuthology.orchestra.run.smithi107.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-09-12T01:45:54.903 INFO:teuthology.orchestra.run.smithi077.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-12T01:45:54.948 INFO:teuthology.orchestra.run.smithi107.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-12T01:45:54.973 INFO:teuthology.orchestra.run.smithi107.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-12T01:45:55.007 INFO:teuthology.orchestra.run.smithi107.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-09-12T01:45:55.031 INFO:teuthology.orchestra.run.smithi062.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 6.2 MB/s | 7.4 MB 00:01 2024-09-12T01:45:55.032 INFO:teuthology.orchestra.run.smithi107.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:45:55.058 INFO:teuthology.orchestra.run.smithi107.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T01:45:55.075 INFO:teuthology.orchestra.run.smithi062.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 413 kB/s | 18 kB 00:00 2024-09-12T01:45:55.083 INFO:teuthology.orchestra.run.smithi107.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T01:45:55.108 INFO:teuthology.orchestra.run.smithi107.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-12T01:45:55.118 INFO:teuthology.orchestra.run.smithi062.stdout:(38/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 2.9 MB/s | 765 kB 00:00 2024-09-12T01:45:55.150 INFO:teuthology.orchestra.run.smithi107.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T01:45:55.184 INFO:teuthology.orchestra.run.smithi107.stdout:(113/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.5 MB/s | 863 kB 00:00 2024-09-12T01:45:55.258 INFO:teuthology.orchestra.run.smithi107.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 5.0 MB/s | 548 kB 00:00 2024-09-12T01:45:55.342 INFO:teuthology.orchestra.run.smithi107.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 392 kB/s | 32 kB 00:00 2024-09-12T01:45:55.368 INFO:teuthology.orchestra.run.smithi107.stdout:(116/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 236 kB/s | 43 kB 00:00 2024-09-12T01:45:55.385 INFO:teuthology.orchestra.run.smithi107.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 337 kB/s | 14 kB 00:00 2024-09-12T01:45:55.419 INFO:teuthology.orchestra.run.smithi107.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T01:45:55.420 INFO:teuthology.orchestra.run.smithi077.stdout:(26/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 23 MB/s | 49 MB 00:02 2024-09-12T01:45:55.444 INFO:teuthology.orchestra.run.smithi107.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T01:45:55.478 INFO:teuthology.orchestra.run.smithi107.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T01:45:55.503 INFO:teuthology.orchestra.run.smithi107.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T01:45:55.507 INFO:teuthology.orchestra.run.smithi077.stdout:(27/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 5.1 MB/s | 3.1 MB 00:00 2024-09-12T01:45:55.528 INFO:teuthology.orchestra.run.smithi107.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T01:45:55.537 INFO:teuthology.orchestra.run.smithi077.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.4 MB/s | 171 kB 00:00 2024-09-12T01:45:55.553 INFO:teuthology.orchestra.run.smithi107.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-12T01:45:55.563 INFO:teuthology.orchestra.run.smithi077.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 573 kB/s | 32 kB 00:00 2024-09-12T01:45:55.578 INFO:teuthology.orchestra.run.smithi107.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-12T01:45:55.588 INFO:teuthology.orchestra.run.smithi077.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.8 MB/s | 146 kB 00:00 2024-09-12T01:45:55.604 INFO:teuthology.orchestra.run.smithi107.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-12T01:45:55.618 INFO:teuthology.orchestra.run.smithi062.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 12 MB/s | 49 MB 00:04 2024-09-12T01:45:55.629 INFO:teuthology.orchestra.run.smithi107.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-12T01:45:55.654 INFO:teuthology.orchestra.run.smithi107.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-12T01:45:55.730 INFO:teuthology.orchestra.run.smithi107.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-09-12T01:45:55.755 INFO:teuthology.orchestra.run.smithi107.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:45:55.780 INFO:teuthology.orchestra.run.smithi107.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:45:55.788 INFO:teuthology.orchestra.run.smithi077.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 16 MB/s | 3.6 MB 00:00 2024-09-12T01:45:55.814 INFO:teuthology.orchestra.run.smithi107.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-12T01:45:55.839 INFO:teuthology.orchestra.run.smithi077.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T01:45:55.839 INFO:teuthology.orchestra.run.smithi107.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 984 kB/s | 58 kB 00:00 2024-09-12T01:45:55.865 INFO:teuthology.orchestra.run.smithi107.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-12T01:45:55.890 INFO:teuthology.orchestra.run.smithi107.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T01:45:55.924 INFO:teuthology.orchestra.run.smithi107.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-12T01:45:55.931 INFO:teuthology.orchestra.run.smithi077.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 22 MB/s | 7.4 MB 00:00 2024-09-12T01:45:55.949 INFO:teuthology.orchestra.run.smithi107.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-12T01:45:55.956 INFO:teuthology.orchestra.run.smithi077.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 422 kB/s | 49 kB 00:00 2024-09-12T01:45:55.981 INFO:teuthology.orchestra.run.smithi077.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 329 kB/s | 16 kB 00:00 2024-09-12T01:45:55.991 INFO:teuthology.orchestra.run.smithi107.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-12T01:45:56.006 INFO:teuthology.orchestra.run.smithi077.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.6 MB/s | 285 kB 00:00 2024-09-12T01:45:56.017 INFO:teuthology.orchestra.run.smithi107.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-12T01:45:56.040 INFO:teuthology.orchestra.run.smithi077.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 13 MB/s | 765 kB 00:00 2024-09-12T01:45:56.042 INFO:teuthology.orchestra.run.smithi107.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T01:45:56.065 INFO:teuthology.orchestra.run.smithi077.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 311 kB/s | 18 kB 00:00 2024-09-12T01:45:56.067 INFO:teuthology.orchestra.run.smithi107.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-12T01:45:56.093 INFO:teuthology.orchestra.run.smithi107.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T01:45:56.118 INFO:teuthology.orchestra.run.smithi107.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-12T01:45:56.143 INFO:teuthology.orchestra.run.smithi107.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T01:45:56.168 INFO:teuthology.orchestra.run.smithi107.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T01:45:56.193 INFO:teuthology.orchestra.run.smithi107.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T01:45:56.199 INFO:teuthology.orchestra.run.smithi077.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 503 kB/s | 80 kB 00:00 2024-09-12T01:45:56.207 INFO:teuthology.orchestra.run.smithi062.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 71 kB/s | 80 kB 00:01 2024-09-12T01:45:56.227 INFO:teuthology.orchestra.run.smithi107.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-12T01:45:56.272 INFO:teuthology.orchestra.run.smithi107.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 2.4 MB/s | 191 kB 00:00 2024-09-12T01:45:56.283 INFO:teuthology.orchestra.run.smithi077.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T01:45:56.320 INFO:teuthology.orchestra.run.smithi107.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-12T01:45:56.335 INFO:teuthology.orchestra.run.smithi062.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 267 kB/s | 191 kB 00:00 2024-09-12T01:45:56.358 INFO:teuthology.orchestra.run.smithi077.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-12T01:45:56.383 INFO:teuthology.orchestra.run.smithi077.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-12T01:45:56.433 INFO:teuthology.orchestra.run.smithi077.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T01:45:56.444 INFO:teuthology.orchestra.run.smithi062.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 604 kB/s | 801 kB 00:01 2024-09-12T01:45:56.493 INFO:teuthology.orchestra.run.smithi077.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T01:45:56.542 INFO:teuthology.orchestra.run.smithi077.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-09-12T01:45:56.545 INFO:teuthology.orchestra.run.smithi107.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-12T01:45:56.595 INFO:teuthology.orchestra.run.smithi107.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.8 MB/s | 3.2 MB 00:00 2024-09-12T01:45:56.601 INFO:teuthology.orchestra.run.smithi077.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T01:45:56.702 INFO:teuthology.orchestra.run.smithi077.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 6.7 MB/s | 689 kB 00:00 2024-09-12T01:45:56.704 INFO:teuthology.orchestra.run.smithi107.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-12T01:45:56.794 INFO:teuthology.orchestra.run.smithi077.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.8 MB/s | 1.2 MB 00:00 2024-09-12T01:45:56.821 INFO:teuthology.orchestra.run.smithi107.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-12T01:45:56.877 INFO:teuthology.orchestra.run.smithi077.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-09-12T01:45:56.919 INFO:teuthology.orchestra.run.smithi077.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-12T01:45:56.921 INFO:teuthology.orchestra.run.smithi107.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 3.9 MB/s | 2.3 MB 00:00 2024-09-12T01:45:56.936 INFO:teuthology.orchestra.run.smithi077.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-12T01:45:56.978 INFO:teuthology.orchestra.run.smithi077.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 787 kB/s | 33 kB 00:00 2024-09-12T01:45:57.027 INFO:teuthology.orchestra.run.smithi062.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 309 kB/s | 253 kB 00:00 2024-09-12T01:45:57.095 INFO:teuthology.orchestra.run.smithi077.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-09-12T01:45:57.128 INFO:teuthology.orchestra.run.smithi062.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 159 kB/s | 106 kB 00:00 2024-09-12T01:45:57.137 INFO:teuthology.orchestra.run.smithi077.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-12T01:45:57.171 INFO:teuthology.orchestra.run.smithi107.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 2.9 MB/s | 1.8 MB 00:00 2024-09-12T01:45:57.187 INFO:teuthology.orchestra.run.smithi077.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T01:45:57.253 INFO:teuthology.orchestra.run.smithi062.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-12T01:45:57.304 INFO:teuthology.orchestra.run.smithi077.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-12T01:45:57.305 INFO:teuthology.orchestra.run.smithi107.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 2.4 MB 00:00 2024-09-12T01:45:57.354 INFO:teuthology.orchestra.run.smithi077.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-12T01:45:57.363 INFO:teuthology.orchestra.run.smithi107.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 2.5 MB/s | 1.4 MB 00:00 2024-09-12T01:45:57.369 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:45:57.370 INFO:teuthology.orchestra.run.smithi107.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-12T01:45:57.605 INFO:teuthology.orchestra.run.smithi077.stdout:(58/156): ceph-common-19.1.1-298.gb53b6d3e.el9. 2.9 MB/s | 21 MB 00:07 2024-09-12T01:45:57.647 INFO:teuthology.orchestra.run.smithi077.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-12T01:45:57.697 INFO:teuthology.orchestra.run.smithi077.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 491 kB/s | 24 kB 00:00 2024-09-12T01:45:57.747 INFO:teuthology.orchestra.run.smithi077.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-09-12T01:45:57.753 INFO:teuthology.orchestra.run.smithi062.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 186 kB/s | 135 kB 00:00 2024-09-12T01:45:57.805 INFO:teuthology.orchestra.run.smithi062.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 185 kB/s | 125 kB 00:00 2024-09-12T01:45:57.881 INFO:teuthology.orchestra.run.smithi077.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 2.1 MB/s | 581 kB 00:00 2024-09-12T01:45:57.948 INFO:teuthology.orchestra.run.smithi077.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-12T01:45:57.973 INFO:teuthology.orchestra.run.smithi077.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-12T01:45:57.979 INFO:teuthology.orchestra.run.smithi062.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 296 kB/s | 215 kB 00:00 2024-09-12T01:45:57.998 INFO:teuthology.orchestra.run.smithi077.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-12T01:45:58.028 INFO:teuthology.orchestra.run.smithi062.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-12T01:45:58.090 INFO:teuthology.orchestra.run.smithi062.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-09-12T01:45:58.125 INFO:teuthology.orchestra.run.smithi062.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-09-12T01:45:58.172 INFO:teuthology.orchestra.run.smithi062.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-12T01:45:58.213 INFO:teuthology.orchestra.run.smithi062.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-09-12T01:45:58.238 INFO:teuthology.orchestra.run.smithi062.stdout:(54/156): boost-program-options-1.75.0-8.el9.x8 412 kB/s | 107 kB 00:00 2024-09-12T01:45:58.305 INFO:teuthology.orchestra.run.smithi062.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-12T01:45:58.331 INFO:teuthology.orchestra.run.smithi062.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-12T01:45:58.348 INFO:teuthology.orchestra.run.smithi077.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.2 MB/s | 3.0 MB 00:01 2024-09-12T01:45:58.356 INFO:teuthology.orchestra.run.smithi062.stdout:(57/156): flexiblas-openblas-openmp-3.0.4-8.el9 128 kB/s | 18 kB 00:00 2024-09-12T01:45:58.381 INFO:teuthology.orchestra.run.smithi062.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T01:45:58.406 INFO:teuthology.orchestra.run.smithi062.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-12T01:45:58.457 INFO:teuthology.orchestra.run.smithi062.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-12T01:45:58.482 INFO:teuthology.orchestra.run.smithi062.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-12T01:45:58.515 INFO:teuthology.orchestra.run.smithi062.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-12T01:45:58.541 INFO:teuthology.orchestra.run.smithi062.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-12T01:45:58.601 INFO:teuthology.orchestra.run.smithi062.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T01:45:58.624 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-12T01:45:58.633 INFO:teuthology.orchestra.run.smithi062.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 419 kB/s | 38 kB 00:00 2024-09-12T01:45:58.659 INFO:teuthology.orchestra.run.smithi062.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-12T01:45:58.774 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-12T01:45:58.774 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-12T01:45:58.800 INFO:teuthology.orchestra.run.smithi062.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-09-12T01:45:58.884 INFO:teuthology.orchestra.run.smithi062.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 17 MB/s | 4.9 MB 00:00 2024-09-12T01:45:58.926 INFO:teuthology.orchestra.run.smithi062.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-09-12T01:45:58.951 INFO:teuthology.orchestra.run.smithi062.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T01:45:58.993 INFO:teuthology.orchestra.run.smithi062.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-12T01:45:59.052 INFO:teuthology.orchestra.run.smithi062.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T01:45:59.103 INFO:teuthology.orchestra.run.smithi062.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-12T01:45:59.132 INFO:teuthology.orchestra.run.smithi077.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-12T01:45:59.186 INFO:teuthology.orchestra.run.smithi062.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-12T01:45:59.211 INFO:teuthology.orchestra.run.smithi062.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 570 kB/s | 61 kB 00:00 2024-09-12T01:45:59.252 INFO:teuthology.orchestra.run.smithi062.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-12T01:45:59.295 INFO:teuthology.orchestra.run.smithi062.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-12T01:45:59.311 INFO:teuthology.orchestra.run.smithi062.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-12T01:45:59.387 INFO:teuthology.orchestra.run.smithi062.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-12T01:45:59.403 INFO:teuthology.orchestra.run.smithi062.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-12T01:45:59.429 INFO:teuthology.orchestra.run.smithi062.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-12T01:45:59.446 INFO:teuthology.orchestra.run.smithi062.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 590 kB/s | 35 kB 00:00 2024-09-12T01:45:59.521 INFO:teuthology.orchestra.run.smithi062.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-12T01:45:59.546 INFO:teuthology.orchestra.run.smithi062.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-12T01:45:59.581 INFO:teuthology.orchestra.run.smithi062.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T01:45:59.599 INFO:teuthology.orchestra.run.smithi077.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 1.9 MB/s | 910 kB 00:00 2024-09-12T01:45:59.665 INFO:teuthology.orchestra.run.smithi062.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-12T01:45:59.689 INFO:teuthology.orchestra.run.smithi062.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 296 kB/s | 42 kB 00:00 2024-09-12T01:45:59.715 INFO:teuthology.orchestra.run.smithi062.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-09-12T01:45:59.715 INFO:teuthology.orchestra.run.smithi077.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-12T01:45:59.740 INFO:teuthology.orchestra.run.smithi062.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T01:45:59.782 INFO:teuthology.orchestra.run.smithi062.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-12T01:45:59.783 INFO:teuthology.orchestra.run.smithi077.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.7 MB/s | 4.9 MB 00:01 2024-09-12T01:45:59.807 INFO:teuthology.orchestra.run.smithi062.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-09-12T01:45:59.833 INFO:teuthology.orchestra.run.smithi062.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 583 kB/s | 54 kB 00:00 2024-09-12T01:45:59.866 INFO:teuthology.orchestra.run.smithi062.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-12T01:45:59.900 INFO:teuthology.orchestra.run.smithi062.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-09-12T01:45:59.925 INFO:teuthology.orchestra.run.smithi062.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T01:45:59.992 INFO:teuthology.orchestra.run.smithi062.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-09-12T01:46:00.026 INFO:teuthology.orchestra.run.smithi062.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-09-12T01:46:00.076 INFO:teuthology.orchestra.run.smithi062.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-12T01:46:00.126 INFO:teuthology.orchestra.run.smithi062.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 579 kB/s | 58 kB 00:00 2024-09-12T01:46:00.152 INFO:teuthology.orchestra.run.smithi062.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-12T01:46:00.191 INFO:teuthology.orchestra.run.smithi077.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-12T01:46:00.194 INFO:teuthology.orchestra.run.smithi062.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 951 kB/s | 64 kB 00:00 2024-09-12T01:46:00.275 INFO:teuthology.orchestra.run.smithi077.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-12T01:46:00.342 INFO:teuthology.orchestra.run.smithi077.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-09-12T01:46:00.360 INFO:teuthology.orchestra.run.smithi062.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-12T01:46:00.394 INFO:teuthology.orchestra.run.smithi062.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 185 kB/s | 45 kB 00:00 2024-09-12T01:46:00.400 INFO:teuthology.orchestra.run.smithi077.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-12T01:46:00.419 INFO:teuthology.orchestra.run.smithi062.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 99 kB/s | 22 kB 00:00 2024-09-12T01:46:00.495 INFO:teuthology.orchestra.run.smithi062.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-12T01:46:00.520 INFO:teuthology.orchestra.run.smithi062.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-12T01:46:00.543 INFO:teuthology.orchestra.run.smithi077.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-12T01:46:00.553 INFO:teuthology.orchestra.run.smithi062.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.3 MB/s | 309 kB 00:00 2024-09-12T01:46:00.567 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-12T01:46:00.568 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-12T01:46:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:46:00.646 INFO:teuthology.orchestra.run.smithi062.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-12T01:46:00.671 INFO:teuthology.orchestra.run.smithi062.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 529 kB/s | 49 kB 00:00 2024-09-12T01:46:00.692 INFO:teuthology.orchestra.run.smithi077.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-12T01:46:00.713 INFO:teuthology.orchestra.run.smithi062.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.9 MB/s | 151 kB 00:00 2024-09-12T01:46:00.743 INFO:teuthology.orchestra.run.smithi077.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-12T01:46:00.746 INFO:teuthology.orchestra.run.smithi062.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 672 kB/s | 67 kB 00:00 2024-09-12T01:46:00.789 INFO:teuthology.orchestra.run.smithi062.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-12T01:46:00.793 INFO:teuthology.orchestra.run.smithi077.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-12T01:46:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T01:46:00.847 INFO:teuthology.orchestra.run.smithi062.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-12T01:46:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-12T01:46:00.882 INFO:teuthology.orchestra.run.smithi062.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 422 kB/s | 14 kB 00:00 2024-09-12T01:46:00.902 INFO:teuthology.orchestra.run.smithi077.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-12T01:46:00.915 INFO:teuthology.orchestra.run.smithi062.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-12T01:46:00.949 INFO:teuthology.orchestra.run.smithi062.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-09-12T01:46:00.952 INFO:teuthology.orchestra.run.smithi077.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-12T01:46:00.974 INFO:teuthology.orchestra.run.smithi062.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T01:46:00.999 INFO:teuthology.orchestra.run.smithi062.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T01:46:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T01:46:01.066 INFO:teuthology.orchestra.run.smithi062.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 323 kB/s | 11 kB 00:00 2024-09-12T01:46:01.092 INFO:teuthology.orchestra.run.smithi062.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-12T01:46:01.117 INFO:teuthology.orchestra.run.smithi062.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 938 kB/s | 23 kB 00:00 2024-09-12T01:46:01.159 INFO:teuthology.orchestra.run.smithi062.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 465 kB/s | 19 kB 00:00 2024-09-12T01:46:01.176 INFO:teuthology.orchestra.run.smithi062.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-12T01:46:01.251 INFO:teuthology.orchestra.run.smithi062.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-09-12T01:46:01.268 INFO:teuthology.orchestra.run.smithi062.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-12T01:46:01.285 INFO:teuthology.orchestra.run.smithi062.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-09-12T01:46:01.416 INFO:teuthology.orchestra.run.smithi062.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 444 kB/s | 58 kB 00:00 2024-09-12T01:46:01.478 INFO:teuthology.orchestra.run.smithi062.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-12T01:46:01.503 INFO:teuthology.orchestra.run.smithi062.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 669 kB/s | 16 kB 00:00 2024-09-12T01:46:01.528 INFO:teuthology.orchestra.run.smithi062.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T01:46:01.554 INFO:teuthology.orchestra.run.smithi062.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T01:46:01.612 INFO:teuthology.orchestra.run.smithi062.stdout:(136/156): libarrow-9.0.0-11.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-12T01:46:01.665 INFO:teuthology.orchestra.run.smithi062.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 276 kB/s | 31 kB 00:00 2024-09-12T01:46:01.696 INFO:teuthology.orchestra.run.smithi062.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 972 kB/s | 272 kB 00:00 2024-09-12T01:46:01.721 INFO:teuthology.orchestra.run.smithi062.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-12T01:46:01.747 INFO:teuthology.orchestra.run.smithi062.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 719 kB/s | 36 kB 00:00 2024-09-12T01:46:01.772 INFO:teuthology.orchestra.run.smithi062.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T01:46:01.797 INFO:teuthology.orchestra.run.smithi062.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T01:46:01.822 INFO:teuthology.orchestra.run.smithi062.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T01:46:01.848 INFO:teuthology.orchestra.run.smithi062.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-09-12T01:46:01.873 INFO:teuthology.orchestra.run.smithi062.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T01:46:01.906 INFO:teuthology.orchestra.run.smithi062.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T01:46:01.932 INFO:teuthology.orchestra.run.smithi062.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T01:46:01.990 INFO:teuthology.orchestra.run.smithi062.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-12T01:46:02.036 INFO:teuthology.orchestra.run.smithi077.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 2.5 MB/s | 5.8 MB 00:02 2024-09-12T01:46:02.111 INFO:teuthology.orchestra.run.smithi077.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-09-12T01:46:02.136 INFO:teuthology.orchestra.run.smithi077.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-12T01:46:02.220 INFO:teuthology.orchestra.run.smithi077.stdout:(84/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.1 MB/s | 6.0 MB 00:01 2024-09-12T01:46:02.245 INFO:teuthology.orchestra.run.smithi077.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 710 kB/s | 77 kB 00:00 2024-09-12T01:46:02.271 INFO:teuthology.orchestra.run.smithi077.stdout:(86/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-12T01:46:02.287 INFO:teuthology.orchestra.run.smithi077.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 628 kB/s | 42 kB 00:00 2024-09-12T01:46:02.313 INFO:teuthology.orchestra.run.smithi077.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-12T01:46:02.338 INFO:teuthology.orchestra.run.smithi077.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-12T01:46:02.372 INFO:teuthology.orchestra.run.smithi077.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-12T01:46:02.397 INFO:teuthology.orchestra.run.smithi077.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-12T01:46:02.422 INFO:teuthology.orchestra.run.smithi077.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 642 kB/s | 54 kB 00:00 2024-09-12T01:46:02.481 INFO:teuthology.orchestra.run.smithi077.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 714 kB/s | 42 kB 00:00 2024-09-12T01:46:02.506 INFO:teuthology.orchestra.run.smithi077.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 528 kB/s | 44 kB 00:00 2024-09-12T01:46:02.539 INFO:teuthology.orchestra.run.smithi077.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T01:46:02.565 INFO:teuthology.orchestra.run.smithi077.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-12T01:46:02.590 INFO:teuthology.orchestra.run.smithi077.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-12T01:46:02.590 INFO:teuthology.orchestra.run.smithi062.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 4.8 MB/s | 3.2 MB 00:00 2024-09-12T01:46:02.624 INFO:teuthology.orchestra.run.smithi077.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T01:46:02.640 INFO:teuthology.orchestra.run.smithi077.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T01:46:02.683 INFO:teuthology.orchestra.run.smithi077.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-12T01:46:02.708 INFO:teuthology.orchestra.run.smithi077.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 948 kB/s | 64 kB 00:00 2024-09-12T01:46:02.733 INFO:teuthology.orchestra.run.smithi077.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-12T01:46:02.891 INFO:teuthology.orchestra.run.smithi062.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 3.5 MB/s | 3.4 MB 00:00 2024-09-12T01:46:02.892 INFO:teuthology.orchestra.run.smithi077.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-12T01:46:02.951 INFO:teuthology.orchestra.run.smithi077.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T01:46:02.976 INFO:teuthology.orchestra.run.smithi077.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-12T01:46:03.009 INFO:teuthology.orchestra.run.smithi077.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 5.2 MB/s | 309 kB 00:00 2024-09-12T01:46:03.035 INFO:teuthology.orchestra.run.smithi077.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-12T01:46:03.060 INFO:teuthology.orchestra.run.smithi077.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:46:03.085 INFO:teuthology.orchestra.run.smithi077.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T01:46:03.119 INFO:teuthology.orchestra.run.smithi077.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-12T01:46:03.152 INFO:teuthology.orchestra.run.smithi077.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-12T01:46:03.164 INFO:teuthology.orchestra.run.smithi062.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 2.0 MB/s | 2.3 MB 00:01 2024-09-12T01:46:03.186 INFO:teuthology.orchestra.run.smithi077.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-12T01:46:03.270 INFO:teuthology.orchestra.run.smithi077.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-12T01:46:03.303 INFO:teuthology.orchestra.run.smithi077.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-12T01:46:03.328 INFO:teuthology.orchestra.run.smithi077.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 745 kB/s | 43 kB 00:00 2024-09-12T01:46:03.354 INFO:teuthology.orchestra.run.smithi077.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 639 kB/s | 32 kB 00:00 2024-09-12T01:46:03.379 INFO:teuthology.orchestra.run.smithi077.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-12T01:46:03.413 INFO:teuthology.orchestra.run.smithi077.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T01:46:03.438 INFO:teuthology.orchestra.run.smithi077.stdout:(119/156): python3-asyncssh-2.13.2-5.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-09-12T01:46:03.463 INFO:teuthology.orchestra.run.smithi077.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-12T01:46:03.488 INFO:teuthology.orchestra.run.smithi077.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T01:46:03.514 INFO:teuthology.orchestra.run.smithi077.stdout:(122/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-09-12T01:46:03.533 INFO:teuthology.orchestra.run.smithi062.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 63 kB/s | 41 kB 00:00 2024-09-12T01:46:03.539 INFO:teuthology.orchestra.run.smithi077.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-12T01:46:03.564 INFO:teuthology.orchestra.run.smithi077.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T01:46:03.590 INFO:teuthology.orchestra.run.smithi077.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-12T01:46:03.592 INFO:teuthology.orchestra.run.smithi062.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:01 2024-09-12T01:46:03.615 INFO:teuthology.orchestra.run.smithi077.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-12T01:46:03.640 INFO:teuthology.orchestra.run.smithi077.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T01:46:03.665 INFO:teuthology.orchestra.run.smithi077.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T01:46:03.699 INFO:teuthology.orchestra.run.smithi077.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-12T01:46:03.724 INFO:teuthology.orchestra.run.smithi077.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:46:03.749 INFO:teuthology.orchestra.run.smithi077.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T01:46:03.783 INFO:teuthology.orchestra.run.smithi077.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-12T01:46:03.808 INFO:teuthology.orchestra.run.smithi077.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-12T01:46:03.834 INFO:teuthology.orchestra.run.smithi077.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T01:46:03.859 INFO:teuthology.orchestra.run.smithi077.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T01:46:03.884 INFO:teuthology.orchestra.run.smithi077.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-12T01:46:03.910 INFO:teuthology.orchestra.run.smithi077.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-12T01:46:03.925 INFO:teuthology.orchestra.run.smithi062.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 332 kB/s | 249 kB 00:00 2024-09-12T01:46:03.935 INFO:teuthology.orchestra.run.smithi077.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T01:46:03.960 INFO:teuthology.orchestra.run.smithi077.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T01:46:03.977 INFO:teuthology.orchestra.run.smithi077.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 858 kB/s | 36 kB 00:00 2024-09-12T01:46:04.002 INFO:teuthology.orchestra.run.smithi077.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-12T01:46:04.044 INFO:teuthology.orchestra.run.smithi077.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-12T01:46:04.070 INFO:teuthology.orchestra.run.smithi077.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-12T01:46:04.103 INFO:teuthology.orchestra.run.smithi077.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T01:46:04.129 INFO:teuthology.orchestra.run.smithi077.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-09-12T01:46:04.171 INFO:teuthology.orchestra.run.smithi077.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T01:46:04.204 INFO:teuthology.orchestra.run.smithi077.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-12T01:46:04.246 INFO:teuthology.orchestra.run.smithi077.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-12T01:46:04.438 INFO:teuthology.orchestra.run.smithi077.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-09-12T01:46:04.492 INFO:teuthology.orchestra.run.smithi062.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-12T01:46:04.497 INFO:teuthology.orchestra.run.smithi077.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-12T01:46:04.539 INFO:teuthology.orchestra.run.smithi077.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-09-12T01:46:04.597 INFO:teuthology.orchestra.run.smithi077.stdout:(152/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 8.0 MB/s | 3.2 MB 00:00 2024-09-12T01:46:04.609 INFO:teuthology.orchestra.run.smithi062.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:01 2024-09-12T01:46:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:46:04.616 INFO:teuthology.orchestra.run.smithi062.stdout:Total 14 MB/s | 226 MB 00:16 2024-09-12T01:46:04.622 INFO:teuthology.orchestra.run.smithi077.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 325 kB/s | 41 kB 00:00 2024-09-12T01:46:04.656 INFO:teuthology.orchestra.run.smithi077.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-12T01:46:04.806 INFO:teuthology.orchestra.run.smithi077.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 1.4 MB 00:00 2024-09-12T01:46:04.890 INFO:teuthology.orchestra.run.smithi077.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 2.4 MB 00:00 2024-09-12T01:46:04.895 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:46:04.896 INFO:teuthology.orchestra.run.smithi077.stdout:Total 15 MB/s | 226 MB 00:14 2024-09-12T01:46:06.120 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-12T01:46:06.271 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-12T01:46:06.271 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-12T01:46:06.744 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-09-12T01:46:06.908 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-12T01:46:06.941 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-09-12T01:46:06.941 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-09-12T01:46:06.992 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:46:07.030 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:46:07.083 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:46:07.117 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:46:07.143 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:46:07.185 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:46:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:46:07.627 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:46:07.749 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:46:07.779 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:46:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:46:07.908 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:46:08.054 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:46:08.080 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-12T01:46:08.080 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-12T01:46:08.105 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:46:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:46:08.228 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:46:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:46:08.297 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:46:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:46:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:46:08.537 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:46:08.677 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:46:08.809 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:46:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:46:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:46:09.225 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:46:09.331 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:46:09.401 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-09-12T01:46:09.401 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-09-12T01:46:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:46:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:46:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:46:09.556 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:46:09.601 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:46:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:46:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:46:09.713 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:46:09.741 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:46:09.809 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:46:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:46:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:46:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:46:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:46:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:46:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:46:10.139 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:46:10.217 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:46:10.262 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:46:10.337 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:46:10.480 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:46:10.532 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:46:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:46:11.151 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:46:11.189 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:46:11.231 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:46:11.270 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:46:11.311 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:46:11.460 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:46:11.507 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:46:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:46:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:46:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:46:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:46:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:46:11.773 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:46:11.815 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:46:11.858 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:46:11.993 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:46:12.035 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:46:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:46:12.179 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:46:12.210 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:46:12.249 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:46:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:46:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:46:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:46:12.501 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:46:12.533 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:46:12.560 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:46:12.595 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:46:12.636 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:46:12.875 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:46:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:46:13.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:46:13.073 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:46:13.115 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:46:13.149 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:46:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:46:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:46:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:46:13.422 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:46:13.477 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:46:14.197 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:46:14.250 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:46:14.276 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:46:14.303 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-12T01:46:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:46:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:46:14.444 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:46:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:46:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:46:14.591 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:46:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:46:14.652 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:46:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:46:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:46:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:46:14.786 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:46:14.810 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:46:14.887 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:46:15.101 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:46:15.204 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:46:15.327 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:46:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:46:15.464 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:46:15.493 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:46:15.526 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:46:15.641 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:46:15.649 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:46:15.698 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:46:15.726 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:46:15.830 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:46:15.852 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:46:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:46:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:46:15.959 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:46:16.104 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:46:16.234 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:46:16.346 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:46:16.449 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:46:16.497 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-09-12T01:46:16.531 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:46:16.623 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:46:16.674 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:46:16.740 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:46:16.768 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:46:16.783 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:46:16.814 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:46:16.854 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:46:16.884 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:46:16.905 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:46:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:46:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:46:16.984 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:46:17.009 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:46:17.037 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:46:17.072 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:46:17.145 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:46:17.197 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:46:17.229 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:46:17.290 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:46:17.304 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:46:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:46:17.322 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:46:17.349 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:46:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:46:17.419 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:46:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:46:17.472 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:46:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:46:17.502 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:46:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:46:17.546 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:46:17.548 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:46:17.631 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:46:17.674 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:46:17.717 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:46:17.731 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:46:17.745 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:46:17.758 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:46:17.816 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:46:17.861 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:46:17.872 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:46:17.914 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:46:17.934 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:46:18.012 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:46:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:46:18.068 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:46:18.115 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:46:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:46:18.137 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:46:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:46:18.202 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:46:18.228 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:46:18.357 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:46:18.388 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:46:18.511 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:46:18.539 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:46:18.581 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:46:18.655 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:46:18.741 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:46:18.771 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:46:18.816 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:46:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:46:18.868 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:46:18.909 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:46:19.015 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:46:19.073 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:46:19.146 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:46:19.179 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:46:19.201 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:46:19.273 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:46:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:46:19.312 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:46:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:46:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:46:19.430 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:46:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:46:19.475 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:46:19.520 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:46:19.653 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:46:19.717 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:46:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:46:19.903 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:46:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:46:20.068 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:46:20.103 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:46:20.151 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:46:20.185 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:46:20.209 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:46:20.210 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:46:20.259 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:46:20.285 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:46:20.299 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:46:20.391 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:46:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:46:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:46:20.469 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:46:20.487 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:46:20.508 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:46:20.520 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:46:20.559 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:46:20.562 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:46:20.565 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:46:20.591 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:46:20.605 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:46:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:46:20.621 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:46:20.641 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:46:20.655 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:46:20.697 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:46:20.733 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:46:20.738 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:46:20.773 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:46:20.794 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:46:20.828 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:46:20.860 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:46:20.875 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:46:20.912 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:46:20.943 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:46:20.958 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:46:20.998 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:46:21.046 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:46:21.046 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:46:21.079 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:46:21.103 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:46:21.165 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:46:21.179 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:46:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:46:21.240 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:46:21.282 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:46:21.283 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:46:21.283 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:46:21.283 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:21.314 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:46:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:46:21.515 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:46:21.585 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:46:21.837 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:46:21.883 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:46:21.916 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:46:22.015 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:46:22.063 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:46:22.108 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:46:22.221 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:46:22.260 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:46:22.262 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:46:22.361 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:46:22.428 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:46:22.445 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:46:22.475 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:46:22.476 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:46:22.515 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:46:22.552 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:46:22.572 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:46:22.769 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:46:22.876 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:46:22.972 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:46:23.057 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:46:23.110 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:46:23.146 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:46:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:46:23.206 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:46:23.245 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:46:23.291 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:46:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:46:23.342 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:46:23.522 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:46:23.574 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:46:23.617 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:46:23.750 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:46:23.791 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:46:23.842 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:46:23.888 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:46:23.936 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:46:24.070 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:46:24.240 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:46:24.280 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:46:24.317 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:46:24.399 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:46:24.467 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:46:24.506 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:46:24.533 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:46:24.543 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:46:24.578 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:46:24.611 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:46:24.614 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:46:24.641 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:46:24.655 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:46:24.675 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:46:24.687 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:46:24.790 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:46:24.846 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:46:24.890 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:46:24.985 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:46:25.029 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:46:25.043 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:46:25.105 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:46:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:46:25.168 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:46:25.211 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:46:25.690 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:46:25.716 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:46:25.787 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:46:25.817 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:46:26.050 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:46:26.106 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:46:26.139 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:46:26.257 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:46:26.322 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:46:26.376 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:46:26.484 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:46:26.533 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:46:26.781 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:46:26.813 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:46:26.911 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:46:27.791 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:46:27.923 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:46:28.090 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:46:28.305 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:46:28.850 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:46:28.900 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:46:28.991 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:46:28.991 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:46:28.991 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:46:28.992 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:29.018 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:46:29.576 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:46:29.669 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:46:29.706 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:46:29.739 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:46:30.106 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:46:30.158 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:46:30.297 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:46:30.340 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:46:30.389 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:46:30.961 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:46:30.994 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:46:31.086 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:46:31.138 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:46:32.955 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:46:32.955 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-09-12T01:46:32.955 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-09-12T01:46:32.956 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-09-12T01:46:32.956 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-09-12T01:46:32.956 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-09-12T01:46:32.956 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-09-12T01:46:32.956 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-09-12T01:46:32.956 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:33.127 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:46:33.144 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:46:33.144 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:33.144 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:46:33.144 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:33.950 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:46:33.993 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:46:34.614 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:46:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:46:34.642 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:34.642 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:46:34.642 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:46:34.642 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:46:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:34.660 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:46:34.705 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:46:34.864 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:46:34.872 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:46:34.872 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:46:34.872 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:46:34.872 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:46:34.888 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:46:34.888 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:34.888 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:46:34.888 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:46:34.888 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:46:34.889 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:34.923 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:46:35.332 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:46:35.355 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:46:35.356 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:35.356 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:46:35.356 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:46:35.356 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:46:35.356 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:35.462 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:46:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:46:35.565 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:46:35.749 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:46:35.799 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:46:35.869 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:46:35.957 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:46:36.089 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:46:36.133 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:46:36.165 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:46:36.193 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:46:36.592 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:46:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:46:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:46:36.726 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:46:36.756 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:46:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:46:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:38.804 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:38.936 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:46:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:39.144 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:39.144 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:46:39.144 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:39.144 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:39.195 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:39.207 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:39.306 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:46:39.351 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:46:40.267 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:46:40.297 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:40.322 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:40.322 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:46:40.322 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:40.322 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:40.365 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:40.388 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:40.388 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:40.388 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:46:40.388 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:40.441 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:40.464 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:40.464 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:40.465 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:46:40.465 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:40.465 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:40.465 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:46:40.555 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-09-12T01:46:40.555 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-09-12T01:46:40.555 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-09-12T01:46:40.555 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-09-12T01:46:40.555 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-09-12T01:46:40.555 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-09-12T01:46:40.555 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-09-12T01:46:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:40.729 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:46:40.756 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:46:40.756 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:40.756 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:46:40.757 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:46:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:40.799 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:42.249 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:46:42.275 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:46:42.275 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:42.275 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:46:42.275 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:46:42.276 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:46:42.276 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:42.507 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:46:42.531 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:46:42.531 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:42.531 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:46:42.532 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:46:42.532 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:46:42.532 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:42.967 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:46:42.990 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:46:42.990 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:42.991 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:46:42.991 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:46:42.991 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:46:42.991 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:46:43.153 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:46:43.209 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:46:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:46:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:46:43.520 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:46:43.608 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:46:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:46:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:46:43.816 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:46:43.843 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:46:44.311 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:46:44.342 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:46:44.374 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:46:44.437 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:46:44.466 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:46:45.345 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:46:45.386 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:46:45.427 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:46:45.460 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:46:45.487 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:46:45.505 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:46:45.542 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:45.658 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:46:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:46:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:46:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:46:45.815 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:46:46.456 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:46.497 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:46.517 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:46.542 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:46.645 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:46:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:46.860 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:46.860 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:46.860 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:46:46.860 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:46.861 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:46.861 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:46.912 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:46.924 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:47.023 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:46:47.068 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:46:47.346 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:46:47.436 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:46:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:46:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:46:47.589 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:46:47.614 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:46:47.640 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:46:47.640 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:46:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:46:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:46:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:46:47.842 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:46:47.847 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:47.848 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:47.993 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:46:48.027 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:48.027 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:46:48.031 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:48.055 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:48.055 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:48.055 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:46:48.055 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:48.056 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:48.056 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:48.099 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:48.111 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:46:48.121 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:48.122 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:48.122 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:46:48.122 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:48.174 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:48.175 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:48.198 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:48.198 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:48.198 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:46:48.198 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:48.198 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:48.198 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:48.478 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:46:48.478 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-09-12T01:46:48.478 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-09-12T01:46:48.478 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-09-12T01:46:48.478 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-09-12T01:46:48.478 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-09-12T01:46:48.478 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-09-12T01:46:48.478 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-09-12T01:46:48.478 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:46:48.500 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:48.523 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:48.524 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:48.524 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:46:48.524 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:48.524 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:48.524 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:46:48.692 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:46:48.729 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:46:48.729 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:48.729 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:46:48.730 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:46:50.399 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:46:50.456 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:46:50.456 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:50.456 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:46:50.456 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:46:50.456 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:46:50.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:46:50.722 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:46:50.774 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:46:50.774 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:50.774 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:46:50.774 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:46:50.774 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:46:50.774 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:46:51.281 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:46:51.333 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:46:51.333 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:51.333 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:46:51.334 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:46:51.334 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:46:51.334 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:46:51.465 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:46:51.527 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:46:51.633 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:46:51.883 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:46:51.945 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:46:52.036 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:46:52.168 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:46:52.355 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:46:52.403 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:46:52.442 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:46:52.467 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:46:53.030 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:46:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:46:53.105 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:46:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:46:53.159 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:46:53.178 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:46:53.209 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:46:53.236 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:46:53.237 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:46:53.264 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:46:53.419 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:46:53.466 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:46:53.496 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:46:53.526 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:46:53.581 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:46:53.817 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:53.817 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:46:53.817 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:46:53.817 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:46:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:46:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:46:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:46:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:46:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:46:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:46:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:46:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:46:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:46:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:46:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:46:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:46:54.177 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:54.212 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:54.232 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:54.566 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:46:54.624 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:55.069 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:46:55.158 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:46:55.199 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:46:55.282 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:46:55.311 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:46:55.336 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:46:55.362 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:46:55.363 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:46:55.455 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:46:55.455 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:46:55.539 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:46:55.564 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:46:55.569 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:55.570 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:55.749 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:55.749 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:46:55.784 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:55.816 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:55.825 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:46:55.888 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:55.963 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:56.147 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:46:56.184 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:56.237 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:56.237 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:56.237 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:46:56.238 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:56.238 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:56.238 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:46:56.294 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:56.324 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:56.331 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:46:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:46:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:46:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:46:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:46:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:46:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:46:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:46:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:46:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:46:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:46:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:46:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:46:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:46:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:46:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:46:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:46:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:46:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:46:56.344 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-12T01:46:56.432 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:46:56.506 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:46:56.758 DEBUG:teuthology.parallel:result is None 2024-09-12T01:46:57.566 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:46:57.604 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:57.657 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:57.657 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:57.657 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:46:57.657 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:57.657 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:57.658 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:46:57.705 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:57.755 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:57.756 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:57.756 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:46:57.756 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:46:57.805 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:57.858 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:57.858 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:57.858 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:46:57.858 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:57.858 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:57.858 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:46:58.215 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:58.266 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:58.266 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:58.266 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:46:58.267 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:58.267 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:58.267 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:47:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:47:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:47:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:47:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:47:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:47:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:47:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:47:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:47:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:47:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:47:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:47:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:47:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:47:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:47:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:47:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:47:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:47:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:47:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:47:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:47:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:47:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:47:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:47:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:47:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:47:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:47:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:47:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:47:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:47:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:47:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:47:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:47:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:47:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:47:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:47:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:47:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:47:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:47:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:47:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:47:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:47:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:47:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:47:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:47:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:47:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:47:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:47:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:47:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:47:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:47:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:47:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:47:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:47:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:47:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:47:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:47:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:47:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:47:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:47:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:47:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:47:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:47:03.513 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:47:03.580 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:47:03.623 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:47:03.660 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:47:03.695 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:47:03.957 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:47:04.009 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:47:04.063 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:47:04.095 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:47:04.139 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:47:04.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:47:04.251 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:47:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:47:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:47:04.257 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:47:04.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:47:04.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:47:04.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:47:04.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:47:04.262 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:47:04.263 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:47:04.264 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:47:04.264 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.264 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.264 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:04.264 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:47:04.264 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:47:04.264 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:47:04.264 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:47:04.264 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:47:04.264 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:47:04.265 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:47:04.265 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:47:04.265 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-12T01:47:04.667 DEBUG:teuthology.parallel:result is None 2024-09-12T01:47:05.030 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:47:05.078 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:47:05.121 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:47:06.490 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:47:06.600 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:47:06.657 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:47:06.775 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:47:06.811 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:47:06.837 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:47:06.873 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:47:06.873 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:47:06.989 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:47:06.989 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:47:07.148 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:47:07.172 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:47:07.189 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:47:07.190 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:47:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:47:07.433 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:47:07.559 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:47:07.636 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:47:07.856 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:47:07.856 INFO:teuthology.orchestra.run.smithi062.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-12T01:47:07.857 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:47:13.461 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:47:13.461 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:47:13.461 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:47:13.461 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:47:13.461 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:47:13.461 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:47:13.462 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:47:13.463 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:47:13.463 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:47:13.463 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:47:13.463 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:47:13.463 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:47:13.463 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:47:13.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:47:13.476 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:47:13.477 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:47:13.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:47:13.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:47:13.480 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:47:13.481 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:47:13.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:47:13.483 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:47:13.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:47:13.485 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:47:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:47:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:47:15.695 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-09-12T01:47:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:47:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:47:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:47:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:47:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:47:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:47:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:47:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:47:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:47:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:47:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:47:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:47:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:47:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:47:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:47:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:47:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:47:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:47:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:47:15.708 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-09-12T01:47:16.340 DEBUG:teuthology.parallel:result is None 2024-09-12T01:47:16.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:16.489 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:47:16.535 INFO:teuthology.orchestra.run.smithi062.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:47:16.535 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:47:16.535 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:47:16.537 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:16.681 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:47:16.708 INFO:teuthology.orchestra.run.smithi077.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:47:16.708 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:47:16.708 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:47:16.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:16.858 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:47:16.884 INFO:teuthology.orchestra.run.smithi107.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:47:16.884 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:47:16.884 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:47:16.886 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T01:47:16.886 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:47:16.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:47:16.947 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:47:16.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:47:16.979 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:47:16.979 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:47:17.011 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T01:47:17.012 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:47:17.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:47:17.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:47:17.167 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:47:17.167 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:47:17.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:47:17.267 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:47:17.267 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:47:17.298 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:47:17.366 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T01:47:17.366 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:47:17.366 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:47:17.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:47:17.519 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:47:17.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:47:17.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:47:17.611 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:47:17.611 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:47:17.635 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:47:17.700 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T01:47:17.700 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:47:17.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:47:17.757 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:47:17.854 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:47:17.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:47:17.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:47:17.945 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:47:17.945 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:47:17.970 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:47:18.036 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T01:47:18.125 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-12T01:47:18.126 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:18.126 INFO:tasks.cephadm:Cluster fsid is f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:18.126 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T01:47:18.126 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.62', 'mon.b': '172.21.15.77', 'mon.c': '172.21.15.107'} 2024-09-12T01:47:18.127 INFO:tasks.cephadm:First mon is mon.a on smithi062 2024-09-12T01:47:18.127 INFO:tasks.cephadm:First mgr is x 2024-09-12T01:47:18.127 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T01:47:18.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname $(hostname -s) 2024-09-12T01:47:18.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname $(hostname -s) 2024-09-12T01:47:18.210 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname $(hostname -s) 2024-09-12T01:47:18.236 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T01:47:18.236 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:18.385 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T01:47:18.535 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:18.536 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T01:47:18.536 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T01:47:18.537 DEBUG:teuthology.orchestra.run.smithi062:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:47:19.141 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:47 /home/ubuntu/cephtest/cephadm 2024-09-12T01:47:19.142 DEBUG:teuthology.orchestra.run.smithi077:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:47:19.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:47 /home/ubuntu/cephtest/cephadm 2024-09-12T01:47:19.524 DEBUG:teuthology.orchestra.run.smithi107:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:47:19.909 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:47 /home/ubuntu/cephtest/cephadm 2024-09-12T01:47:19.910 DEBUG:teuthology.orchestra.run.smithi062:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:47:19.952 DEBUG:teuthology.orchestra.run.smithi077:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:47:19.972 DEBUG:teuthology.orchestra.run.smithi107:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:47:20.010 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T01:47:20.010 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:47:20.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:47:20.017 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:47:21.615 INFO:teuthology.orchestra.run.smithi107.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:47:21.622 INFO:teuthology.orchestra.run.smithi077.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:47:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:47:53.550 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:47:53.551 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:47:53.551 INFO:teuthology.orchestra.run.smithi062.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:47:53.551 INFO:teuthology.orchestra.run.smithi062.stdout: "repo_digests": [ 2024-09-12T01:47:53.551 INFO:teuthology.orchestra.run.smithi062.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:47:53.551 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T01:47:53.551 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:48:08.486 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-12T01:48:08.487 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:48:08.487 INFO:teuthology.orchestra.run.smithi077.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:48:08.487 INFO:teuthology.orchestra.run.smithi077.stdout: "repo_digests": [ 2024-09-12T01:48:08.487 INFO:teuthology.orchestra.run.smithi077.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:48:08.487 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-12T01:48:08.487 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-12T01:48:14.887 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T01:48:14.887 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:48:14.887 INFO:teuthology.orchestra.run.smithi107.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:48:14.888 INFO:teuthology.orchestra.run.smithi107.stdout: "repo_digests": [ 2024-09-12T01:48:14.888 INFO:teuthology.orchestra.run.smithi107.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:48:14.888 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-09-12T01:48:14.888 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T01:48:14.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph 2024-09-12T01:48:14.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph 2024-09-12T01:48:15.011 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph 2024-09-12T01:48:15.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /etc/ceph 2024-09-12T01:48:15.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /etc/ceph 2024-09-12T01:48:15.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /etc/ceph 2024-09-12T01:48:15.151 INFO:tasks.cephadm:Writing seed config... 2024-09-12T01:48:15.152 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T01:48:15.152 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T01:48:15.152 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T01:48:15.153 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T01:48:15.154 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T01:48:15.155 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T01:48:15.156 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T01:48:15.156 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T01:48:15.156 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-12T01:48:15.156 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:48:15.157 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T01:48:15.193 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f18ee350-70a8-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T01:48:15.193 DEBUG:teuthology.orchestra.run.smithi062:mon.a> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T01:48:15.237 DEBUG:teuthology.orchestra.run.smithi062:mgr.x> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T01:48:15.283 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T01:48:15.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid f18ee350-70a8-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.62 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:15.544 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:48:15.545 INFO:teuthology.orchestra.run.smithi062.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', 'f18ee350-70a8-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.62', '--skip-admin-label'] 2024-09-12T01:48:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T01:48:15.548 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying podman|docker is present... 2024-09-12T01:48:15.591 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:48:15.591 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying lvm2 is present... 2024-09-12T01:48:15.591 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying time synchronization is in place... 2024-09-12T01:48:15.605 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:48:15.605 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:48:15.618 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:48:15.618 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-09-12T01:48:15.632 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout enabled 2024-09-12T01:48:15.644 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout active 2024-09-12T01:48:15.644 INFO:teuthology.orchestra.run.smithi062.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:48:15.644 INFO:teuthology.orchestra.run.smithi062.stdout:Repeating the final host check... 2024-09-12T01:48:15.688 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:48:15.688 INFO:teuthology.orchestra.run.smithi062.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T01:48:15.689 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl is present 2024-09-12T01:48:15.689 INFO:teuthology.orchestra.run.smithi062.stdout:lvcreate is present 2024-09-12T01:48:15.701 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:48:15.701 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:48:15.713 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:48:15.713 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-09-12T01:48:15.726 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout enabled 2024-09-12T01:48:15.738 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout active 2024-09-12T01:48:15.739 INFO:teuthology.orchestra.run.smithi062.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:48:15.739 INFO:teuthology.orchestra.run.smithi062.stdout:Host looks OK 2024-09-12T01:48:15.739 INFO:teuthology.orchestra.run.smithi062.stdout:Cluster fsid: f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:15.739 INFO:teuthology.orchestra.run.smithi062.stdout:Acquiring lock 140277056541696 on /run/cephadm/f18ee350-70a8-11ef-bcea-c7b262605968.lock 2024-09-12T01:48:15.739 INFO:teuthology.orchestra.run.smithi062.stdout:Lock 140277056541696 acquired on /run/cephadm/f18ee350-70a8-11ef-bcea-c7b262605968.lock 2024-09-12T01:48:15.739 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying IP 172.21.15.62 port 3300 ... 2024-09-12T01:48:15.740 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying IP 172.21.15.62 port 6789 ... 2024-09-12T01:48:15.740 INFO:teuthology.orchestra.run.smithi062.stdout:Base mon IP(s) is [172.21.15.62:3300, 172.21.15.62:6789], mon addrv is [v2:172.21.15.62:3300,v1:172.21.15.62:6789] 2024-09-12T01:48:15.747 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.62 metric 100 2024-09-12T01:48:15.747 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.62 metric 100 2024-09-12T01:48:15.753 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T01:48:15.753 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-12T01:48:15.753 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-12T01:48:15.760 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T01:48:15.760 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T01:48:15.760 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:48:15.760 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-12T01:48:15.761 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febb:d1c3/64 scope link noprefixroute 2024-09-12T01:48:15.761 INFO:teuthology.orchestra.run.smithi062.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:48:15.761 INFO:teuthology.orchestra.run.smithi062.stdout:Mon IP `172.21.15.62` is in CIDR network `172.21.0.0/20` 2024-09-12T01:48:15.761 INFO:teuthology.orchestra.run.smithi062.stdout:Mon IP `172.21.15.62` is in CIDR network `172.21.0.0/20` 2024-09-12T01:48:15.761 INFO:teuthology.orchestra.run.smithi062.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T01:48:15.762 INFO:teuthology.orchestra.run.smithi062.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T01:48:15.762 INFO:teuthology.orchestra.run.smithi062.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:48:16.259 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T01:48:16.259 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:48:16.259 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T01:48:16.259 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T01:48:16.259 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T01:48:16.259 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T01:48:16.259 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T01:48:17.347 INFO:teuthology.orchestra.run.smithi062.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:48:17.347 INFO:teuthology.orchestra.run.smithi062.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:48:17.347 INFO:teuthology.orchestra.run.smithi062.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T01:48:18.387 INFO:teuthology.orchestra.run.smithi062.stdout:stat: stdout 167 167 2024-09-12T01:48:18.387 INFO:teuthology.orchestra.run.smithi062.stdout:Creating initial keys... 2024-09-12T01:48:19.475 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-authtool: stdout AQBiSOJmvBLZLxAABvpCV8ax+RFQ0iY1z5HXGQ== 2024-09-12T01:48:20.498 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-authtool: stdout AQBjSOJmu7ItMxAAzrB4kqW7qxur3BzuDAUYmw== 2024-09-12T01:48:21.614 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-authtool: stdout AQBkSOJmQUiPOBAApnDrK4VySYrhQKA6InvACw== 2024-09-12T01:48:21.615 INFO:teuthology.orchestra.run.smithi062.stdout:Creating initial monmap... 2024-09-12T01:48:22.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:48:22.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T01:48:22.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:22.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:48:22.603 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool for a [v2:172.21.15.62:3300,v1:172.21.15.62:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:48:22.603 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = quincy 2024-09-12T01:48:22.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: set fsid to f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:22.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:48:22.603 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:48:22.603 INFO:teuthology.orchestra.run.smithi062.stdout:Creating mon... 2024-09-12T01:48:23.634 INFO:teuthology.orchestra.run.smithi062.stdout:create mon.a on 2024-09-12T01:48:23.973 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T01:48:24.202 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T01:48:24.497 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f18ee350-70a8-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-f18ee350-70a8-11ef-bcea-c7b262605968.target. 2024-09-12T01:48:24.497 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f18ee350-70a8-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-f18ee350-70a8-11ef-bcea-c7b262605968.target. 2024-09-12T01:48:24.851 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.a 2024-09-12T01:48:24.851 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T01:48:25.111 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f18ee350-70a8-11ef-bcea-c7b262605968.target.wants/ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-f18ee350-70a8-11ef-bcea-c7b262605968@.service. 2024-09-12T01:48:25.743 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:25 smithi062 podman[30282]: 2024-09-12 01:48:25.680117224 +0000 UTC m=+0.338210825 container start 4a32ff1987da48f46d8ce1505e180680f5155231d01637b1aad9b701e6ea2b50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T01:48:25.743 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:25 smithi062 ceph-mon[30303]: mkfs f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:25.808 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:48:25.808 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout disabled 2024-09-12T01:48:25.822 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:48:25.822 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-09-12T01:48:25.822 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld.service is not enabled 2024-09-12T01:48:25.822 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:48:25.823 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mon to start... 2024-09-12T01:48:25.823 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mon... 2024-09-12T01:48:26.020 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:25 smithi062 ceph-mon[30303]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:48:26.020 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:25 smithi062 bash[30282]: 4a32ff1987da48f46d8ce1505e180680f5155231d01637b1aad9b701e6ea2b50 2024-09-12T01:48:26.020 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:25 smithi062 systemd[1]: Started Ceph mon.a for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:48:26.964 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:48:26.964 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: monmap epoch 1 2024-09-12T01:48:26.964 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:26.964 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: last_changed 2024-09-12T01:48:22.017888+0000 2024-09-12T01:48:26.964 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: created 2024-09-12T01:48:22.017888+0000 2024-09-12T01:48:26.964 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: min_mon_release 19 (squid) 2024-09-12T01:48:26.964 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: election_strategy: 1 2024-09-12T01:48:26.965 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T01:48:26.965 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: fsmap 2024-09-12T01:48:26.965 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:48:26.965 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: mgrmap e1: no daemons active 2024-09-12T01:48:26.965 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:26 smithi062 ceph-mon[30303]: from='client.? 172.21.15.62:0/3738627376' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T01:48:26.969 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T01:48:26.976 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout id: f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:26.976 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T01:48:26.976 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:26.976 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout services: 2024-09-12T01:48:26.976 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.642826s) 2024-09-12T01:48:26.976 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T01:48:26.976 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T01:48:26.976 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:26.976 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout data: 2024-09-12T01:48:26.976 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.301+0000 7f2e6ee00640 1 Processor -- start 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.302+0000 7f2e6ee00640 1 -- start start 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.302+0000 7f2e6ee00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e68109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.302+0000 7f2e6ee00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6810a1e0 con 0x7f2e68109810 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.303+0000 7f2e67e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e68109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.303+0000 7f2e67e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e68109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53466/0 (socket says 172.21.15.62:53466) 2024-09-12T01:48:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.303+0000 7f2e67e00640 1 -- 172.21.15.62:0/1673910433 learned_addr learned my addr 172.21.15.62:0/1673910433 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.303+0000 7f2e67e00640 1 -- 172.21.15.62:0/1673910433 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6810a950 con 0x7f2e68109810 2024-09-12T01:48:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.306+0000 7f2e67e00640 1 --2- 172.21.15.62:0/1673910433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e68109c10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009820 tx=0x7f2e5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80af12ee494d9256 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.306+0000 7f2e67400640 1 -- 172.21.15.62:0/1673910433 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58037070 con 0x7f2e68109810 2024-09-12T01:48:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.306+0000 7f2e67400640 1 -- 172.21.15.62:0/1673910433 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58032440 con 0x7f2e68109810 2024-09-12T01:48:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.306+0000 7f2e67400640 1 -- 172.21.15.62:0/1673910433 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58032740 con 0x7f2e68109810 2024-09-12T01:48:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.307+0000 7f2e6ee00640 1 -- 172.21.15.62:0/1673910433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 msgr2=0x7f2e68109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.307+0000 7f2e6ee00640 1 --2- 172.21.15.62:0/1673910433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e68109c10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009820 tx=0x7f2e5802a270 comp rx=0 tx=0).stop 2024-09-12T01:48:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.307+0000 7f2e6ee00640 1 -- 172.21.15.62:0/1673910433 shutdown_connections 2024-09-12T01:48:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.307+0000 7f2e6ee00640 1 --2- 172.21.15.62:0/1673910433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e68109c10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.307+0000 7f2e6ee00640 1 -- 172.21.15.62:0/1673910433 >> 172.21.15.62:0/1673910433 conn(0x7f2e6807ccf0 msgr2=0x7f2e6807d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:26.979 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.307+0000 7f2e6ee00640 1 -- 172.21.15.62:0/1673910433 shutdown_connections 2024-09-12T01:48:26.979 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.307+0000 7f2e6ee00640 1 -- 172.21.15.62:0/1673910433 wait complete. 2024-09-12T01:48:26.979 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.308+0000 7f2e6ee00640 1 Processor -- start 2024-09-12T01:48:26.979 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.308+0000 7f2e6ee00640 1 -- start start 2024-09-12T01:48:26.979 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.309+0000 7f2e6ee00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e6819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:26.979 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.309+0000 7f2e6ee00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6810aef0 con 0x7f2e68109810 2024-09-12T01:48:26.979 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.309+0000 7f2e67e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e6819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:26.980 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.309+0000 7f2e67e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e6819cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53480/0 (socket says 172.21.15.62:53480) 2024-09-12T01:48:26.980 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.309+0000 7f2e67e00640 1 -- 172.21.15.62:0/3738627376 learned_addr learned my addr 172.21.15.62:0/3738627376 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:26.980 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.309+0000 7f2e67e00640 1 -- 172.21.15.62:0/3738627376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6819d480 con 0x7f2e68109810 2024-09-12T01:48:26.980 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.310+0000 7f2e67e00640 1 --2- 172.21.15.62:0/3738627376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e6819cf40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2e580090b0 tx=0x7f2e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:26.980 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.310+0000 7f2e65600640 1 -- 172.21.15.62:0/3738627376 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58041070 con 0x7f2e68109810 2024-09-12T01:48:26.980 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.310+0000 7f2e65600640 1 -- 172.21.15.62:0/3738627376 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5803c7a0 con 0x7f2e68109810 2024-09-12T01:48:26.980 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.310+0000 7f2e65600640 1 -- 172.21.15.62:0/3738627376 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58037040 con 0x7f2e68109810 2024-09-12T01:48:26.980 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.310+0000 7f2e6ee00640 1 -- 172.21.15.62:0/3738627376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6819d710 con 0x7f2e68109810 2024-09-12T01:48:26.980 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.310+0000 7f2e6ee00640 1 -- 172.21.15.62:0/3738627376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e681a0400 con 0x7f2e68109810 2024-09-12T01:48:26.980 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.310+0000 7f2e65600640 1 -- 172.21.15.62:0/3738627376 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e58044070 con 0x7f2e68109810 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.310+0000 7f2e65600640 1 -- 172.21.15.62:0/3738627376 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2e5803d3f0 con 0x7f2e68109810 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.311+0000 7f2e6ee00640 1 -- 172.21.15.62:0/3738627376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6810b560 con 0x7f2e68109810 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.314+0000 7f2e65600640 1 -- 172.21.15.62:0/3738627376 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2e58046450 con 0x7f2e68109810 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.379+0000 7f2e6ee00640 1 -- 172.21.15.62:0/3738627376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f2e6802d940 con 0x7f2e68109810 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.380+0000 7f2e65600640 1 -- 172.21.15.62:0/3738627376 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f2e58046630 con 0x7f2e68109810 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.380+0000 7f2e6ee00640 1 -- 172.21.15.62:0/3738627376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 msgr2=0x7f2e6819cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.380+0000 7f2e6ee00640 1 --2- 172.21.15.62:0/3738627376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e6819cf40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2e580090b0 tx=0x7f2e580046c0 comp rx=0 tx=0).stop 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.381+0000 7f2e6ee00640 1 -- 172.21.15.62:0/3738627376 shutdown_connections 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.381+0000 7f2e6ee00640 1 --2- 172.21.15.62:0/3738627376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e68109810 0x7f2e6819cf40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.381+0000 7f2e6ee00640 1 -- 172.21.15.62:0/3738627376 >> 172.21.15.62:0/3738627376 conn(0x7f2e6807ccf0 msgr2=0x7f2e68191110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.381+0000 7f2e6ee00640 1 -- 172.21.15.62:0/3738627376 shutdown_connections 2024-09-12T01:48:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:26.381+0000 7f2e6ee00640 1 -- 172.21.15.62:0/3738627376 wait complete. 2024-09-12T01:48:26.982 INFO:teuthology.orchestra.run.smithi062.stdout:mon is available 2024-09-12T01:48:26.982 INFO:teuthology.orchestra.run.smithi062.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T01:48:27.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:27 smithi062 ceph-mon[30303]: from='client.? 172.21.15.62:0/2133145572' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:48:27.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:27 smithi062 ceph-mon[30303]: from='client.? 172.21.15.62:0/2133145572' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T01:48:28.114 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:28.114 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout fsid = f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.62:3300,v1:172.21.15.62:6789] 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:48:28.115 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:48:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:48:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:48:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:48:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.441+0000 7fa27ae00640 1 Processor -- start 2024-09-12T01:48:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.441+0000 7fa27ae00640 1 -- start start 2024-09-12T01:48:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.442+0000 7fa27ae00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27407c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.442+0000 7fa27ae00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa27407c850 con 0x7fa27407de20 2024-09-12T01:48:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.442+0000 7fa273e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27407c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.442+0000 7fa273e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27407c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53496/0 (socket says 172.21.15.62:53496) 2024-09-12T01:48:28.116 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.442+0000 7fa273e00640 1 -- 172.21.15.62:0/3715178956 learned_addr learned my addr 172.21.15.62:0/3715178956 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.442+0000 7fa273e00640 1 -- 172.21.15.62:0/3715178956 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27407c9d0 con 0x7fa27407de20 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.443+0000 7fa273e00640 1 --2- 172.21.15.62:0/3715178956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27407c280 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa264009820 tx=0x7fa26402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5394849128ef6c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.444+0000 7fa273400640 1 -- 172.21.15.62:0/3715178956 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa264037070 con 0x7fa27407de20 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.444+0000 7fa273400640 1 -- 172.21.15.62:0/3715178956 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa264032440 con 0x7fa27407de20 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.444+0000 7fa273400640 1 -- 172.21.15.62:0/3715178956 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa264032740 con 0x7fa27407de20 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.444+0000 7fa27ae00640 1 -- 172.21.15.62:0/3715178956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 msgr2=0x7fa27407c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.444+0000 7fa27ae00640 1 --2- 172.21.15.62:0/3715178956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27407c280 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa264009820 tx=0x7fa26402a270 comp rx=0 tx=0).stop 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.444+0000 7fa27ae00640 1 -- 172.21.15.62:0/3715178956 shutdown_connections 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.444+0000 7fa27ae00640 1 --2- 172.21.15.62:0/3715178956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27407c280 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.444+0000 7fa27ae00640 1 -- 172.21.15.62:0/3715178956 >> 172.21.15.62:0/3715178956 conn(0x7fa274102cc0 msgr2=0x7fa274105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:28.117 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.444+0000 7fa27ae00640 1 -- 172.21.15.62:0/3715178956 shutdown_connections 2024-09-12T01:48:28.118 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.444+0000 7fa27ae00640 1 -- 172.21.15.62:0/3715178956 wait complete. 2024-09-12T01:48:28.118 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.445+0000 7fa27ae00640 1 Processor -- start 2024-09-12T01:48:28.118 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.446+0000 7fa27ae00640 1 -- start start 2024-09-12T01:48:28.118 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.446+0000 7fa27ae00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27419cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:28.118 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.446+0000 7fa27ae00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa27407cf00 con 0x7fa27407de20 2024-09-12T01:48:28.118 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.446+0000 7fa273e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27419cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:28.118 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.446+0000 7fa273e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27419cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53508/0 (socket says 172.21.15.62:53508) 2024-09-12T01:48:28.118 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.446+0000 7fa273e00640 1 -- 172.21.15.62:0/2133145572 learned_addr learned my addr 172.21.15.62:0/2133145572 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:28.118 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.447+0000 7fa273e00640 1 -- 172.21.15.62:0/2133145572 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27419d4a0 con 0x7fa27407de20 2024-09-12T01:48:28.118 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.447+0000 7fa273e00640 1 --2- 172.21.15.62:0/2133145572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27419cf60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa2640090b0 tx=0x7fa2640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.447+0000 7fa271600640 1 -- 172.21.15.62:0/2133145572 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa264041070 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.447+0000 7fa271600640 1 -- 172.21.15.62:0/2133145572 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa26403c7a0 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.447+0000 7fa271600640 1 -- 172.21.15.62:0/2133145572 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa264037040 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.447+0000 7fa27ae00640 1 -- 172.21.15.62:0/2133145572 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27419d730 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.447+0000 7fa27ae00640 1 -- 172.21.15.62:0/2133145572 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2741a0420 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.448+0000 7fa271600640 1 -- 172.21.15.62:0/2133145572 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa264044070 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.448+0000 7fa271600640 1 -- 172.21.15.62:0/2133145572 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa26403d3f0 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.448+0000 7fa27ae00640 1 -- 172.21.15.62:0/2133145572 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27407c300 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.451+0000 7fa271600640 1 -- 172.21.15.62:0/2133145572 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa264046450 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.513+0000 7fa27ae00640 1 -- 172.21.15.62:0/2133145572 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa27402d910 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.517+0000 7fa271600640 1 -- 172.21.15.62:0/2133145572 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fa264046630 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.518+0000 7fa271600640 1 -- 172.21.15.62:0/2133145572 <== mon.0 v2:172.21.15.62:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa264056070 con 0x7fa27407de20 2024-09-12T01:48:28.119 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.519+0000 7fa27ae00640 1 -- 172.21.15.62:0/2133145572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 msgr2=0x7fa27419cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:28.120 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.519+0000 7fa27ae00640 1 --2- 172.21.15.62:0/2133145572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27419cf60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa2640090b0 tx=0x7fa2640046c0 comp rx=0 tx=0).stop 2024-09-12T01:48:28.120 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.519+0000 7fa27ae00640 1 -- 172.21.15.62:0/2133145572 shutdown_connections 2024-09-12T01:48:28.120 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.519+0000 7fa27ae00640 1 --2- 172.21.15.62:0/2133145572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa27407de20 0x7fa27419cf60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:28.120 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.519+0000 7fa27ae00640 1 -- 172.21.15.62:0/2133145572 >> 172.21.15.62:0/2133145572 conn(0x7fa274102cc0 msgr2=0x7fa274103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:28.120 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.519+0000 7fa27ae00640 1 -- 172.21.15.62:0/2133145572 shutdown_connections 2024-09-12T01:48:28.120 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:27.519+0000 7fa27ae00640 1 -- 172.21.15.62:0/2133145572 wait complete. 2024-09-12T01:48:28.120 INFO:teuthology.orchestra.run.smithi062.stdout:Generating new minimal ceph.conf... 2024-09-12T01:48:29.065 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:28 smithi062 ceph-mon[30303]: from='client.? 172.21.15.62:0/2914986461' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.597+0000 7fecd9000640 1 Processor -- start 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.597+0000 7fecd9000640 1 -- start start 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.598+0000 7fecd9000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd4109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.598+0000 7fecd9000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fecd410a1e0 con 0x7fecd4109810 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.598+0000 7fecd1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd4109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.598+0000 7fecd1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd4109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53512/0 (socket says 172.21.15.62:53512) 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.598+0000 7fecd1e00640 1 -- 172.21.15.62:0/464149445 learned_addr learned my addr 172.21.15.62:0/464149445 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.598+0000 7fecd1e00640 1 -- 172.21.15.62:0/464149445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd410a950 con 0x7fecd4109810 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.599+0000 7fecd1e00640 1 --2- 172.21.15.62:0/464149445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd4109c10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009820 tx=0x7fecc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83152adbb90f07f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.600+0000 7fecd1400640 1 -- 172.21.15.62:0/464149445 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecc4037070 con 0x7fecd4109810 2024-09-12T01:48:29.345 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.600+0000 7fecd1400640 1 -- 172.21.15.62:0/464149445 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fecc4032900 con 0x7fecd4109810 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.600+0000 7fecd1400640 1 -- 172.21.15.62:0/464149445 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecc4030850 con 0x7fecd4109810 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.600+0000 7fecd9000640 1 -- 172.21.15.62:0/464149445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 msgr2=0x7fecd4109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.600+0000 7fecd9000640 1 --2- 172.21.15.62:0/464149445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd4109c10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009820 tx=0x7fecc402a270 comp rx=0 tx=0).stop 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.601+0000 7fecd9000640 1 -- 172.21.15.62:0/464149445 shutdown_connections 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.601+0000 7fecd9000640 1 --2- 172.21.15.62:0/464149445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd4109c10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.601+0000 7fecd9000640 1 -- 172.21.15.62:0/464149445 >> 172.21.15.62:0/464149445 conn(0x7fecd407ccf0 msgr2=0x7fecd407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.601+0000 7fecd9000640 1 -- 172.21.15.62:0/464149445 shutdown_connections 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.601+0000 7fecd9000640 1 -- 172.21.15.62:0/464149445 wait complete. 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.601+0000 7fecd9000640 1 Processor -- start 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.602+0000 7fecd9000640 1 -- start start 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.602+0000 7fecd9000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.602+0000 7fecd9000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fecd410dd00 con 0x7fecd4109810 2024-09-12T01:48:29.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.602+0000 7fecd1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.602+0000 7fecd1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53520/0 (socket says 172.21.15.62:53520) 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.602+0000 7fecd1e00640 1 -- 172.21.15.62:0/2914986461 learned_addr learned my addr 172.21.15.62:0/2914986461 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.603+0000 7fecd1e00640 1 -- 172.21.15.62:0/2914986461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd419dd10 con 0x7fecd4109810 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.603+0000 7fecd1e00640 1 --2- 172.21.15.62:0/2914986461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd419d7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fecc4030460 tx=0x7fecc4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.603+0000 7feccb400640 1 -- 172.21.15.62:0/2914986461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecc4042070 con 0x7fecd4109810 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.603+0000 7feccb400640 1 -- 172.21.15.62:0/2914986461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fecc4032be0 con 0x7fecd4109810 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.603+0000 7feccb400640 1 -- 172.21.15.62:0/2914986461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecc4037040 con 0x7fecd4109810 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.603+0000 7fecd9000640 1 -- 172.21.15.62:0/2914986461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd419dfa0 con 0x7fecd4109810 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.603+0000 7fecd9000640 1 -- 172.21.15.62:0/2914986461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd41a0c90 con 0x7fecd4109810 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.604+0000 7feccb400640 1 -- 172.21.15.62:0/2914986461 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fecc4045070 con 0x7fecd4109810 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.604+0000 7feccb400640 1 -- 172.21.15.62:0/2914986461 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fecc4047a30 con 0x7fecd4109810 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.605+0000 7fecd9000640 1 -- 172.21.15.62:0/2914986461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd4109c10 con 0x7fecd4109810 2024-09-12T01:48:29.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.607+0000 7feccb400640 1 -- 172.21.15.62:0/2914986461 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fecc4032d90 con 0x7fecd4109810 2024-09-12T01:48:29.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.670+0000 7fecd9000640 1 -- 172.21.15.62:0/2914986461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fecd41a0e60 con 0x7fecd4109810 2024-09-12T01:48:29.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.670+0000 7feccb400640 1 -- 172.21.15.62:0/2914986461 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fecc403da10 con 0x7fecd4109810 2024-09-12T01:48:29.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.671+0000 7fecd9000640 1 -- 172.21.15.62:0/2914986461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 msgr2=0x7fecd419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:29.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.671+0000 7fecd9000640 1 --2- 172.21.15.62:0/2914986461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd419d7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fecc4030460 tx=0x7fecc4030d80 comp rx=0 tx=0).stop 2024-09-12T01:48:29.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.671+0000 7fecd9000640 1 -- 172.21.15.62:0/2914986461 shutdown_connections 2024-09-12T01:48:29.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.671+0000 7fecd9000640 1 --2- 172.21.15.62:0/2914986461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecd4109810 0x7fecd419d7d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:29.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.671+0000 7fecd9000640 1 -- 172.21.15.62:0/2914986461 >> 172.21.15.62:0/2914986461 conn(0x7fecd407ccf0 msgr2=0x7fecd41074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:29.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.671+0000 7fecd9000640 1 -- 172.21.15.62:0/2914986461 shutdown_connections 2024-09-12T01:48:29.348 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:28.671+0000 7fecd9000640 1 -- 172.21.15.62:0/2914986461 wait complete. 2024-09-12T01:48:29.348 INFO:teuthology.orchestra.run.smithi062.stdout:Restarting the monitor... 2024-09-12T01:48:29.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:29 smithi062 systemd[1]: Stopping Ceph mon.a for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:48:29.947 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:29 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a[30299]: 2024-09-12T01:48:29.691+0000 7f5de9800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:48:29.947 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:29 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a[30299]: 2024-09-12T01:48:29.691+0000 7f5de9800640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T01:48:30.230 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:29 smithi062 podman[30544]: 2024-09-12 01:48:29.947680705 +0000 UTC m=+0.375142494 container died 4a32ff1987da48f46d8ce1505e180680f5155231d01637b1aad9b701e6ea2b50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T01:48:30.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:30 smithi062 podman[30544]: 2024-09-12 01:48:30.379902393 +0000 UTC m=+0.807364181 container cleanup 4a32ff1987da48f46d8ce1505e180680f5155231d01637b1aad9b701e6ea2b50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T01:48:30.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:30 smithi062 bash[30544]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a 2024-09-12T01:48:30.827 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:30 smithi062 podman[30556]: 2024-09-12 01:48:30.564161743 +0000 UTC m=+0.606675696 container remove 4a32ff1987da48f46d8ce1505e180680f5155231d01637b1aad9b701e6ea2b50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T01:48:31.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:30 smithi062 systemd[1]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T01:48:31.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:30 smithi062 systemd[1]: Stopped Ceph mon.a for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:48:31.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:30 smithi062 systemd[1]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.240s CPU time. 2024-09-12T01:48:31.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:30 smithi062 systemd[1]: Starting Ceph mon.a for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:48:31.423 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 podman[30647]: 2024-09-12 01:48:31.063961434 +0000 UTC m=+0.029705423 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:48:31.423 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 podman[30647]: 2024-09-12 01:48:31.232061813 +0000 UTC m=+0.197805801 container create 39307ccb1c721dc1c14918c03b07102d1bd1601bc2c174b6d996e36b36f5a4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:48:31.584 INFO:teuthology.orchestra.run.smithi062.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T01:48:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 podman[30647]: 2024-09-12 01:48:31.509863061 +0000 UTC m=+0.475607050 container init 39307ccb1c721dc1c14918c03b07102d1bd1601bc2c174b6d996e36b36f5a4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 podman[30647]: 2024-09-12 01:48:31.516541607 +0000 UTC m=+0.482285597 container start 39307ccb1c721dc1c14918c03b07102d1bd1601bc2c174b6d996e36b36f5a4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: pidfile_write: ignore empty --pid-file 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: load: jerasure load: lrc 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: RocksDB version: 7.9.2 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Git sha 0 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: DB SUMMARY 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: DB Session ID: LKD8OPINJZEBH8CW6OLD 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:48:31.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104688 ; 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.env: 0x55859bd32940 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T01:48:31.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.info_log: 0x5585d1da16a0 2024-09-12T01:48:31.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:48:31.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.statistics: (nil) 2024-09-12T01:48:31.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.use_fsync: 0 2024-09-12T01:48:31.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:48:31.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:48:31.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:48:31.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:48:31.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:48:31.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:48:31.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:48:31.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.db_log_dir: 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.wal_dir: 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:48:31.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.write_buffer_manager: 0x5585d1db0dc0 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.unordered_write: 0 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:48:31.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.row_cache: None 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.wal_filter: None 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.wal_compression: 0 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:48:31.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:48:31.821 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:48:31.821 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:48:31.821 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:48:31.821 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:48:31.821 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:48:31.821 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:48:31.821 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:48:31.821 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:48:31.821 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T01:48:31.821 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_open_files: -1 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:48:31.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Compression algorithms supported: 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: kZSTD supported: 0 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:48:31.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.merge_operator: 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_filter: None 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5585d1da1300) 2024-09-12T01:48:31.824 INFO:journalctl@ceph.mon.a.smithi062.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: index_type: 0 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: data_block_index_type: 0 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: index_shortening: 1 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: checksum: 4 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: no_block_cache: 0 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: block_cache: 0x5585d1d951f0 2024-09-12T01:48:31.825 INFO:journalctl@ceph.mon.a.smithi062.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: block_cache_options: 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: capacity : 536870912 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: num_shard_bits : 4 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: strict_capacity_limit : 0 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: block_cache_compressed: (nil) 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: persistent_cache: (nil) 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: block_size: 4096 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: block_size_deviation: 10 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: block_restart_interval: 16 2024-09-12T01:48:31.826 INFO:journalctl@ceph.mon.a.smithi062.stdout: index_block_restart_interval: 1 2024-09-12T01:48:31.827 INFO:journalctl@ceph.mon.a.smithi062.stdout: metadata_block_size: 4096 2024-09-12T01:48:31.827 INFO:journalctl@ceph.mon.a.smithi062.stdout: partition_filters: 0 2024-09-12T01:48:31.827 INFO:journalctl@ceph.mon.a.smithi062.stdout: use_delta_encoding: 1 2024-09-12T01:48:31.827 INFO:journalctl@ceph.mon.a.smithi062.stdout: filter_policy: bloomfilter 2024-09-12T01:48:31.827 INFO:journalctl@ceph.mon.a.smithi062.stdout: whole_key_filtering: 1 2024-09-12T01:48:31.827 INFO:journalctl@ceph.mon.a.smithi062.stdout: verify_compression: 0 2024-09-12T01:48:31.827 INFO:journalctl@ceph.mon.a.smithi062.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:48:31.827 INFO:journalctl@ceph.mon.a.smithi062.stdout: format_version: 5 2024-09-12T01:48:31.827 INFO:journalctl@ceph.mon.a.smithi062.stdout: enable_index_compression: 1 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout: block_align: 0 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout: max_auto_readahead_size: 262144 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout: prepopulate_block_cache: 0 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout: initial_auto_readahead_size: 8192 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compression: NoCompression 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:48:31.828 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.num_levels: 7 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:48:31.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:48:31.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:48:31.831 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:48:31.832 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:48:31.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:48:31.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:48:31.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:48:31.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.ttl: 2592000 2024-09-12T01:48:31.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:48:31.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:48:31.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:48:31.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:48:31.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:48:31.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a8e6ea21-ab9d-478f-a8cd-1601929f0746 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105711559249, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T01:48:31.835 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105711560960, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99843, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97725, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14159, "raw_average_key_size": 49, "raw_value_size": 90034, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726105711, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a8e6ea21-ab9d-478f-a8cd-1601929f0746", "db_session_id": "LKD8OPINJZEBH8CW6OLD", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105711561152, "job": 1, "event": "recovery_finished"} 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5585d1dc4e00 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: DB pointer 0x5585d1ec0000 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout: ** DB Stats ** 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:48:31.836 INFO:journalctl@ceph.mon.a.smithi062.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: ** Compaction Stats [default] ** 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: L0 2/0 99.36 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 89.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: Sum 2/0 99.36 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 89.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 89.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: ** Compaction Stats [default] ** 2024-09-12T01:48:31.837 INFO:journalctl@ceph.mon.a.smithi062.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 89.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:48:31.838 INFO:journalctl@ceph.mon.a.smithi062.stdout: Cumulative compaction: 0.00 GB write, 16.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:48:31.839 INFO:journalctl@ceph.mon.a.smithi062.stdout: Interval compaction: 0.00 GB write, 16.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:48:31.839 INFO:journalctl@ceph.mon.a.smithi062.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:48:31.839 INFO:journalctl@ceph.mon.a.smithi062.stdout: Block cache BinnedLRUCache@0x5585d1d951f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T01:48:31.839 INFO:journalctl@ceph.mon.a.smithi062.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T01:48:31.839 INFO:journalctl@ceph.mon.a.smithi062.stdout: 2024-09-12T01:48:31.839 INFO:journalctl@ceph.mon.a.smithi062.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:48:31.839 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: starting mon.a rank 0 at public addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] at bind addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:31.839 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: mon.a@-1(???) e1 preinit fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: mon.a@-1(???).mds e1 new map 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: mon.a@-1(???).mds e1 print_map 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout: e1 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout: btime 2024-09-12T01:48:25:739215+0000 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout: legacy client fscid: -1 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout: 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout: No filesystems configured 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:48:31.840 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 bash[30647]: 39307ccb1c721dc1c14918c03b07102d1bd1601bc2c174b6d996e36b36f5a4db 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 systemd[1]: Started Ceph mon.a for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: monmap epoch 1 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: last_changed 2024-09-12T01:48:22.017888+0000 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: created 2024-09-12T01:48:22.017888+0000 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: min_mon_release 19 (squid) 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: election_strategy: 1 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: fsmap 2024-09-12T01:48:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:48:31.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:31 smithi062 ceph-mon[30666]: mgrmap e1: no daemons active 2024-09-12T01:48:32.896 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.200+0000 7f211be00640 1 Processor -- start 2024-09-12T01:48:32.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.200+0000 7f211be00640 1 -- start start 2024-09-12T01:48:32.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.201+0000 7f211be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211407c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:32.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.201+0000 7f211be00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f211407c870 con 0x7f211407de40 2024-09-12T01:48:32.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.201+0000 7f2119400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211407c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:32.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.201+0000 7f2119400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211407c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37880/0 (socket says 172.21.15.62:37880) 2024-09-12T01:48:32.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.201+0000 7f2119400640 1 -- 172.21.15.62:0/2314362017 learned_addr learned my addr 172.21.15.62:0/2314362017 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:32.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.202+0000 7f2119400640 1 -- 172.21.15.62:0/2314362017 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211407c9f0 con 0x7f211407de40 2024-09-12T01:48:32.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.204+0000 7f2119400640 1 --2- 172.21.15.62:0/2314362017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211407c2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2108009820 tx=0x7f210802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84246ff6d80b2ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.204+0000 7f2113e00640 1 -- 172.21.15.62:0/2314362017 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2108037070 con 0x7f211407de40 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.205+0000 7f2113e00640 1 -- 172.21.15.62:0/2314362017 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2108032900 con 0x7f211407de40 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.205+0000 7f2113e00640 1 -- 172.21.15.62:0/2314362017 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2108030850 con 0x7f211407de40 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.205+0000 7f211be00640 1 -- 172.21.15.62:0/2314362017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 msgr2=0x7f211407c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.205+0000 7f211be00640 1 --2- 172.21.15.62:0/2314362017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211407c2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2108009820 tx=0x7f210802a270 comp rx=0 tx=0).stop 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.205+0000 7f211be00640 1 -- 172.21.15.62:0/2314362017 shutdown_connections 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.205+0000 7f211be00640 1 --2- 172.21.15.62:0/2314362017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211407c2a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.205+0000 7f211be00640 1 -- 172.21.15.62:0/2314362017 >> 172.21.15.62:0/2314362017 conn(0x7f2114102cc0 msgr2=0x7f2114105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.205+0000 7f211be00640 1 -- 172.21.15.62:0/2314362017 shutdown_connections 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.205+0000 7f211be00640 1 -- 172.21.15.62:0/2314362017 wait complete. 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.206+0000 7f211be00640 1 Processor -- start 2024-09-12T01:48:32.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.206+0000 7f211be00640 1 -- start start 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.207+0000 7f211be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.207+0000 7f211be00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f211410dba0 con 0x7f211407de40 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.207+0000 7f2119400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.207+0000 7f2119400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211419d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37894/0 (socket says 172.21.15.62:37894) 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.207+0000 7f2119400640 1 -- 172.21.15.62:0/2142329773 learned_addr learned my addr 172.21.15.62:0/2142329773 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.207+0000 7f2119400640 1 -- 172.21.15.62:0/2142329773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211419dc80 con 0x7f211407de40 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.208+0000 7f2119400640 1 --2- 172.21.15.62:0/2142329773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211419d740 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f21080097f0 tx=0x7f2108030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.208+0000 7f2112000640 1 -- 172.21.15.62:0/2142329773 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2108037040 con 0x7f211407de40 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.208+0000 7f2112000640 1 -- 172.21.15.62:0/2142329773 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2108040070 con 0x7f211407de40 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.208+0000 7f2112000640 1 -- 172.21.15.62:0/2142329773 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f210803a390 con 0x7f211407de40 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.208+0000 7f211be00640 1 -- 172.21.15.62:0/2142329773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211419df10 con 0x7f211407de40 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.208+0000 7f211be00640 1 -- 172.21.15.62:0/2142329773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21141a0c00 con 0x7f211407de40 2024-09-12T01:48:32.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.209+0000 7f2112000640 1 -- 172.21.15.62:0/2142329773 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f210803a5e0 con 0x7f211407de40 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.209+0000 7f2112000640 1 -- 172.21.15.62:0/2142329773 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2108045950 con 0x7f211407de40 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.209+0000 7f211be00640 1 -- 172.21.15.62:0/2142329773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f211407c320 con 0x7f211407de40 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.212+0000 7f2112000640 1 -- 172.21.15.62:0/2142329773 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2108045460 con 0x7f211407de40 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.275+0000 7f211be00640 1 -- 172.21.15.62:0/2142329773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f211419e390 con 0x7f211407de40 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.277+0000 7f2112000640 1 -- 172.21.15.62:0/2142329773 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f210803b430 con 0x7f211407de40 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.278+0000 7f211be00640 1 -- 172.21.15.62:0/2142329773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 msgr2=0x7f211419d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.278+0000 7f211be00640 1 --2- 172.21.15.62:0/2142329773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211419d740 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f21080097f0 tx=0x7f2108030d80 comp rx=0 tx=0).stop 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.278+0000 7f211be00640 1 -- 172.21.15.62:0/2142329773 shutdown_connections 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.278+0000 7f211be00640 1 --2- 172.21.15.62:0/2142329773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f211407de40 0x7f211419d740 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.278+0000 7f211be00640 1 -- 172.21.15.62:0/2142329773 >> 172.21.15.62:0/2142329773 conn(0x7f2114102cc0 msgr2=0x7f2114103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.279+0000 7f211be00640 1 -- 172.21.15.62:0/2142329773 shutdown_connections 2024-09-12T01:48:32.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:32.279+0000 7f211be00640 1 -- 172.21.15.62:0/2142329773 wait complete. 2024-09-12T01:48:32.905 INFO:teuthology.orchestra.run.smithi062.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T01:48:32.923 INFO:teuthology.orchestra.run.smithi062.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:32.923 INFO:teuthology.orchestra.run.smithi062.stdout:Creating mgr... 2024-09-12T01:48:32.924 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T01:48:32.924 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T01:48:33.256 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.x 2024-09-12T01:48:33.256 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T01:48:33.502 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f18ee350-70a8-11ef-bcea-c7b262605968.target.wants/ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-f18ee350-70a8-11ef-bcea-c7b262605968@.service. 2024-09-12T01:48:33.530 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:33 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2142329773' entity='client.admin' 2024-09-12T01:48:33.841 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:33 smithi062 systemd[1]: Starting Ceph mgr.x for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:48:34.092 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:33 smithi062 podman[30875]: 2024-09-12 01:48:33.745611667 +0000 UTC m=+0.026977233 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:48:34.092 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:33 smithi062 podman[30875]: 2024-09-12 01:48:33.843323999 +0000 UTC m=+0.124689564 container create d0e9031ef5e832ac715a713aab084b1b45a264780cded574a5994971167ba33d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T01:48:34.092 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:34 smithi062 podman[30875]: 2024-09-12 01:48:34.053912101 +0000 UTC m=+0.335277667 container init d0e9031ef5e832ac715a713aab084b1b45a264780cded574a5994971167ba33d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:48:34.092 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:34 smithi062 podman[30875]: 2024-09-12 01:48:34.060187626 +0000 UTC m=+0.341553191 container start d0e9031ef5e832ac715a713aab084b1b45a264780cded574a5994971167ba33d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T01:48:34.175 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:48:34.176 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout disabled 2024-09-12T01:48:34.189 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:48:34.189 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-09-12T01:48:34.189 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld.service is not enabled 2024-09-12T01:48:34.189 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:48:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:48:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout disabled 2024-09-12T01:48:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:48:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-09-12T01:48:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld.service is not enabled 2024-09-12T01:48:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T01:48:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr to start... 2024-09-12T01:48:34.221 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr... 2024-09-12T01:48:34.457 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:34 smithi062 bash[30875]: d0e9031ef5e832ac715a713aab084b1b45a264780cded574a5994971167ba33d 2024-09-12T01:48:34.457 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:34 smithi062 systemd[1]: Started Ceph mgr.x for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:48:34.457 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:34 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:34.234+0000 7f4aab1da040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:48:34.457 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:34 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:34.307+0000 7f4aab1da040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:48:34.707 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:34 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:34.507+0000 7f4aab1da040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:48:34.707 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:34 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:34.590+0000 7f4aab1da040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:48:34.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:34 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4075901945' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:48:34.961 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:34 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:34.776+0000 7f4aab1da040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:48:34.961 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:34 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:34.960+0000 7f4aab1da040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:48:35.453 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "f18ee350-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:48:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:48:35.455 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:48:35.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:48:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:48:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:48:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:48:25:739215+0000", 2024-09-12T01:48:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:48:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:48:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:35.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:48:25.740004+0000", 2024-09-12T01:48:35.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.699+0000 7f6b8a600640 1 Processor -- start 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.699+0000 7f6b8a600640 1 -- start start 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.699+0000 7f6b8a600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b84109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.699+0000 7f6b8a600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8410a1e0 con 0x7f6b84109810 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.700+0000 7f6b83400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b84109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.700+0000 7f6b83400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b84109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37918/0 (socket says 172.21.15.62:37918) 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.700+0000 7f6b83400640 1 -- 172.21.15.62:0/3042106782 learned_addr learned my addr 172.21.15.62:0/3042106782 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.700+0000 7f6b83400640 1 -- 172.21.15.62:0/3042106782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8410a950 con 0x7f6b84109810 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.701+0000 7f6b83400640 1 --2- 172.21.15.62:0/3042106782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b84109c10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009820 tx=0x7f6b7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d8100242a9b375 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.702+0000 7f6b82000640 1 -- 172.21.15.62:0/3042106782 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b74037070 con 0x7f6b84109810 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.702+0000 7f6b82000640 1 -- 172.21.15.62:0/3042106782 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b74032900 con 0x7f6b84109810 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.702+0000 7f6b82000640 1 -- 172.21.15.62:0/3042106782 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b74030850 con 0x7f6b84109810 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.702+0000 7f6b8a600640 1 -- 172.21.15.62:0/3042106782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 msgr2=0x7f6b84109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.702+0000 7f6b8a600640 1 --2- 172.21.15.62:0/3042106782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b84109c10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009820 tx=0x7f6b7402a270 comp rx=0 tx=0).stop 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.703+0000 7f6b8a600640 1 -- 172.21.15.62:0/3042106782 shutdown_connections 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.703+0000 7f6b8a600640 1 --2- 172.21.15.62:0/3042106782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b84109c10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.703+0000 7f6b8a600640 1 -- 172.21.15.62:0/3042106782 >> 172.21.15.62:0/3042106782 conn(0x7f6b8407ccf0 msgr2=0x7f6b8407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.703+0000 7f6b8a600640 1 -- 172.21.15.62:0/3042106782 shutdown_connections 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.703+0000 7f6b8a600640 1 -- 172.21.15.62:0/3042106782 wait complete. 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.704+0000 7f6b8a600640 1 Processor -- start 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.704+0000 7f6b8a600640 1 -- start start 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.704+0000 7f6b8a600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b8419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.704+0000 7f6b8a600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8410dd00 con 0x7f6b84109810 2024-09-12T01:48:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.704+0000 7f6b83400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b8419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.704+0000 7f6b83400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b8419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37934/0 (socket says 172.21.15.62:37934) 2024-09-12T01:48:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.704+0000 7f6b83400640 1 -- 172.21.15.62:0/4075901945 learned_addr learned my addr 172.21.15.62:0/4075901945 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.705+0000 7f6b83400640 1 -- 172.21.15.62:0/4075901945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8419dd10 con 0x7f6b84109810 2024-09-12T01:48:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.705+0000 7f6b83400640 1 --2- 172.21.15.62:0/4075901945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b8419d7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009940 tx=0x7f6b740326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.705+0000 7f6b7be00640 1 -- 172.21.15.62:0/4075901945 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b74042070 con 0x7f6b84109810 2024-09-12T01:48:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.705+0000 7f6b7be00640 1 -- 172.21.15.62:0/4075901945 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b74032be0 con 0x7f6b84109810 2024-09-12T01:48:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.705+0000 7f6b7be00640 1 -- 172.21.15.62:0/4075901945 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b74037040 con 0x7f6b84109810 2024-09-12T01:48:35.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.705+0000 7f6b8a600640 1 -- 172.21.15.62:0/4075901945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8419dfa0 con 0x7f6b84109810 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.706+0000 7f6b8a600640 1 -- 172.21.15.62:0/4075901945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b841a0c90 con 0x7f6b84109810 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.706+0000 7f6b7be00640 1 -- 172.21.15.62:0/4075901945 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6b74045070 con 0x7f6b84109810 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.706+0000 7f6b7be00640 1 -- 172.21.15.62:0/4075901945 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6b74047a30 con 0x7f6b84109810 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.707+0000 7f6b8a600640 1 -- 172.21.15.62:0/4075901945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b84109c10 con 0x7f6b84109810 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.709+0000 7f6b7be00640 1 -- 172.21.15.62:0/4075901945 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6b74032d90 con 0x7f6b84109810 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.775+0000 7f6b8a600640 1 -- 172.21.15.62:0/4075901945 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6b841a0e60 con 0x7f6b84109810 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.775+0000 7f6b7be00640 1 -- 172.21.15.62:0/4075901945 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f6b7403d430 con 0x7f6b84109810 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.776+0000 7f6b8a600640 1 -- 172.21.15.62:0/4075901945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 msgr2=0x7f6b8419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.776+0000 7f6b8a600640 1 --2- 172.21.15.62:0/4075901945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b8419d7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009940 tx=0x7f6b740326e0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.776+0000 7f6b8a600640 1 -- 172.21.15.62:0/4075901945 shutdown_connections 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.776+0000 7f6b8a600640 1 --2- 172.21.15.62:0/4075901945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b84109810 0x7f6b8419d7d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.776+0000 7f6b8a600640 1 -- 172.21.15.62:0/4075901945 >> 172.21.15.62:0/4075901945 conn(0x7f6b8407ccf0 msgr2=0x7f6b841074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:35.469 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.777+0000 7f6b8a600640 1 -- 172.21.15.62:0/4075901945 shutdown_connections 2024-09-12T01:48:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:34.777+0000 7f6b8a600640 1 -- 172.21.15.62:0/4075901945 wait complete. 2024-09-12T01:48:35.470 INFO:teuthology.orchestra.run.smithi062.stdout:mgr not available, waiting (1/15)... 2024-09-12T01:48:35.671 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:35 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:35.356+0000 7f4aab1da040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:48:35.671 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:35 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:35.431+0000 7f4aab1da040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:48:35.671 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:35 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:35.670+0000 7f4aab1da040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:48:37.091 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:36 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:36.828+0000 7f4aab1da040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:48:37.092 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:36 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:36.911+0000 7f4aab1da040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:48:38.230 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:38 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4089896810' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:48:38.230 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:37 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:37.903+0000 7f4aab1da040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:48:38.230 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:38 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:38.051+0000 7f4aab1da040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:48:38.230 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:38 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:38.229+0000 7f4aab1da040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:48:38.485 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:38 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:38.305+0000 7f4aab1da040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:48:38.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "f18ee350-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:48:38.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:38.603 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:48:38.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:48:38.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:48:38.612 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:48:25:739215+0000", 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:48:38.613 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:48:38.614 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:48:38.614 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:48:38.614 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:48:25.740004+0000", 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:48:38.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.939+0000 7ffb0c600640 1 Processor -- start 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.939+0000 7ffb0c600640 1 -- start start 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.940+0000 7ffb0c600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb04109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.940+0000 7ffb0c600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0410a1e0 con 0x7ffb04109810 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.940+0000 7ffb09c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb04109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.940+0000 7ffb09c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb04109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37946/0 (socket says 172.21.15.62:37946) 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.940+0000 7ffb09c00640 1 -- 172.21.15.62:0/2989032550 learned_addr learned my addr 172.21.15.62:0/2989032550 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.940+0000 7ffb09c00640 1 -- 172.21.15.62:0/2989032550 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0410a950 con 0x7ffb04109810 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.942+0000 7ffb09c00640 1 --2- 172.21.15.62:0/2989032550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb04109c10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009820 tx=0x7ffaf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0221ca0dead2af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.942+0000 7ffb03e00640 1 -- 172.21.15.62:0/2989032550 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8037070 con 0x7ffb04109810 2024-09-12T01:48:38.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.942+0000 7ffb03e00640 1 -- 172.21.15.62:0/2989032550 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffaf8032900 con 0x7ffb04109810 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.942+0000 7ffb03e00640 1 -- 172.21.15.62:0/2989032550 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8030850 con 0x7ffb04109810 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.943+0000 7ffb0c600640 1 -- 172.21.15.62:0/2989032550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 msgr2=0x7ffb04109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.943+0000 7ffb0c600640 1 --2- 172.21.15.62:0/2989032550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb04109c10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009820 tx=0x7ffaf802a270 comp rx=0 tx=0).stop 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.943+0000 7ffb0c600640 1 -- 172.21.15.62:0/2989032550 shutdown_connections 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.943+0000 7ffb0c600640 1 --2- 172.21.15.62:0/2989032550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb04109c10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.943+0000 7ffb0c600640 1 -- 172.21.15.62:0/2989032550 >> 172.21.15.62:0/2989032550 conn(0x7ffb0407ccf0 msgr2=0x7ffb0407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.943+0000 7ffb0c600640 1 -- 172.21.15.62:0/2989032550 shutdown_connections 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.943+0000 7ffb0c600640 1 -- 172.21.15.62:0/2989032550 wait complete. 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.944+0000 7ffb0c600640 1 Processor -- start 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.944+0000 7ffb0c600640 1 -- start start 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.944+0000 7ffb0c600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb0419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:38.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.944+0000 7ffb0c600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0410dd00 con 0x7ffb04109810 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.944+0000 7ffb09c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb0419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.945+0000 7ffb09c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb0419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37952/0 (socket says 172.21.15.62:37952) 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.945+0000 7ffb09c00640 1 -- 172.21.15.62:0/4089896810 learned_addr learned my addr 172.21.15.62:0/4089896810 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.945+0000 7ffb09c00640 1 -- 172.21.15.62:0/4089896810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0419dd10 con 0x7ffb04109810 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.945+0000 7ffb09c00640 1 --2- 172.21.15.62:0/4089896810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb0419d7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009940 tx=0x7ffaf80326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.945+0000 7ffb02000640 1 -- 172.21.15.62:0/4089896810 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8042070 con 0x7ffb04109810 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.946+0000 7ffb02000640 1 -- 172.21.15.62:0/4089896810 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffaf8032be0 con 0x7ffb04109810 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.946+0000 7ffb0c600640 1 -- 172.21.15.62:0/4089896810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0419dfa0 con 0x7ffb04109810 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.946+0000 7ffb02000640 1 -- 172.21.15.62:0/4089896810 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8037040 con 0x7ffb04109810 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.946+0000 7ffb0c600640 1 -- 172.21.15.62:0/4089896810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb041a0c90 con 0x7ffb04109810 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.946+0000 7ffb02000640 1 -- 172.21.15.62:0/4089896810 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffaf8045070 con 0x7ffb04109810 2024-09-12T01:48:38.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.946+0000 7ffb02000640 1 -- 172.21.15.62:0/4089896810 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffaf8047a80 con 0x7ffb04109810 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.947+0000 7ffb0c600640 1 -- 172.21.15.62:0/4089896810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb04109c10 con 0x7ffb04109810 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:37.949+0000 7ffb02000640 1 -- 172.21.15.62:0/4089896810 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ffaf8032d90 con 0x7ffb04109810 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:38.015+0000 7ffb0c600640 1 -- 172.21.15.62:0/4089896810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ffb041a0e60 con 0x7ffb04109810 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:38.015+0000 7ffb02000640 1 -- 172.21.15.62:0/4089896810 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7ffaf803d430 con 0x7ffb04109810 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:38.017+0000 7ffb0c600640 1 -- 172.21.15.62:0/4089896810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 msgr2=0x7ffb0419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:38.017+0000 7ffb0c600640 1 --2- 172.21.15.62:0/4089896810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb0419d7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009940 tx=0x7ffaf80326e0 comp rx=0 tx=0).stop 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:38.017+0000 7ffb0c600640 1 -- 172.21.15.62:0/4089896810 shutdown_connections 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:38.017+0000 7ffb0c600640 1 --2- 172.21.15.62:0/4089896810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb04109810 0x7ffb0419d7d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:38.017+0000 7ffb0c600640 1 -- 172.21.15.62:0/4089896810 >> 172.21.15.62:0/4089896810 conn(0x7ffb0407ccf0 msgr2=0x7ffb041074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:38.017+0000 7ffb0c600640 1 -- 172.21.15.62:0/4089896810 shutdown_connections 2024-09-12T01:48:38.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:38.017+0000 7ffb0c600640 1 -- 172.21.15.62:0/4089896810 wait complete. 2024-09-12T01:48:38.620 INFO:teuthology.orchestra.run.smithi062.stdout:mgr not available, waiting (2/15)... 2024-09-12T01:48:38.835 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:38 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:38.484+0000 7f4aab1da040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:48:38.836 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:38 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:38.570+0000 7f4aab1da040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:48:38.836 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:38 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:38.647+0000 7f4aab1da040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:48:38.836 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:38 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:38.835+0000 7f4aab1da040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:48:39.091 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:38 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:38.915+0000 7f4aab1da040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:48:39.092 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:38 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:38.997+0000 7f4aab1da040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:48:39.591 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:39 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:39.098+0000 7f4aab1da040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:48:39.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:39 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:39.171+0000 7f4aab1da040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:48:39.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:39 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:39.244+0000 7f4aab1da040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:48:40.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:40.198+0000 7f4aab1da040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:48:40.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: Activating manager daemon x 2024-09-12T01:48:40.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: mgrmap e2: x(active, starting, since 0.00388192s) 2024-09-12T01:48:40.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: from='mgr.14100 172.21.15.62:0/773442368' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:48:40.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: from='mgr.14100 172.21.15.62:0/773442368' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:48:40.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: from='mgr.14100 172.21.15.62:0/773442368' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:48:40.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: from='mgr.14100 172.21.15.62:0/773442368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:48:40.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: from='mgr.14100 172.21.15.62:0/773442368' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:48:40.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: Manager daemon x is now available 2024-09-12T01:48:40.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: from='mgr.14100 172.21.15.62:0/773442368' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:48:40.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: from='mgr.14100 172.21.15.62:0/773442368' entity='mgr.x' 2024-09-12T01:48:40.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: from='mgr.14100 172.21.15.62:0/773442368' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:48:40.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: from='mgr.14100 172.21.15.62:0/773442368' entity='mgr.x' 2024-09-12T01:48:40.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:40 smithi062 ceph-mon[30666]: from='mgr.14100 172.21.15.62:0/773442368' entity='mgr.x' 2024-09-12T01:48:41.345 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:41 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1606567262' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:48:41.345 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:41 smithi062 ceph-mon[30666]: mgrmap e3: x(active, since 1.00775s) 2024-09-12T01:48:41.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:41.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:48:41.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "f18ee350-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:48:41.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:48:41.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:48:41.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:48:41.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:48:41.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:41.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:48:41.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:48:41.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:48:41.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:41.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:48:41.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:48:41.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:41.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-12T01:48:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:48:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:48:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:48:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:48:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:48:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:48:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:48:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:48:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:48:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:48:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:48:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:48:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:48:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:48:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:48:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:48:25:739215+0000", 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:48:41.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:48:25.740004+0000", 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:48:41.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.075+0000 7fd112000640 1 Processor -- start 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.075+0000 7fd112000640 1 -- start start 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.076+0000 7fd112000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c07c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.076+0000 7fd112000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c07c870 con 0x7fd10c07de40 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.076+0000 7fd10b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c07c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.076+0000 7fd10b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c07c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38028/0 (socket says 172.21.15.62:38028) 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.076+0000 7fd10b400640 1 -- 172.21.15.62:0/2742948885 learned_addr learned my addr 172.21.15.62:0/2742948885 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.077+0000 7fd10b400640 1 -- 172.21.15.62:0/2742948885 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10c07c9f0 con 0x7fd10c07de40 2024-09-12T01:48:41.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.078+0000 7fd10b400640 1 --2- 172.21.15.62:0/2742948885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c07c2a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009820 tx=0x7fd0fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44859e8c2ec2c55a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.078+0000 7fd10aa00640 1 -- 172.21.15.62:0/2742948885 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc037070 con 0x7fd10c07de40 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.078+0000 7fd10aa00640 1 -- 172.21.15.62:0/2742948885 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0fc032900 con 0x7fd10c07de40 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.078+0000 7fd10aa00640 1 -- 172.21.15.62:0/2742948885 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc030850 con 0x7fd10c07de40 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.078+0000 7fd112000640 1 -- 172.21.15.62:0/2742948885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 msgr2=0x7fd10c07c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.078+0000 7fd112000640 1 --2- 172.21.15.62:0/2742948885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c07c2a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009820 tx=0x7fd0fc02a270 comp rx=0 tx=0).stop 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.079+0000 7fd112000640 1 -- 172.21.15.62:0/2742948885 shutdown_connections 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.079+0000 7fd112000640 1 --2- 172.21.15.62:0/2742948885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c07c2a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.079+0000 7fd112000640 1 -- 172.21.15.62:0/2742948885 >> 172.21.15.62:0/2742948885 conn(0x7fd10c102cc0 msgr2=0x7fd10c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.079+0000 7fd112000640 1 -- 172.21.15.62:0/2742948885 shutdown_connections 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.079+0000 7fd112000640 1 -- 172.21.15.62:0/2742948885 wait complete. 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.080+0000 7fd112000640 1 Processor -- start 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.080+0000 7fd112000640 1 -- start start 2024-09-12T01:48:41.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.080+0000 7fd112000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c19d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.080+0000 7fd112000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c10dba0 con 0x7fd10c07de40 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.080+0000 7fd10b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c19d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.080+0000 7fd10b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c19d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38044/0 (socket says 172.21.15.62:38044) 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.080+0000 7fd10b400640 1 -- 172.21.15.62:0/1606567262 learned_addr learned my addr 172.21.15.62:0/1606567262 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.081+0000 7fd10b400640 1 -- 172.21.15.62:0/1606567262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10c19dc80 con 0x7fd10c07de40 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.081+0000 7fd10b400640 1 --2- 172.21.15.62:0/1606567262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c19d740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0097f0 tx=0x7fd0fc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.081+0000 7fd108c00640 1 -- 172.21.15.62:0/1606567262 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc037040 con 0x7fd10c07de40 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.081+0000 7fd108c00640 1 -- 172.21.15.62:0/1606567262 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0fc040070 con 0x7fd10c07de40 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.081+0000 7fd112000640 1 -- 172.21.15.62:0/1606567262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10c19df10 con 0x7fd10c07de40 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.081+0000 7fd108c00640 1 -- 172.21.15.62:0/1606567262 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc03a390 con 0x7fd10c07de40 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.081+0000 7fd112000640 1 -- 172.21.15.62:0/1606567262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd10c1a0c00 con 0x7fd10c07de40 2024-09-12T01:48:41.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.082+0000 7fd108c00640 1 -- 172.21.15.62:0/1606567262 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 2) ==== 46043+0+0 (secure 0 0 0) 0x7fd0fc032900 con 0x7fd10c07de40 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.082+0000 7fd112000640 1 -- 172.21.15.62:0/1606567262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd10c07c320 con 0x7fd10c07de40 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.083+0000 7fd108c00640 1 -- 172.21.15.62:0/1606567262 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd0fc06bd00 con 0x7fd10c07de40 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.085+0000 7fd108c00640 1 -- 172.21.15.62:0/1606567262 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd0fc032bf0 con 0x7fd10c07de40 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.150+0000 7fd112000640 1 -- 172.21.15.62:0/1606567262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd10c19e390 con 0x7fd10c07de40 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.150+0000 7fd108c00640 1 -- 172.21.15.62:0/1606567262 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fd0fc044ca0 con 0x7fd10c07de40 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.151+0000 7fd112000640 1 -- 172.21.15.62:0/1606567262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 msgr2=0x7fd10c19d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.151+0000 7fd112000640 1 --2- 172.21.15.62:0/1606567262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c19d740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0097f0 tx=0x7fd0fc030d80 comp rx=0 tx=0).stop 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.151+0000 7fd112000640 1 -- 172.21.15.62:0/1606567262 shutdown_connections 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.151+0000 7fd112000640 1 --2- 172.21.15.62:0/1606567262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd10c07de40 0x7fd10c19d740 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.151+0000 7fd112000640 1 -- 172.21.15.62:0/1606567262 >> 172.21.15.62:0/1606567262 conn(0x7fd10c102cc0 msgr2=0x7fd10c103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.151+0000 7fd112000640 1 -- 172.21.15.62:0/1606567262 shutdown_connections 2024-09-12T01:48:41.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:41.151+0000 7fd112000640 1 -- 172.21.15.62:0/1606567262 wait complete. 2024-09-12T01:48:41.865 INFO:teuthology.orchestra.run.smithi062.stdout:mgr not available, waiting (3/15)... 2024-09-12T01:48:43.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:43 smithi062 ceph-mon[30666]: mgrmap e4: x(active, since 2s) 2024-09-12T01:48:45.012 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:44 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3284051549' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:48:45.553 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:45.553 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:48:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "f18ee350-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:48:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:48:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:48:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:48:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:48:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:48:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:48:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:48:45.554 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:48:45.555 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:48:45.556 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:48:25:739215+0000", 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:48:45.557 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:48:25.740004+0000", 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:48:45.558 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.391+0000 7f39cf200640 1 Processor -- start 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.391+0000 7f39cf200640 1 -- start start 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.391+0000 7f39cf200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d0107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.392+0000 7f39cf200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0107d20 con 0x7f39d0107350 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.392+0000 7f39cde00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d0107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.392+0000 7f39cde00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d0107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46384/0 (socket says 172.21.15.62:46384) 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.392+0000 7f39cde00640 1 -- 172.21.15.62:0/1391161211 learned_addr learned my addr 172.21.15.62:0/1391161211 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.392+0000 7f39cde00640 1 -- 172.21.15.62:0/1391161211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d0108550 con 0x7f39d0107350 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.393+0000 7f39cde00640 1 --2- 172.21.15.62:0/1391161211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d0107750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009820 tx=0x7f39c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11b841d46920be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.394+0000 7f39cd400640 1 -- 172.21.15.62:0/1391161211 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c0037070 con 0x7f39d0107350 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.394+0000 7f39cd400640 1 -- 172.21.15.62:0/1391161211 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39c0032900 con 0x7f39d0107350 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.394+0000 7f39cd400640 1 -- 172.21.15.62:0/1391161211 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c0030850 con 0x7f39d0107350 2024-09-12T01:48:45.559 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.394+0000 7f39cf200640 1 -- 172.21.15.62:0/1391161211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 msgr2=0x7f39d0107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.394+0000 7f39cf200640 1 --2- 172.21.15.62:0/1391161211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d0107750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009820 tx=0x7f39c002a270 comp rx=0 tx=0).stop 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.394+0000 7f39cf200640 1 -- 172.21.15.62:0/1391161211 shutdown_connections 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.394+0000 7f39cf200640 1 --2- 172.21.15.62:0/1391161211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d0107750 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.394+0000 7f39cf200640 1 -- 172.21.15.62:0/1391161211 >> 172.21.15.62:0/1391161211 conn(0x7f39d0102ae0 msgr2=0x7f39d0104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.394+0000 7f39cf200640 1 -- 172.21.15.62:0/1391161211 shutdown_connections 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.394+0000 7f39cf200640 1 -- 172.21.15.62:0/1391161211 wait complete. 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.395+0000 7f39cf200640 1 Processor -- start 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.395+0000 7f39cf200640 1 -- start start 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.396+0000 7f39cf200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.396+0000 7f39cf200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f39d010b900 con 0x7f39d0107350 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.396+0000 7f39cde00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:45.560 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.396+0000 7f39cde00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d019d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46394/0 (socket says 172.21.15.62:46394) 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.396+0000 7f39cde00640 1 -- 172.21.15.62:0/3284051549 learned_addr learned my addr 172.21.15.62:0/3284051549 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.396+0000 7f39cde00640 1 -- 172.21.15.62:0/3284051549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d019dae0 con 0x7f39d0107350 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.397+0000 7f39cde00640 1 --2- 172.21.15.62:0/3284051549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d019d5a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f39c00097f0 tx=0x7f39c0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.397+0000 7f39c6a00640 1 -- 172.21.15.62:0/3284051549 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c0037040 con 0x7f39d0107350 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.397+0000 7f39c6a00640 1 -- 172.21.15.62:0/3284051549 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39c0040070 con 0x7f39d0107350 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.397+0000 7f39c6a00640 1 -- 172.21.15.62:0/3284051549 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c003a390 con 0x7f39d0107350 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.397+0000 7f39cf200640 1 -- 172.21.15.62:0/3284051549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d019dd70 con 0x7f39d0107350 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.397+0000 7f39cf200640 1 -- 172.21.15.62:0/3284051549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d01a0a60 con 0x7f39d0107350 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.398+0000 7f39c6a00640 1 -- 172.21.15.62:0/3284051549 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f39c003b430 con 0x7f39d0107350 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.398+0000 7f39cf200640 1 -- 172.21.15.62:0/3284051549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d010ba80 con 0x7f39d0107350 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.399+0000 7f39c6a00640 1 --2- 172.21.15.62:0/3284051549 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7f39b4038f70 0x7f39b403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.399+0000 7f39c6a00640 1 -- 172.21.15.62:0/3284051549 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39c006c080 con 0x7f39d0107350 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.399+0000 7f39c7e00640 1 --2- 172.21.15.62:0/3284051549 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7f39b4038f70 0x7f39b403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.400+0000 7f39c7e00640 1 --2- 172.21.15.62:0/3284051549 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7f39b4038f70 0x7f39b403b430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f39b80098c0 tx=0x7f39b8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.405+0000 7f39c6a00640 1 -- 172.21.15.62:0/3284051549 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39c006bde0 con 0x7f39d0107350 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.663+0000 7f39cf200640 1 -- 172.21.15.62:0/3284051549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f39d01a0c30 con 0x7f39d0107350 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.664+0000 7f39c6a00640 1 -- 172.21.15.62:0/3284051549 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f39c0032900 con 0x7f39d0107350 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.666+0000 7f39cf200640 1 -- 172.21.15.62:0/3284051549 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7f39b4038f70 msgr2=0x7f39b403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.666+0000 7f39cf200640 1 --2- 172.21.15.62:0/3284051549 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7f39b4038f70 0x7f39b403b430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f39b80098c0 tx=0x7f39b8006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.666+0000 7f39cf200640 1 -- 172.21.15.62:0/3284051549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 msgr2=0x7f39d019d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.666+0000 7f39cf200640 1 --2- 172.21.15.62:0/3284051549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d019d5a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f39c00097f0 tx=0x7f39c0030d80 comp rx=0 tx=0).stop 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.667+0000 7f39cf200640 1 -- 172.21.15.62:0/3284051549 shutdown_connections 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.667+0000 7f39cf200640 1 --2- 172.21.15.62:0/3284051549 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7f39b4038f70 0x7f39b403b430 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:45.562 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.667+0000 7f39cf200640 1 --2- 172.21.15.62:0/3284051549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d0107350 0x7f39d019d5a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:45.563 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.667+0000 7f39cf200640 1 -- 172.21.15.62:0/3284051549 >> 172.21.15.62:0/3284051549 conn(0x7f39d0102ae0 msgr2=0x7f39d0103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:45.563 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.667+0000 7f39cf200640 1 -- 172.21.15.62:0/3284051549 shutdown_connections 2024-09-12T01:48:45.563 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:44.667+0000 7f39cf200640 1 -- 172.21.15.62:0/3284051549 wait complete. 2024-09-12T01:48:45.563 INFO:teuthology.orchestra.run.smithi062.stdout:mgr is available 2024-09-12T01:48:46.535 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:46 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2489428299' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:48:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:48:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout fsid = f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:46.765 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.62:3300,v1:172.21.15.62:6789] 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:48:46.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.014+0000 7fe193e00640 1 Processor -- start 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.015+0000 7fe193e00640 1 -- start start 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.015+0000 7fe193e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe194109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.015+0000 7fe193e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe19410a1e0 con 0x7fe194109810 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.015+0000 7fe192a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe194109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.016+0000 7fe192a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe194109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46410/0 (socket says 172.21.15.62:46410) 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.016+0000 7fe192a00640 1 -- 172.21.15.62:0/163883490 learned_addr learned my addr 172.21.15.62:0/163883490 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.016+0000 7fe192a00640 1 -- 172.21.15.62:0/163883490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19410a730 con 0x7fe194109810 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.017+0000 7fe192a00640 1 --2- 172.21.15.62:0/163883490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe194109c10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe184009e80 tx=0x7fe18402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569324595223adc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.017+0000 7fe192000640 1 -- 172.21.15.62:0/163883490 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe184036070 con 0x7fe194109810 2024-09-12T01:48:46.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.017+0000 7fe192000640 1 -- 172.21.15.62:0/163883490 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1840318c0 con 0x7fe194109810 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.017+0000 7fe192000640 1 -- 172.21.15.62:0/163883490 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe184007ab0 con 0x7fe194109810 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.018+0000 7fe193e00640 1 -- 172.21.15.62:0/163883490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 msgr2=0x7fe194109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.018+0000 7fe193e00640 1 --2- 172.21.15.62:0/163883490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe194109c10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe184009e80 tx=0x7fe18402a7a0 comp rx=0 tx=0).stop 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.018+0000 7fe193e00640 1 -- 172.21.15.62:0/163883490 shutdown_connections 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.018+0000 7fe193e00640 1 --2- 172.21.15.62:0/163883490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe194109c10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.018+0000 7fe193e00640 1 -- 172.21.15.62:0/163883490 >> 172.21.15.62:0/163883490 conn(0x7fe19407cb00 msgr2=0x7fe19407cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.018+0000 7fe193e00640 1 -- 172.21.15.62:0/163883490 shutdown_connections 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.018+0000 7fe193e00640 1 -- 172.21.15.62:0/163883490 wait complete. 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.019+0000 7fe193e00640 1 Processor -- start 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.019+0000 7fe193e00640 1 -- start start 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.019+0000 7fe193e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe19419d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.019+0000 7fe193e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe19410d9f0 con 0x7fe194109810 2024-09-12T01:48:46.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.019+0000 7fe192a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe19419d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.020+0000 7fe192a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe19419d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46416/0 (socket says 172.21.15.62:46416) 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.020+0000 7fe192a00640 1 -- 172.21.15.62:0/2489428299 learned_addr learned my addr 172.21.15.62:0/2489428299 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.020+0000 7fe192a00640 1 -- 172.21.15.62:0/2489428299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19419db10 con 0x7fe194109810 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.020+0000 7fe192a00640 1 --2- 172.21.15.62:0/2489428299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe19419d5d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe184031ca0 tx=0x7fe184031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.020+0000 7fe18be00640 1 -- 172.21.15.62:0/2489428299 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe184036050 con 0x7fe194109810 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.020+0000 7fe18be00640 1 -- 172.21.15.62:0/2489428299 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe184042070 con 0x7fe194109810 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.020+0000 7fe193e00640 1 -- 172.21.15.62:0/2489428299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19419dda0 con 0x7fe194109810 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.020+0000 7fe18be00640 1 -- 172.21.15.62:0/2489428299 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18403d940 con 0x7fe194109810 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.021+0000 7fe193e00640 1 -- 172.21.15.62:0/2489428299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1941a0a90 con 0x7fe194109810 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.022+0000 7fe193e00640 1 -- 172.21.15.62:0/2489428299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe194109c90 con 0x7fe194109810 2024-09-12T01:48:46.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.022+0000 7fe18be00640 1 -- 172.21.15.62:0/2489428299 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fe18403b610 con 0x7fe194109810 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.022+0000 7fe18be00640 1 --2- 172.21.15.62:0/2489428299 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fe178038f70 0x7fe17803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.022+0000 7fe18be00640 1 -- 172.21.15.62:0/2489428299 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe184007e00 con 0x7fe194109810 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.023+0000 7fe18a000640 1 --2- 172.21.15.62:0/2489428299 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fe178038f70 0x7fe17803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.023+0000 7fe18a000640 1 --2- 172.21.15.62:0/2489428299 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fe178038f70 0x7fe17803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0098c0 tx=0x7fe17c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.027+0000 7fe18be00640 1 -- 172.21.15.62:0/2489428299 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe184042220 con 0x7fe194109810 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.215+0000 7fe193e00640 1 -- 172.21.15.62:0/2489428299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe1941a2290 con 0x7fe194109810 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.216+0000 7fe18be00640 1 -- 172.21.15.62:0/2489428299 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fe18406cc80 con 0x7fe194109810 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.218+0000 7fe193e00640 1 -- 172.21.15.62:0/2489428299 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fe178038f70 msgr2=0x7fe17803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.218+0000 7fe193e00640 1 --2- 172.21.15.62:0/2489428299 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fe178038f70 0x7fe17803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0098c0 tx=0x7fe17c006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.218+0000 7fe193e00640 1 -- 172.21.15.62:0/2489428299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 msgr2=0x7fe19419d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.218+0000 7fe193e00640 1 --2- 172.21.15.62:0/2489428299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe19419d5d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe184031ca0 tx=0x7fe184031cd0 comp rx=0 tx=0).stop 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.219+0000 7fe193e00640 1 -- 172.21.15.62:0/2489428299 shutdown_connections 2024-09-12T01:48:46.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.219+0000 7fe193e00640 1 --2- 172.21.15.62:0/2489428299 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fe178038f70 0x7fe17803b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.219+0000 7fe193e00640 1 --2- 172.21.15.62:0/2489428299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe194109810 0x7fe19419d5d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.219+0000 7fe193e00640 1 -- 172.21.15.62:0/2489428299 >> 172.21.15.62:0/2489428299 conn(0x7fe19407cb00 msgr2=0x7fe194107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.219+0000 7fe193e00640 1 -- 172.21.15.62:0/2489428299 shutdown_connections 2024-09-12T01:48:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:46.219+0000 7fe193e00640 1 -- 172.21.15.62:0/2489428299 wait complete. 2024-09-12T01:48:46.771 INFO:teuthology.orchestra.run.smithi062.stdout:Enabling cephadm module... 2024-09-12T01:48:47.784 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:47 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/881694271' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T01:48:47.785 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:47 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: ignoring --setuser ceph since I am not root 2024-09-12T01:48:47.785 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:47 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: ignoring --setgroup ceph since I am not root 2024-09-12T01:48:47.785 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:47 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:47.785+0000 7f1182fd4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:48:48.048 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:47 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:47.857+0000 7f1182fd4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:48:48.048 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:48.048+0000 7f1182fd4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:48:48.152 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.257+0000 7efee6600640 1 Processor -- start 2024-09-12T01:48:48.152 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.257+0000 7efee6600640 1 -- start start 2024-09-12T01:48:48.152 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.257+0000 7efee6600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee0107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:48.152 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.257+0000 7efee6600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efee0107f00 con 0x7efee0107530 2024-09-12T01:48:48.152 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.258+0000 7efedf400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee0107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:48.152 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.258+0000 7efedf400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee0107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46422/0 (socket says 172.21.15.62:46422) 2024-09-12T01:48:48.152 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.258+0000 7efedf400640 1 -- 172.21.15.62:0/3700004928 learned_addr learned my addr 172.21.15.62:0/3700004928 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:48.152 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.258+0000 7efedf400640 1 -- 172.21.15.62:0/3700004928 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee0108730 con 0x7efee0107530 2024-09-12T01:48:48.152 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.259+0000 7efedf400640 1 --2- 172.21.15.62:0/3700004928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee0107930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efed0009820 tx=0x7efed002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b176ed5c27d973d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.259+0000 7efede000640 1 -- 172.21.15.62:0/3700004928 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efed0037070 con 0x7efee0107530 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.259+0000 7efede000640 1 -- 172.21.15.62:0/3700004928 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efed0032900 con 0x7efee0107530 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.259+0000 7efede000640 1 -- 172.21.15.62:0/3700004928 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efed0030850 con 0x7efee0107530 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.260+0000 7efee6600640 1 -- 172.21.15.62:0/3700004928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 msgr2=0x7efee0107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.260+0000 7efee6600640 1 --2- 172.21.15.62:0/3700004928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee0107930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efed0009820 tx=0x7efed002a270 comp rx=0 tx=0).stop 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.260+0000 7efee6600640 1 -- 172.21.15.62:0/3700004928 shutdown_connections 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.260+0000 7efee6600640 1 --2- 172.21.15.62:0/3700004928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee0107930 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.260+0000 7efee6600640 1 -- 172.21.15.62:0/3700004928 >> 172.21.15.62:0/3700004928 conn(0x7efee0102cc0 msgr2=0x7efee0105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.260+0000 7efee6600640 1 -- 172.21.15.62:0/3700004928 shutdown_connections 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.260+0000 7efee6600640 1 -- 172.21.15.62:0/3700004928 wait complete. 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.261+0000 7efee6600640 1 Processor -- start 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.261+0000 7efee6600640 1 -- start start 2024-09-12T01:48:48.153 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.261+0000 7efee6600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.261+0000 7efee6600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efee010bae0 con 0x7efee0107530 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.262+0000 7efedf400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.262+0000 7efedf400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee019d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46436/0 (socket says 172.21.15.62:46436) 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.262+0000 7efedf400640 1 -- 172.21.15.62:0/881694271 learned_addr learned my addr 172.21.15.62:0/881694271 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.262+0000 7efedf400640 1 -- 172.21.15.62:0/881694271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee019dcc0 con 0x7efee0107530 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.262+0000 7efedf400640 1 --2- 172.21.15.62:0/881694271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee019d780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efed00097f0 tx=0x7efed0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.262+0000 7efed7e00640 1 -- 172.21.15.62:0/881694271 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efed0037040 con 0x7efee0107530 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.262+0000 7efed7e00640 1 -- 172.21.15.62:0/881694271 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efed0040070 con 0x7efee0107530 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.262+0000 7efee6600640 1 -- 172.21.15.62:0/881694271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee019df50 con 0x7efee0107530 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.262+0000 7efed7e00640 1 -- 172.21.15.62:0/881694271 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efed003a390 con 0x7efee0107530 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.263+0000 7efee6600640 1 -- 172.21.15.62:0/881694271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee01a0c40 con 0x7efee0107530 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.264+0000 7efed7e00640 1 -- 172.21.15.62:0/881694271 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7efed003b430 con 0x7efee0107530 2024-09-12T01:48:48.154 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.264+0000 7efee6600640 1 -- 172.21.15.62:0/881694271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee01079b0 con 0x7efee0107530 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.264+0000 7efed7e00640 1 --2- 172.21.15.62:0/881694271 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7efec4038f70 0x7efec403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.264+0000 7efed7e00640 1 -- 172.21.15.62:0/881694271 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efed006c090 con 0x7efee0107530 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.264+0000 7efedea00640 1 --2- 172.21.15.62:0/881694271 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7efec4038f70 0x7efec403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.265+0000 7efedea00640 1 --2- 172.21.15.62:0/881694271 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7efec4038f70 0x7efec403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efecc0098c0 tx=0x7efecc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.269+0000 7efed7e00640 1 -- 172.21.15.62:0/881694271 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efed006bdf0 con 0x7efee0107530 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.504+0000 7efee6600640 1 -- 172.21.15.62:0/881694271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7efee019e3d0 con 0x7efee0107530 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.555+0000 7efed7e00640 1 -- 172.21.15.62:0/881694271 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7efed0032900 con 0x7efee0107530 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.557+0000 7efed7e00640 1 -- 172.21.15.62:0/881694271 <== mon.0 v2:172.21.15.62:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7efed0043c30 con 0x7efee0107530 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.559+0000 7efee6600640 1 -- 172.21.15.62:0/881694271 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7efec4038f70 msgr2=0x7efec403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.559+0000 7efee6600640 1 --2- 172.21.15.62:0/881694271 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7efec4038f70 0x7efec403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efecc0098c0 tx=0x7efecc006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.559+0000 7efee6600640 1 -- 172.21.15.62:0/881694271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 msgr2=0x7efee019d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.559+0000 7efee6600640 1 --2- 172.21.15.62:0/881694271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee019d780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efed00097f0 tx=0x7efed0030d80 comp rx=0 tx=0).stop 2024-09-12T01:48:48.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.559+0000 7efee6600640 1 -- 172.21.15.62:0/881694271 shutdown_connections 2024-09-12T01:48:48.156 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.559+0000 7efee6600640 1 --2- 172.21.15.62:0/881694271 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7efec4038f70 0x7efec403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:48.156 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.559+0000 7efee6600640 1 --2- 172.21.15.62:0/881694271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efee0107530 0x7efee019d780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:48.156 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.559+0000 7efee6600640 1 -- 172.21.15.62:0/881694271 >> 172.21.15.62:0/881694271 conn(0x7efee0102cc0 msgr2=0x7efee0103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:48.156 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.559+0000 7efee6600640 1 -- 172.21.15.62:0/881694271 shutdown_connections 2024-09-12T01:48:48.156 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:47.559+0000 7efee6600640 1 -- 172.21.15.62:0/881694271 wait complete. 2024-09-12T01:48:48.314 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:48.131+0000 7f1182fd4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:48:48.578 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:48 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/881694271' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T01:48:48.578 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:48 smithi062 ceph-mon[30666]: mgrmap e5: x(active, since 7s) 2024-09-12T01:48:48.578 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:48.314+0000 7f1182fd4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:48:48.578 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:48.491+0000 7f1182fd4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:48:49.177 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:48.879+0000 7f1182fd4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:48:49.177 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:48.956+0000 7f1182fd4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:48:49.177 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:49 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:49.177+0000 7f1182fd4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:48:49.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.686+0000 7fd830200640 1 Processor -- start 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.686+0000 7fd830200640 1 -- start start 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.686+0000 7fd830200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd828109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.686+0000 7fd830200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd82810a1e0 con 0x7fd828109810 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.687+0000 7fd82d800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd828109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.687+0000 7fd82d800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd828109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46462/0 (socket says 172.21.15.62:46462) 2024-09-12T01:48:49.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.687+0000 7fd82d800640 1 -- 172.21.15.62:0/1325557710 learned_addr learned my addr 172.21.15.62:0/1325557710 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:49.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.687+0000 7fd82d800640 1 -- 172.21.15.62:0/1325557710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82810a950 con 0x7fd828109810 2024-09-12T01:48:49.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.688+0000 7fd82d800640 1 --2- 172.21.15.62:0/1325557710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd828109c10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009820 tx=0x7fd81c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385b51f585570e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.688+0000 7fd827e00640 1 -- 172.21.15.62:0/1325557710 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81c037070 con 0x7fd828109810 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.688+0000 7fd827e00640 1 -- 172.21.15.62:0/1325557710 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd81c032900 con 0x7fd828109810 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.689+0000 7fd827e00640 1 -- 172.21.15.62:0/1325557710 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81c030850 con 0x7fd828109810 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.689+0000 7fd830200640 1 -- 172.21.15.62:0/1325557710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 msgr2=0x7fd828109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.689+0000 7fd830200640 1 --2- 172.21.15.62:0/1325557710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd828109c10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009820 tx=0x7fd81c02a270 comp rx=0 tx=0).stop 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.689+0000 7fd830200640 1 -- 172.21.15.62:0/1325557710 shutdown_connections 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.689+0000 7fd830200640 1 --2- 172.21.15.62:0/1325557710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd828109c10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.689+0000 7fd830200640 1 -- 172.21.15.62:0/1325557710 >> 172.21.15.62:0/1325557710 conn(0x7fd82807ccf0 msgr2=0x7fd82807d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.689+0000 7fd830200640 1 -- 172.21.15.62:0/1325557710 shutdown_connections 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.689+0000 7fd830200640 1 -- 172.21.15.62:0/1325557710 wait complete. 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.690+0000 7fd830200640 1 Processor -- start 2024-09-12T01:48:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.690+0000 7fd830200640 1 -- start start 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.691+0000 7fd830200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd82819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.691+0000 7fd830200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd82810dd00 con 0x7fd828109810 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.691+0000 7fd82d800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd82819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.691+0000 7fd82d800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd82819d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46478/0 (socket says 172.21.15.62:46478) 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.691+0000 7fd82d800640 1 -- 172.21.15.62:0/2713180591 learned_addr learned my addr 172.21.15.62:0/2713180591 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.691+0000 7fd82d800640 1 -- 172.21.15.62:0/2713180591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82819dd10 con 0x7fd828109810 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.692+0000 7fd82d800640 1 --2- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd82819d7d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009940 tx=0x7fd81c0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.692+0000 7fd826000640 1 -- 172.21.15.62:0/2713180591 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81c042070 con 0x7fd828109810 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.692+0000 7fd826000640 1 -- 172.21.15.62:0/2713180591 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd81c032be0 con 0x7fd828109810 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.692+0000 7fd826000640 1 -- 172.21.15.62:0/2713180591 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81c037040 con 0x7fd828109810 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.692+0000 7fd830200640 1 -- 172.21.15.62:0/2713180591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd82819dfa0 con 0x7fd828109810 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.692+0000 7fd830200640 1 -- 172.21.15.62:0/2713180591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8281a0c90 con 0x7fd828109810 2024-09-12T01:48:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.693+0000 7fd826000640 1 -- 172.21.15.62:0/2713180591 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fd81c045070 con 0x7fd828109810 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.693+0000 7fd826000640 1 --2- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fd810038fc0 0x7fd81003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.693+0000 7fd830200640 1 -- 172.21.15.62:0/2713180591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd828109c10 con 0x7fd828109810 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.694+0000 7fd826000640 1 -- 172.21.15.62:0/2713180591 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd81c06be80 con 0x7fd828109810 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.694+0000 7fd82ce00640 1 -- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fd810038fc0 msgr2=0x7fd81003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2854042842 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.694+0000 7fd82ce00640 1 --2- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fd810038fc0 0x7fd81003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.699+0000 7fd826000640 1 -- 172.21.15.62:0/2713180591 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd81c04b170 con 0x7fd828109810 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.895+0000 7fd82ce00640 1 -- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fd810038fc0 msgr2=0x7fd81003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2854042842 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.895+0000 7fd82ce00640 1 --2- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fd810038fc0 0x7fd81003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.934+0000 7fd830200640 1 -- 172.21.15.62:0/2713180591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd8281a12e0 con 0x7fd828109810 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.935+0000 7fd826000640 1 -- 172.21.15.62:0/2713180591 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fd81c06b8a0 con 0x7fd828109810 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.937+0000 7fd830200640 1 -- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fd810038fc0 msgr2=0x7fd81003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:48:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.937+0000 7fd830200640 1 --2- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fd810038fc0 0x7fd81003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:49.625 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.937+0000 7fd830200640 1 -- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 msgr2=0x7fd82819d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:49.625 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.937+0000 7fd830200640 1 --2- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd82819d7d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009940 tx=0x7fd81c0326e0 comp rx=0 tx=0).stop 2024-09-12T01:48:49.625 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.937+0000 7fd830200640 1 -- 172.21.15.62:0/2713180591 shutdown_connections 2024-09-12T01:48:49.625 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.937+0000 7fd830200640 1 --2- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fd810038fc0 0x7fd81003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:49.625 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.937+0000 7fd830200640 1 --2- 172.21.15.62:0/2713180591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd828109810 0x7fd82819d7d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:49.625 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.937+0000 7fd830200640 1 -- 172.21.15.62:0/2713180591 >> 172.21.15.62:0/2713180591 conn(0x7fd82807ccf0 msgr2=0x7fd8281074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:49.625 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.937+0000 7fd830200640 1 -- 172.21.15.62:0/2713180591 shutdown_connections 2024-09-12T01:48:49.625 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:48.937+0000 7fd830200640 1 -- 172.21.15.62:0/2713180591 wait complete. 2024-09-12T01:48:49.625 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for the mgr to restart... 2024-09-12T01:48:49.625 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr epoch 5... 2024-09-12T01:48:49.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:49 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2713180591' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:48:50.591 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:50 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:50.331+0000 7f1182fd4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:48:50.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:50 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:50.415+0000 7f1182fd4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:48:51.672 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:51.359+0000 7f1182fd4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:48:51.672 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:51.501+0000 7f1182fd4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:48:51.672 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:51.671+0000 7f1182fd4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:48:51.925 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:51.746+0000 7f1182fd4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:48:51.925 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:51.924+0000 7f1182fd4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:48:52.272 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:52.009+0000 7f1182fd4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:48:52.272 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:52.083+0000 7f1182fd4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:48:52.272 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:52.271+0000 7f1182fd4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:48:52.542 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:52.354+0000 7f1182fd4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:48:52.542 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:52.439+0000 7f1182fd4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:48:52.542 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:52.541+0000 7f1182fd4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:48:52.841 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:52.618+0000 7f1182fd4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:48:52.842 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:52.692+0000 7f1182fd4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:48:54.092 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:53.657+0000 7f1182fd4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:48:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: Active manager daemon x restarted 2024-09-12T01:48:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: Activating manager daemon x 2024-09-12T01:48:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T01:48:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: mgrmap e6: x(active, starting, since 0.00392957s) 2024-09-12T01:48:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:48:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:48:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:48:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:48:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:48:54.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: Manager daemon x is now available 2024-09-12T01:48:54.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:48:54.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:48:54.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:54.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:53 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:54.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:54 smithi062 ceph-mon[30666]: Found migration_current of "None". Setting to last migration. 2024-09-12T01:48:54.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:54 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:48:54.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:54 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:48:54.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:54 smithi062 ceph-mon[30666]: mgrmap e7: x(active, since 1.00686s) 2024-09-12T01:48:55.278 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:48:55.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T01:48:55.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:48:55.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:48:55.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.077+0000 7fa169400640 1 Processor -- start 2024-09-12T01:48:55.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.078+0000 7fa169400640 1 -- start start 2024-09-12T01:48:55.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.078+0000 7fa169400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa16410a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:55.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.078+0000 7fa169400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa164075730 con 0x7fa164107f10 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.078+0000 7fa163e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa16410a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.078+0000 7fa163e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa16410a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46486/0 (socket says 172.21.15.62:46486) 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.079+0000 7fa163e00640 1 -- 172.21.15.62:0/3506394776 learned_addr learned my addr 172.21.15.62:0/3506394776 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.079+0000 7fa163e00640 1 -- 172.21.15.62:0/3506394776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16410a840 con 0x7fa164107f10 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.080+0000 7fa163e00640 1 --2- 172.21.15.62:0/3506394776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa16410a300 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa154009820 tx=0x7fa15402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1619401dcf1c3afe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.080+0000 7fa163400640 1 -- 172.21.15.62:0/3506394776 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa154037070 con 0x7fa164107f10 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.080+0000 7fa163400640 1 -- 172.21.15.62:0/3506394776 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa154032900 con 0x7fa164107f10 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.080+0000 7fa163400640 1 -- 172.21.15.62:0/3506394776 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa154030850 con 0x7fa164107f10 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.081+0000 7fa169400640 1 -- 172.21.15.62:0/3506394776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 msgr2=0x7fa16410a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.081+0000 7fa169400640 1 --2- 172.21.15.62:0/3506394776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa16410a300 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa154009820 tx=0x7fa15402a270 comp rx=0 tx=0).stop 2024-09-12T01:48:55.290 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.081+0000 7fa169400640 1 -- 172.21.15.62:0/3506394776 shutdown_connections 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.081+0000 7fa169400640 1 --2- 172.21.15.62:0/3506394776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa16410a300 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.081+0000 7fa169400640 1 -- 172.21.15.62:0/3506394776 >> 172.21.15.62:0/3506394776 conn(0x7fa164101ab0 msgr2=0x7fa164103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.081+0000 7fa169400640 1 -- 172.21.15.62:0/3506394776 shutdown_connections 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.081+0000 7fa169400640 1 -- 172.21.15.62:0/3506394776 wait complete. 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.082+0000 7fa169400640 1 Processor -- start 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.082+0000 7fa169400640 1 -- start start 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.082+0000 7fa169400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa164107790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.082+0000 7fa169400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa16410b7c0 con 0x7fa164107f10 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.083+0000 7fa163e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa164107790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.083+0000 7fa163e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa164107790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46492/0 (socket says 172.21.15.62:46492) 2024-09-12T01:48:55.291 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.083+0000 7fa163e00640 1 -- 172.21.15.62:0/420145298 learned_addr learned my addr 172.21.15.62:0/420145298 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.083+0000 7fa163e00640 1 -- 172.21.15.62:0/420145298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa164107cd0 con 0x7fa164107f10 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.083+0000 7fa163e00640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa164107790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa1540097f0 tx=0x7fa154030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.084+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa154037040 con 0x7fa164107f10 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.084+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa154040070 con 0x7fa164107f10 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.084+0000 7fa169400640 1 -- 172.21.15.62:0/420145298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa164105ec0 con 0x7fa164107f10 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.084+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa15403a390 con 0x7fa164107f10 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.084+0000 7fa169400640 1 -- 172.21.15.62:0/420145298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1641063a0 con 0x7fa164107f10 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.085+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fa15403b430 con 0x7fa164107f10 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.086+0000 7fa161600640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 0x7fa14803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.086+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 --> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa14803bb40 con 0x7fa148038f70 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.086+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa15406c140 con 0x7fa164107f10 2024-09-12T01:48:55.292 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.086+0000 7fa15be00640 1 -- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 msgr2=0x7fa14803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2854042842 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.086+0000 7fa15be00640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 0x7fa14803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.287+0000 7fa15be00640 1 -- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 msgr2=0x7fa14803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2854042842 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.287+0000 7fa15be00640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 0x7fa14803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.687+0000 7fa15be00640 1 -- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 msgr2=0x7fa14803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2854042842 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:50.687+0000 7fa15be00640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 0x7fa14803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:51.488+0000 7fa15be00640 1 -- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 msgr2=0x7fa14803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2854042842 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:51.488+0000 7fa15be00640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 0x7fa14803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:53.089+0000 7fa15be00640 1 -- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 msgr2=0x7fa14803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/2854042842 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:53.090+0000 7fa15be00640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 0x7fa14803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:53.661+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fa154032900 con 0x7fa164107f10 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:53.661+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 msgr2=0x7fa14803b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:48:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:53.661+0000 7fa161600640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 0x7fa14803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.663+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fa15406d550 con 0x7fa164107f10 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.663+0000 7fa161600640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa14803c8a0 0x7fa14803ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.663+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 --> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa1540655b0 con 0x7fa14803c8a0 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.664+0000 7fa15be00640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa14803c8a0 0x7fa14803ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.665+0000 7fa15be00640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa14803c8a0 0x7fa14803ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa14c003980 tx=0x7fa14c009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.666+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 <== mgr.14120 v2:172.21.15.62:6800/1515578586 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fa1540655b0 con 0x7fa14803c8a0 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.673+0000 7fa169400640 1 -- 172.21.15.62:0/420145298 --> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa164108370 con 0x7fa14803c8a0 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.673+0000 7fa161600640 1 -- 172.21.15.62:0/420145298 <== mgr.14120 v2:172.21.15.62:6800/1515578586 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fa164108370 con 0x7fa14803c8a0 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 -- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa14803c8a0 msgr2=0x7fa14803ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa14803c8a0 0x7fa14803ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa14c003980 tx=0x7fa14c009290 comp rx=0 tx=0).stop 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 -- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 msgr2=0x7fa164107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa164107790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa1540097f0 tx=0x7fa154030d80 comp rx=0 tx=0).stop 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 -- 172.21.15.62:0/420145298 shutdown_connections 2024-09-12T01:48:55.294 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa14803c8a0 0x7fa14803ec90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:55.295 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:6800/2854042842,v1:172.21.15.62:6801/2854042842] conn(0x7fa148038f70 0x7fa14803b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:55.295 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 --2- 172.21.15.62:0/420145298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa164107f10 0x7fa164107790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:55.295 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 -- 172.21.15.62:0/420145298 >> 172.21.15.62:0/420145298 conn(0x7fa164101ab0 msgr2=0x7fa164102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:55.295 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 -- 172.21.15.62:0/420145298 shutdown_connections 2024-09-12T01:48:55.295 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:54.674+0000 7fa169400640 1 -- 172.21.15.62:0/420145298 wait complete. 2024-09-12T01:48:55.295 INFO:teuthology.orchestra.run.smithi062.stdout:mgr epoch 5 is available 2024-09-12T01:48:55.295 INFO:teuthology.orchestra.run.smithi062.stdout:Setting orchestrator backend to cephadm... 2024-09-12T01:48:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-mon[30666]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T01:48:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-mon[30666]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T01:48:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:48:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:48:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:48:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:56.663 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:56.572+0000 7f10da800640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:48:56] ENGINE Error in HTTPServer.serve 2024-09-12T01:48:56.663 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: Traceback (most recent call last): 2024-09-12T01:48:56.663 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:48:56.663 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self._connections.run(self.expiration_interval) 2024-09-12T01:48:56.663 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:48:56.663 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self._run(expiration_interval) 2024-09-12T01:48:56.663 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:48:56.664 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:48:56.664 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:48:56.664 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:48:56.664 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:48:56.664 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: s = self.context.wrap_socket( 2024-09-12T01:48:56.664 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:48:56.664 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: return self.sslsocket_class._create( 2024-09-12T01:48:56.664 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:48:56.664 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self.do_handshake() 2024-09-12T01:48:56.665 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:48:56.665 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self._sslobj.do_handshake() 2024-09-12T01:48:56.665 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:48:56.665 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:48:56.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.769+0000 7fe986200640 1 Processor -- start 2024-09-12T01:48:56.673 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.769+0000 7fe986200640 1 -- start start 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.770+0000 7fe986200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe980109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.770+0000 7fe986200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe98010a1e0 con 0x7fe980109810 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.770+0000 7fe97f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe980109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.770+0000 7fe97f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe980109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45006/0 (socket says 172.21.15.62:45006) 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.770+0000 7fe97f400640 1 -- 172.21.15.62:0/1244857797 learned_addr learned my addr 172.21.15.62:0/1244857797 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.770+0000 7fe97f400640 1 -- 172.21.15.62:0/1244857797 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98010a950 con 0x7fe980109810 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.771+0000 7fe97f400640 1 --2- 172.21.15.62:0/1244857797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe980109c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe970009820 tx=0x7fe97002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9e91d84878542b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.772+0000 7fe97e000640 1 -- 172.21.15.62:0/1244857797 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe970037070 con 0x7fe980109810 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.772+0000 7fe97e000640 1 -- 172.21.15.62:0/1244857797 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe970032900 con 0x7fe980109810 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.772+0000 7fe97e000640 1 -- 172.21.15.62:0/1244857797 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe970030850 con 0x7fe980109810 2024-09-12T01:48:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.772+0000 7fe986200640 1 -- 172.21.15.62:0/1244857797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 msgr2=0x7fe980109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.772+0000 7fe986200640 1 --2- 172.21.15.62:0/1244857797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe980109c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe970009820 tx=0x7fe97002a270 comp rx=0 tx=0).stop 2024-09-12T01:48:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.773+0000 7fe986200640 1 -- 172.21.15.62:0/1244857797 shutdown_connections 2024-09-12T01:48:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.773+0000 7fe986200640 1 --2- 172.21.15.62:0/1244857797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe980109c10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.773+0000 7fe986200640 1 -- 172.21.15.62:0/1244857797 >> 172.21.15.62:0/1244857797 conn(0x7fe98007ccf0 msgr2=0x7fe98007d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.773+0000 7fe986200640 1 -- 172.21.15.62:0/1244857797 shutdown_connections 2024-09-12T01:48:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.773+0000 7fe986200640 1 -- 172.21.15.62:0/1244857797 wait complete. 2024-09-12T01:48:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.774+0000 7fe986200640 1 Processor -- start 2024-09-12T01:48:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.774+0000 7fe986200640 1 -- start start 2024-09-12T01:48:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.774+0000 7fe986200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe98019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.774+0000 7fe986200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe98010dd00 con 0x7fe980109810 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.774+0000 7fe97f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe98019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.774+0000 7fe97f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe98019d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45008/0 (socket says 172.21.15.62:45008) 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.774+0000 7fe97f400640 1 -- 172.21.15.62:0/596943820 learned_addr learned my addr 172.21.15.62:0/596943820 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.775+0000 7fe97f400640 1 -- 172.21.15.62:0/596943820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98019dd10 con 0x7fe980109810 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.775+0000 7fe97f400640 1 --2- 172.21.15.62:0/596943820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe98019d7d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe970030460 tx=0x7fe970030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.775+0000 7fe977e00640 1 -- 172.21.15.62:0/596943820 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe970042070 con 0x7fe980109810 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.775+0000 7fe977e00640 1 -- 172.21.15.62:0/596943820 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe970032be0 con 0x7fe980109810 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.775+0000 7fe977e00640 1 -- 172.21.15.62:0/596943820 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe970037040 con 0x7fe980109810 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.775+0000 7fe986200640 1 -- 172.21.15.62:0/596943820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98019dfa0 con 0x7fe980109810 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.775+0000 7fe986200640 1 -- 172.21.15.62:0/596943820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9801a0c90 con 0x7fe980109810 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.776+0000 7fe977e00640 1 -- 172.21.15.62:0/596943820 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fe970045070 con 0x7fe980109810 2024-09-12T01:48:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.777+0000 7fe986200640 1 -- 172.21.15.62:0/596943820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe980109c10 con 0x7fe980109810 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.777+0000 7fe977e00640 1 --2- 172.21.15.62:0/596943820 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe964038eb0 0x7fe96403b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.777+0000 7fe977e00640 1 -- 172.21.15.62:0/596943820 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe97006bcd0 con 0x7fe980109810 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.777+0000 7fe97ea00640 1 --2- 172.21.15.62:0/596943820 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe964038eb0 0x7fe96403b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.778+0000 7fe97ea00640 1 --2- 172.21.15.62:0/596943820 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe964038eb0 0x7fe96403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0098c0 tx=0x7fe96c006db0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.783+0000 7fe977e00640 1 -- 172.21.15.62:0/596943820 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe970045360 con 0x7fe980109810 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.987+0000 7fe986200640 1 -- 172.21.15.62:0/596943820 --> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fe980107be0 con 0x7fe964038eb0 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.994+0000 7fe977e00640 1 -- 172.21.15.62:0/596943820 <== mgr.14120 v2:172.21.15.62:6800/1515578586 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe980107be0 con 0x7fe964038eb0 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.997+0000 7fe986200640 1 -- 172.21.15.62:0/596943820 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe964038eb0 msgr2=0x7fe96403b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.997+0000 7fe986200640 1 --2- 172.21.15.62:0/596943820 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe964038eb0 0x7fe96403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0098c0 tx=0x7fe96c006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.997+0000 7fe986200640 1 -- 172.21.15.62:0/596943820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 msgr2=0x7fe98019d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.997+0000 7fe986200640 1 --2- 172.21.15.62:0/596943820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe98019d7d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe970030460 tx=0x7fe970030d80 comp rx=0 tx=0).stop 2024-09-12T01:48:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.997+0000 7fe986200640 1 -- 172.21.15.62:0/596943820 shutdown_connections 2024-09-12T01:48:56.678 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.997+0000 7fe986200640 1 --2- 172.21.15.62:0/596943820 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe964038eb0 0x7fe96403b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.678 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.997+0000 7fe986200640 1 --2- 172.21.15.62:0/596943820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe980109810 0x7fe98019d7d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.678 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.997+0000 7fe986200640 1 -- 172.21.15.62:0/596943820 >> 172.21.15.62:0/596943820 conn(0x7fe98007ccf0 msgr2=0x7fe9801074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:56.678 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.997+0000 7fe986200640 1 -- 172.21.15.62:0/596943820 shutdown_connections 2024-09-12T01:48:56.678 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:55.997+0000 7fe986200640 1 -- 172.21.15.62:0/596943820 wait complete. 2024-09-12T01:48:57.336 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:57 smithi062 ceph-mon[30666]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:57.460 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:57 smithi062 ceph-mon[30666]: mgrmap e8: x(active, since 2s) 2024-09-12T01:48:57.460 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:57 smithi062 ceph-mon[30666]: [12/Sep/2024:01:48:56] ENGINE Bus STARTING 2024-09-12T01:48:57.460 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:57 smithi062 ceph-mon[30666]: [12/Sep/2024:01:48:56] ENGINE Serving on http://172.21.15.62:8765 2024-09-12T01:48:57.460 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:57 smithi062 ceph-mon[30666]: [12/Sep/2024:01:48:56] ENGINE Serving on https://172.21.15.62:7150 2024-09-12T01:48:57.461 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:57 smithi062 ceph-mon[30666]: [12/Sep/2024:01:48:56] ENGINE Bus STARTED 2024-09-12T01:48:57.461 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:57 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:57.461 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:57 smithi062 ceph-mon[30666]: [12/Sep/2024:01:48:56] ENGINE Error in HTTPServer.serve 2024-09-12T01:48:57.461 INFO:journalctl@ceph.mon.a.smithi062.stdout: Traceback (most recent call last): 2024-09-12T01:48:57.461 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:48:57.461 INFO:journalctl@ceph.mon.a.smithi062.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:48:57.461 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:48:57.461 INFO:journalctl@ceph.mon.a.smithi062.stdout: self._run(expiration_interval) 2024-09-12T01:48:57.461 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:48:57.461 INFO:journalctl@ceph.mon.a.smithi062.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: s = self.context.wrap_socket( 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: return self.sslsocket_class._create( 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: self.do_handshake() 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: self._sslobj.do_handshake() 2024-09-12T01:48:57.462 INFO:journalctl@ceph.mon.a.smithi062.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:48:57.945 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T01:48:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.131+0000 7f8313e00640 1 Processor -- start 2024-09-12T01:48:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.132+0000 7f8313e00640 1 -- start start 2024-09-12T01:48:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.132+0000 7f8313e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f8314109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.132+0000 7f8313e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f831410a1e0 con 0x7f8314109810 2024-09-12T01:48:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.132+0000 7f8312a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f8314109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.132+0000 7f8312a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f8314109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45012/0 (socket says 172.21.15.62:45012) 2024-09-12T01:48:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.132+0000 7f8312a00640 1 -- 172.21.15.62:0/2467666675 learned_addr learned my addr 172.21.15.62:0/2467666675 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.133+0000 7f8312a00640 1 -- 172.21.15.62:0/2467666675 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831410a730 con 0x7f8314109810 2024-09-12T01:48:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.134+0000 7f8312a00640 1 --2- 172.21.15.62:0/2467666675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f8314109c10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8304009820 tx=0x7f830402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1b71fcdf441cba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.134+0000 7f8312000640 1 -- 172.21.15.62:0/2467666675 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8304037070 con 0x7f8314109810 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.134+0000 7f8312000640 1 -- 172.21.15.62:0/2467666675 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8304032900 con 0x7f8314109810 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.134+0000 7f8312000640 1 -- 172.21.15.62:0/2467666675 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8304030850 con 0x7f8314109810 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.134+0000 7f8313e00640 1 -- 172.21.15.62:0/2467666675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 msgr2=0x7f8314109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.134+0000 7f8313e00640 1 --2- 172.21.15.62:0/2467666675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f8314109c10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8304009820 tx=0x7f830402a270 comp rx=0 tx=0).stop 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.134+0000 7f8313e00640 1 -- 172.21.15.62:0/2467666675 shutdown_connections 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.135+0000 7f8313e00640 1 --2- 172.21.15.62:0/2467666675 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f8314109c10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.135+0000 7f8313e00640 1 -- 172.21.15.62:0/2467666675 >> 172.21.15.62:0/2467666675 conn(0x7f831407cb00 msgr2=0x7f831407cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.135+0000 7f8313e00640 1 -- 172.21.15.62:0/2467666675 shutdown_connections 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.135+0000 7f8313e00640 1 -- 172.21.15.62:0/2467666675 wait complete. 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.136+0000 7f8313e00640 1 Processor -- start 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.136+0000 7f8313e00640 1 -- start start 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.136+0000 7f8313e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f831419d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:57.949 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.136+0000 7f8313e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f831410d9f0 con 0x7f8314109810 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.136+0000 7f8312a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f831419d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.136+0000 7f8312a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f831419d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45020/0 (socket says 172.21.15.62:45020) 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.136+0000 7f8312a00640 1 -- 172.21.15.62:0/1549759075 learned_addr learned my addr 172.21.15.62:0/1549759075 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.137+0000 7f8312a00640 1 -- 172.21.15.62:0/1549759075 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831419db10 con 0x7f8314109810 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.137+0000 7f8312a00640 1 --2- 172.21.15.62:0/1549759075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f831419d5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f83040097f0 tx=0x7f8304030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.137+0000 7f830b400640 1 -- 172.21.15.62:0/1549759075 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8304042070 con 0x7f8314109810 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.137+0000 7f830b400640 1 -- 172.21.15.62:0/1549759075 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8304032ca0 con 0x7f8314109810 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.137+0000 7f8313e00640 1 -- 172.21.15.62:0/1549759075 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831419dda0 con 0x7f8314109810 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.137+0000 7f830b400640 1 -- 172.21.15.62:0/1549759075 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8304037040 con 0x7f8314109810 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.137+0000 7f8313e00640 1 -- 172.21.15.62:0/1549759075 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83141a0a90 con 0x7f8314109810 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.139+0000 7f830b400640 1 -- 172.21.15.62:0/1549759075 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8304045070 con 0x7f8314109810 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.139+0000 7f8313e00640 1 -- 172.21.15.62:0/1549759075 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8314109c90 con 0x7f8314109810 2024-09-12T01:48:57.950 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.139+0000 7f830b400640 1 --2- 172.21.15.62:0/1549759075 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f82f8038fc0 0x7f82f803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.139+0000 7f830b400640 1 -- 172.21.15.62:0/1549759075 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f830406bff0 con 0x7f8314109810 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.139+0000 7f830be00640 1 --2- 172.21.15.62:0/1549759075 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f82f8038fc0 0x7f82f803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.140+0000 7f830be00640 1 --2- 172.21.15.62:0/1549759075 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f82f8038fc0 0x7f82f803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0098c0 tx=0x7f82fc006db0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.144+0000 7f830b400640 1 -- 172.21.15.62:0/1549759075 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f830406b940 con 0x7f8314109810 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.335+0000 7f8313e00640 1 -- 172.21.15.62:0/1549759075 --> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f8314107c40 con 0x7f82f8038fc0 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.335+0000 7f830b400640 1 -- 172.21.15.62:0/1549759075 <== mgr.14120 v2:172.21.15.62:6800/1515578586 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f8314107c40 con 0x7f82f8038fc0 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.338+0000 7f8313e00640 1 -- 172.21.15.62:0/1549759075 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f82f8038fc0 msgr2=0x7f82f803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.339+0000 7f8313e00640 1 --2- 172.21.15.62:0/1549759075 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f82f8038fc0 0x7f82f803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0098c0 tx=0x7f82fc006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.339+0000 7f8313e00640 1 -- 172.21.15.62:0/1549759075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 msgr2=0x7f831419d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.339+0000 7f8313e00640 1 --2- 172.21.15.62:0/1549759075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f831419d5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f83040097f0 tx=0x7f8304030ec0 comp rx=0 tx=0).stop 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.339+0000 7f8313e00640 1 -- 172.21.15.62:0/1549759075 shutdown_connections 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.339+0000 7f8313e00640 1 --2- 172.21.15.62:0/1549759075 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f82f8038fc0 0x7f82f803b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:57.951 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.339+0000 7f8313e00640 1 --2- 172.21.15.62:0/1549759075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8314109810 0x7f831419d5d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:57.952 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.339+0000 7f8313e00640 1 -- 172.21.15.62:0/1549759075 >> 172.21.15.62:0/1549759075 conn(0x7f831407cb00 msgr2=0x7f8314107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:57.952 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.339+0000 7f8313e00640 1 -- 172.21.15.62:0/1549759075 shutdown_connections 2024-09-12T01:48:57.952 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:57.339+0000 7f8313e00640 1 -- 172.21.15.62:0/1549759075 wait complete. 2024-09-12T01:48:57.952 INFO:teuthology.orchestra.run.smithi062.stdout:Generating ssh key... 2024-09-12T01:48:58.210 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-mon[30666]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:59.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:59 smithi062 ceph-mon[30666]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:59.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:59 smithi062 ceph-mon[30666]: Generating ssh key... 2024-09-12T01:48:59.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:59 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:48:59.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:48:59 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:48:59.226 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: Generating public/private rsa key pair. 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: Your identification has been saved in /tmp/tmp1fcsm0z4/key 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: Your public key has been saved in /tmp/tmp1fcsm0z4/key.pub 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: The key fingerprint is: 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: SHA256:1GaIIJXVip0e3ywgYiVHdYd6gXwwaWLcDy0tjrYdbJ0 ceph-f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: The key's randomart image is: 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: +---[RSA 3072]----+ 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: | .++*=B... | 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: | ..B.X+B+ | 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: | = O.@oo+ | 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: | o = %.Eo | 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: | . o * *So | 2024-09-12T01:48:59.227 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: | . o o o | 2024-09-12T01:48:59.228 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: | . | 2024-09-12T01:48:59.228 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: | | 2024-09-12T01:48:59.228 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: | | 2024-09-12T01:48:59.228 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:48:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: +----[SHA256]-----+ 2024-09-12T01:48:59.529 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.455+0000 7fe229c00640 1 Processor -- start 2024-09-12T01:48:59.529 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.455+0000 7fe229c00640 1 -- start start 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.455+0000 7fe229c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe224107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.456+0000 7fe229c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe224107f00 con 0x7fe224107530 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.456+0000 7fe222a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe224107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.456+0000 7fe222a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe224107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45028/0 (socket says 172.21.15.62:45028) 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.456+0000 7fe222a00640 1 -- 172.21.15.62:0/4154609530 learned_addr learned my addr 172.21.15.62:0/4154609530 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.456+0000 7fe222a00640 1 -- 172.21.15.62:0/4154609530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe224108730 con 0x7fe224107530 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.457+0000 7fe222a00640 1 --2- 172.21.15.62:0/4154609530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe224107930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe214009820 tx=0x7fe21402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e81e16be7e62039 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.457+0000 7fe222000640 1 -- 172.21.15.62:0/4154609530 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe214037070 con 0x7fe224107530 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.458+0000 7fe222000640 1 -- 172.21.15.62:0/4154609530 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe214032900 con 0x7fe224107530 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.458+0000 7fe222000640 1 -- 172.21.15.62:0/4154609530 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe214030850 con 0x7fe224107530 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.458+0000 7fe229c00640 1 -- 172.21.15.62:0/4154609530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 msgr2=0x7fe224107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:59.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.458+0000 7fe229c00640 1 --2- 172.21.15.62:0/4154609530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe224107930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe214009820 tx=0x7fe21402a270 comp rx=0 tx=0).stop 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.458+0000 7fe229c00640 1 -- 172.21.15.62:0/4154609530 shutdown_connections 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.458+0000 7fe229c00640 1 --2- 172.21.15.62:0/4154609530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe224107930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.458+0000 7fe229c00640 1 -- 172.21.15.62:0/4154609530 >> 172.21.15.62:0/4154609530 conn(0x7fe224102cc0 msgr2=0x7fe224105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.458+0000 7fe229c00640 1 -- 172.21.15.62:0/4154609530 shutdown_connections 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.458+0000 7fe229c00640 1 -- 172.21.15.62:0/4154609530 wait complete. 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.459+0000 7fe229c00640 1 Processor -- start 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.459+0000 7fe229c00640 1 -- start start 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.460+0000 7fe229c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe22407db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.460+0000 7fe229c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe22410bae0 con 0x7fe224107530 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.460+0000 7fe222a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe22407db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.460+0000 7fe222a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe22407db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45038/0 (socket says 172.21.15.62:45038) 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.460+0000 7fe222a00640 1 -- 172.21.15.62:0/426376489 learned_addr learned my addr 172.21.15.62:0/426376489 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:48:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.460+0000 7fe222a00640 1 -- 172.21.15.62:0/426376489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22407e050 con 0x7fe224107530 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.461+0000 7fe222a00640 1 --2- 172.21.15.62:0/426376489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe22407db10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe2140097f0 tx=0x7fe214030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.461+0000 7fe21b400640 1 -- 172.21.15.62:0/426376489 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe214037040 con 0x7fe224107530 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.461+0000 7fe21b400640 1 -- 172.21.15.62:0/426376489 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe214040070 con 0x7fe224107530 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.461+0000 7fe21b400640 1 -- 172.21.15.62:0/426376489 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe21403a390 con 0x7fe224107530 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.461+0000 7fe229c00640 1 -- 172.21.15.62:0/426376489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22407c240 con 0x7fe224107530 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.461+0000 7fe229c00640 1 -- 172.21.15.62:0/426376489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22407c720 con 0x7fe224107530 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.462+0000 7fe21b400640 1 -- 172.21.15.62:0/426376489 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe21403b430 con 0x7fe224107530 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.462+0000 7fe229c00640 1 -- 172.21.15.62:0/426376489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2241079b0 con 0x7fe224107530 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.463+0000 7fe21b400640 1 --2- 172.21.15.62:0/426376489 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe208038fc0 0x7fe20803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.463+0000 7fe21b400640 1 -- 172.21.15.62:0/426376489 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe21406c4d0 con 0x7fe224107530 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.463+0000 7fe21be00640 1 --2- 172.21.15.62:0/426376489 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe208038fc0 0x7fe20803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.464+0000 7fe21be00640 1 --2- 172.21.15.62:0/426376489 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe208038fc0 0x7fe20803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0098c0 tx=0x7fe20c006db0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.468+0000 7fe21b400640 1 -- 172.21.15.62:0/426376489 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe2140371e0 con 0x7fe224107530 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.654+0000 7fe229c00640 1 -- 172.21.15.62:0/426376489 --> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fe224104000 con 0x7fe208038fc0 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.897+0000 7fe21b400640 1 -- 172.21.15.62:0/426376489 <== mgr.14120 v2:172.21.15.62:6800/1515578586 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe224104000 con 0x7fe208038fc0 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.900+0000 7fe229c00640 1 -- 172.21.15.62:0/426376489 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe208038fc0 msgr2=0x7fe20803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.900+0000 7fe229c00640 1 --2- 172.21.15.62:0/426376489 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe208038fc0 0x7fe20803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0098c0 tx=0x7fe20c006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.900+0000 7fe229c00640 1 -- 172.21.15.62:0/426376489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 msgr2=0x7fe22407db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.900+0000 7fe229c00640 1 --2- 172.21.15.62:0/426376489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe22407db10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe2140097f0 tx=0x7fe214030d80 comp rx=0 tx=0).stop 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.900+0000 7fe229c00640 1 -- 172.21.15.62:0/426376489 shutdown_connections 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.900+0000 7fe229c00640 1 --2- 172.21.15.62:0/426376489 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fe208038fc0 0x7fe20803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.900+0000 7fe229c00640 1 --2- 172.21.15.62:0/426376489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe224107530 0x7fe22407db10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.900+0000 7fe229c00640 1 -- 172.21.15.62:0/426376489 >> 172.21.15.62:0/426376489 conn(0x7fe224102cc0 msgr2=0x7fe2241038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.900+0000 7fe229c00640 1 -- 172.21.15.62:0/426376489 shutdown_connections 2024-09-12T01:48:59.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:58.900+0000 7fe229c00640 1 -- 172.21.15.62:0/426376489 wait complete. 2024-09-12T01:49:00.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:00 smithi062 ceph-mon[30666]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcdAegYgT5fjdv3h4TUlbrW8DRxwDLZlljgZPitutIhJr1dwNSl+VVxGHevZpFtkzqy7Jn83cRjbce+nWQkPTkA0FzGBLT1cDgwMkFV78tvjBkjaid13kBkEsqk8oXKyesxTXp+FZXUJFbuyIJ5v3NxG7OLJmZijtAM5WsEHEcXgoQi5BtWh3uqH3CPCYzfRZll6ldzPtFh+zH9OFO2cGMVJn3KUNYralB+FcDgGfmhHM8r5vQGgzPXUoSWI17XSVSJrJ3WRiikMXxIF8Goel6QFmDKUCkapOjUwr36fF6STF7/kVfCdUtK2626g6bQkS1QsCkefn2XCtkNfyplGfrKhkSUpOnq9UM0i3yQlbdC+jCo9De0vgSSN+3jeBua59NYYspBe46dWLC6Ucx8MlHeu0ko7/b/sUQ/9y1TYw7Hh6ZIdFPeoFb02l0DVE9dLJM9jF8Uzwxqyy05akJlYJtyNx2sGLshgTiGOTSloivUQwdv19WopD2fpLk5+RCVls= ceph-f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:49:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.010+0000 7f3f91400640 1 Processor -- start 2024-09-12T01:49:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.010+0000 7f3f91400640 1 -- start start 2024-09-12T01:49:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.011+0000 7f3f91400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.011+0000 7f3f91400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c10a1e0 con 0x7f3f8c109810 2024-09-12T01:49:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.011+0000 7f3f8a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.011+0000 7f3f8a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45046/0 (socket says 172.21.15.62:45046) 2024-09-12T01:49:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.011+0000 7f3f8a800640 1 -- 172.21.15.62:0/4116145604 learned_addr learned my addr 172.21.15.62:0/4116145604 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.012+0000 7f3f8a800640 1 -- 172.21.15.62:0/4116145604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c10a950 con 0x7f3f8c109810 2024-09-12T01:49:00.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.013+0000 7f3f8a800640 1 --2- 172.21.15.62:0/4116145604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c109c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009820 tx=0x7f3f7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf84f3d565378ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.013+0000 7f3f89e00640 1 -- 172.21.15.62:0/4116145604 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f7c037070 con 0x7f3f8c109810 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.013+0000 7f3f89e00640 1 -- 172.21.15.62:0/4116145604 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f7c032900 con 0x7f3f8c109810 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.013+0000 7f3f89e00640 1 -- 172.21.15.62:0/4116145604 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f7c030850 con 0x7f3f8c109810 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.013+0000 7f3f91400640 1 -- 172.21.15.62:0/4116145604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 msgr2=0x7f3f8c109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.013+0000 7f3f91400640 1 --2- 172.21.15.62:0/4116145604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c109c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009820 tx=0x7f3f7c02a270 comp rx=0 tx=0).stop 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.014+0000 7f3f91400640 1 -- 172.21.15.62:0/4116145604 shutdown_connections 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.014+0000 7f3f91400640 1 --2- 172.21.15.62:0/4116145604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c109c10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.014+0000 7f3f91400640 1 -- 172.21.15.62:0/4116145604 >> 172.21.15.62:0/4116145604 conn(0x7f3f8c07ccf0 msgr2=0x7f3f8c07d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.014+0000 7f3f91400640 1 -- 172.21.15.62:0/4116145604 shutdown_connections 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.014+0000 7f3f91400640 1 -- 172.21.15.62:0/4116145604 wait complete. 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.015+0000 7f3f91400640 1 Processor -- start 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.015+0000 7f3f91400640 1 -- start start 2024-09-12T01:49:00.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.015+0000 7f3f91400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.015+0000 7f3f91400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c10dd00 con 0x7f3f8c109810 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.015+0000 7f3f8a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.015+0000 7f3f8a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c19d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45054/0 (socket says 172.21.15.62:45054) 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.015+0000 7f3f8a800640 1 -- 172.21.15.62:0/525759365 learned_addr learned my addr 172.21.15.62:0/525759365 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.016+0000 7f3f8a800640 1 -- 172.21.15.62:0/525759365 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c19dd10 con 0x7f3f8c109810 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.016+0000 7f3f8a800640 1 --2- 172.21.15.62:0/525759365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c19d7d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c030460 tx=0x7f3f7c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.016+0000 7f3f83e00640 1 -- 172.21.15.62:0/525759365 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f7c042070 con 0x7f3f8c109810 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.016+0000 7f3f83e00640 1 -- 172.21.15.62:0/525759365 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f7c032be0 con 0x7f3f8c109810 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.016+0000 7f3f83e00640 1 -- 172.21.15.62:0/525759365 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f7c037040 con 0x7f3f8c109810 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.016+0000 7f3f91400640 1 -- 172.21.15.62:0/525759365 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8c19dfa0 con 0x7f3f8c109810 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.016+0000 7f3f91400640 1 -- 172.21.15.62:0/525759365 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f8c1a0c90 con 0x7f3f8c109810 2024-09-12T01:49:00.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.017+0000 7f3f83e00640 1 -- 172.21.15.62:0/525759365 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3f7c045070 con 0x7f3f8c109810 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.017+0000 7f3f91400640 1 -- 172.21.15.62:0/525759365 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8c109c10 con 0x7f3f8c109810 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.018+0000 7f3f83e00640 1 --2- 172.21.15.62:0/525759365 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f3f70038fc0 0x7f3f7003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.018+0000 7f3f83e00640 1 -- 172.21.15.62:0/525759365 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3f7c06bed0 con 0x7f3f8c109810 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.018+0000 7f3f81e00640 1 --2- 172.21.15.62:0/525759365 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f3f70038fc0 0x7f3f7003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.019+0000 7f3f81e00640 1 --2- 172.21.15.62:0/525759365 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f3f70038fc0 0x7f3f7003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3f740098c0 tx=0x7f3f74006db0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.023+0000 7f3f83e00640 1 -- 172.21.15.62:0/525759365 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f7c045360 con 0x7f3f8c109810 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.208+0000 7f3f91400640 1 -- 172.21.15.62:0/525759365 --> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f3f8c107be0 con 0x7f3f70038fc0 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.209+0000 7f3f83e00640 1 -- 172.21.15.62:0/525759365 <== mgr.14120 v2:172.21.15.62:6800/1515578586 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f3f8c107be0 con 0x7f3f70038fc0 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.211+0000 7f3f91400640 1 -- 172.21.15.62:0/525759365 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f3f70038fc0 msgr2=0x7f3f7003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.211+0000 7f3f91400640 1 --2- 172.21.15.62:0/525759365 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f3f70038fc0 0x7f3f7003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3f740098c0 tx=0x7f3f74006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.211+0000 7f3f91400640 1 -- 172.21.15.62:0/525759365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 msgr2=0x7f3f8c19d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.211+0000 7f3f91400640 1 --2- 172.21.15.62:0/525759365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c19d7d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c030460 tx=0x7f3f7c030d80 comp rx=0 tx=0).stop 2024-09-12T01:49:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.211+0000 7f3f91400640 1 -- 172.21.15.62:0/525759365 shutdown_connections 2024-09-12T01:49:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.211+0000 7f3f91400640 1 --2- 172.21.15.62:0/525759365 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f3f70038fc0 0x7f3f7003b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.211+0000 7f3f91400640 1 --2- 172.21.15.62:0/525759365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f8c109810 0x7f3f8c19d7d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.211+0000 7f3f91400640 1 -- 172.21.15.62:0/525759365 >> 172.21.15.62:0/525759365 conn(0x7f3f8c07ccf0 msgr2=0x7f3f8c1074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.211+0000 7f3f91400640 1 -- 172.21.15.62:0/525759365 shutdown_connections 2024-09-12T01:49:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:00.211+0000 7f3f91400640 1 -- 172.21.15.62:0/525759365 wait complete. 2024-09-12T01:49:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:49:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T01:49:00.869 INFO:teuthology.orchestra.run.smithi062.stdout:Adding host smithi062... 2024-09-12T01:49:01.802 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:01 smithi062 ceph-mon[30666]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi062", "addr": "172.21.15.62", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:04.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:03 smithi062 ceph-mon[30666]: Deploying cephadm binary to smithi062 2024-09-12T01:49:06.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Added host 'smithi062' with addr '172.21.15.62' 2024-09-12T01:49:06.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.336+0000 7f1b28c00640 1 Processor -- start 2024-09-12T01:49:06.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.336+0000 7f1b28c00640 1 -- start start 2024-09-12T01:49:06.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.336+0000 7f1b28c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b24109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:06.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.336+0000 7f1b28c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2410a1e0 con 0x7f1b24109810 2024-09-12T01:49:06.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.337+0000 7f1b21e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b24109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:06.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.337+0000 7f1b21e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b24109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45064/0 (socket says 172.21.15.62:45064) 2024-09-12T01:49:06.766 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.337+0000 7f1b21e00640 1 -- 172.21.15.62:0/426120926 learned_addr learned my addr 172.21.15.62:0/426120926 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.337+0000 7f1b21e00640 1 -- 172.21.15.62:0/426120926 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2410a950 con 0x7f1b24109810 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.338+0000 7f1b21e00640 1 --2- 172.21.15.62:0/426120926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b24109c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009820 tx=0x7f1b1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570109c8ae500ef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.339+0000 7f1b20a00640 1 -- 172.21.15.62:0/426120926 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b14037070 con 0x7f1b24109810 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.339+0000 7f1b20a00640 1 -- 172.21.15.62:0/426120926 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b14032900 con 0x7f1b24109810 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.339+0000 7f1b20a00640 1 -- 172.21.15.62:0/426120926 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b14030850 con 0x7f1b24109810 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.339+0000 7f1b28c00640 1 -- 172.21.15.62:0/426120926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 msgr2=0x7f1b24109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.339+0000 7f1b28c00640 1 --2- 172.21.15.62:0/426120926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b24109c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009820 tx=0x7f1b1402a270 comp rx=0 tx=0).stop 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.339+0000 7f1b28c00640 1 -- 172.21.15.62:0/426120926 shutdown_connections 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.339+0000 7f1b28c00640 1 --2- 172.21.15.62:0/426120926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b24109c10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.339+0000 7f1b28c00640 1 -- 172.21.15.62:0/426120926 >> 172.21.15.62:0/426120926 conn(0x7f1b2407ccf0 msgr2=0x7f1b2407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.339+0000 7f1b28c00640 1 -- 172.21.15.62:0/426120926 shutdown_connections 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.339+0000 7f1b28c00640 1 -- 172.21.15.62:0/426120926 wait complete. 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.340+0000 7f1b28c00640 1 Processor -- start 2024-09-12T01:49:06.767 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.340+0000 7f1b28c00640 1 -- start start 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.341+0000 7f1b28c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b2419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.341+0000 7f1b28c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2410dd00 con 0x7f1b24109810 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.341+0000 7f1b21e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b2419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.341+0000 7f1b21e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b2419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45078/0 (socket says 172.21.15.62:45078) 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.341+0000 7f1b21e00640 1 -- 172.21.15.62:0/3782592149 learned_addr learned my addr 172.21.15.62:0/3782592149 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.341+0000 7f1b21e00640 1 -- 172.21.15.62:0/3782592149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2419dd10 con 0x7f1b24109810 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.342+0000 7f1b21e00640 1 --2- 172.21.15.62:0/3782592149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b2419d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b14030460 tx=0x7f1b14030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.342+0000 7f1b1aa00640 1 -- 172.21.15.62:0/3782592149 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b14042070 con 0x7f1b24109810 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.342+0000 7f1b1aa00640 1 -- 172.21.15.62:0/3782592149 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b14032be0 con 0x7f1b24109810 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.342+0000 7f1b1aa00640 1 -- 172.21.15.62:0/3782592149 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b14037040 con 0x7f1b24109810 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.342+0000 7f1b28c00640 1 -- 172.21.15.62:0/3782592149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b2419dfa0 con 0x7f1b24109810 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.342+0000 7f1b28c00640 1 -- 172.21.15.62:0/3782592149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b241a0c90 con 0x7f1b24109810 2024-09-12T01:49:06.768 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.343+0000 7f1b1aa00640 1 -- 172.21.15.62:0/3782592149 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1b14045070 con 0x7f1b24109810 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.343+0000 7f1b28c00640 1 -- 172.21.15.62:0/3782592149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b24109c10 con 0x7f1b24109810 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.344+0000 7f1b1aa00640 1 --2- 172.21.15.62:0/3782592149 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f1b08038fc0 0x7f1b0803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.344+0000 7f1b1aa00640 1 -- 172.21.15.62:0/3782592149 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1b1406bed0 con 0x7f1b24109810 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.344+0000 7f1b21400640 1 --2- 172.21.15.62:0/3782592149 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f1b08038fc0 0x7f1b0803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.345+0000 7f1b21400640 1 --2- 172.21.15.62:0/3782592149 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f1b08038fc0 0x7f1b0803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1b100098c0 tx=0x7f1b10006db0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.349+0000 7f1b1aa00640 1 -- 172.21.15.62:0/3782592149 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b14045360 con 0x7f1b24109810 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:01.538+0000 7f1b28c00640 1 -- 172.21.15.62:0/3782592149 --> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi062", "addr": "172.21.15.62", "target": ["mon-mgr", ""]}) -- 0x7f1b24107be0 con 0x7f1b08038fc0 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.057+0000 7f1b1aa00640 1 -- 172.21.15.62:0/3782592149 <== mgr.14120 v2:172.21.15.62:6800/1515578586 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f1b24107be0 con 0x7f1b08038fc0 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.060+0000 7f1b28c00640 1 -- 172.21.15.62:0/3782592149 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f1b08038fc0 msgr2=0x7f1b0803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.060+0000 7f1b28c00640 1 --2- 172.21.15.62:0/3782592149 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f1b08038fc0 0x7f1b0803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1b100098c0 tx=0x7f1b10006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.060+0000 7f1b28c00640 1 -- 172.21.15.62:0/3782592149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 msgr2=0x7f1b2419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:06.769 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.060+0000 7f1b28c00640 1 --2- 172.21.15.62:0/3782592149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b2419d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b14030460 tx=0x7f1b14030d80 comp rx=0 tx=0).stop 2024-09-12T01:49:06.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.060+0000 7f1b28c00640 1 -- 172.21.15.62:0/3782592149 shutdown_connections 2024-09-12T01:49:06.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.060+0000 7f1b28c00640 1 --2- 172.21.15.62:0/3782592149 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f1b08038fc0 0x7f1b0803b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.060+0000 7f1b28c00640 1 --2- 172.21.15.62:0/3782592149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b24109810 0x7f1b2419d7d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.060+0000 7f1b28c00640 1 -- 172.21.15.62:0/3782592149 >> 172.21.15.62:0/3782592149 conn(0x7f1b2407ccf0 msgr2=0x7f1b241074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:06.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.060+0000 7f1b28c00640 1 -- 172.21.15.62:0/3782592149 shutdown_connections 2024-09-12T01:49:06.770 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:06.060+0000 7f1b28c00640 1 -- 172.21.15.62:0/3782592149 wait complete. 2024-09-12T01:49:06.770 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying unmanaged mon service... 2024-09-12T01:49:07.301 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:07 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:49:07.301 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:07 smithi062 ceph-mon[30666]: Added host smithi062 2024-09-12T01:49:07.301 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:07 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:08.459 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T01:49:08.459 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.300+0000 7eff9fe00640 1 Processor -- start 2024-09-12T01:49:08.459 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.300+0000 7eff9fe00640 1 -- start start 2024-09-12T01:49:08.459 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.300+0000 7eff9fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff98109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.300+0000 7eff9fe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7eff9810a1e0 con 0x7eff98109810 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.300+0000 7eff9d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff98109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.301+0000 7eff9d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff98109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56404/0 (socket says 172.21.15.62:56404) 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.301+0000 7eff9d400640 1 -- 172.21.15.62:0/2884157011 learned_addr learned my addr 172.21.15.62:0/2884157011 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.301+0000 7eff9d400640 1 -- 172.21.15.62:0/2884157011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9810a950 con 0x7eff98109810 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.302+0000 7eff9d400640 1 --2- 172.21.15.62:0/2884157011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff98109c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009e80 tx=0x7eff8c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b548c416a362f925 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.302+0000 7eff97e00640 1 -- 172.21.15.62:0/2884157011 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff8c036070 con 0x7eff98109810 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.302+0000 7eff97e00640 1 -- 172.21.15.62:0/2884157011 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7eff8c0318c0 con 0x7eff98109810 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.302+0000 7eff97e00640 1 -- 172.21.15.62:0/2884157011 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff8c007ab0 con 0x7eff98109810 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.303+0000 7eff9fe00640 1 -- 172.21.15.62:0/2884157011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 msgr2=0x7eff98109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.303+0000 7eff9fe00640 1 --2- 172.21.15.62:0/2884157011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff98109c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009e80 tx=0x7eff8c02a7a0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.460 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.303+0000 7eff9fe00640 1 -- 172.21.15.62:0/2884157011 shutdown_connections 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.303+0000 7eff9fe00640 1 --2- 172.21.15.62:0/2884157011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff98109c10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.303+0000 7eff9fe00640 1 -- 172.21.15.62:0/2884157011 >> 172.21.15.62:0/2884157011 conn(0x7eff9807ccf0 msgr2=0x7eff9807d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.303+0000 7eff9fe00640 1 -- 172.21.15.62:0/2884157011 shutdown_connections 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.303+0000 7eff9fe00640 1 -- 172.21.15.62:0/2884157011 wait complete. 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.304+0000 7eff9fe00640 1 Processor -- start 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.304+0000 7eff9fe00640 1 -- start start 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.304+0000 7eff9fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff9819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.304+0000 7eff9fe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7eff9810dd00 con 0x7eff98109810 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.305+0000 7eff9d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff9819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.305+0000 7eff9d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff9819d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56416/0 (socket says 172.21.15.62:56416) 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.305+0000 7eff9d400640 1 -- 172.21.15.62:0/4250395159 learned_addr learned my addr 172.21.15.62:0/4250395159 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.305+0000 7eff9d400640 1 -- 172.21.15.62:0/4250395159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9819dd10 con 0x7eff98109810 2024-09-12T01:49:08.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.305+0000 7eff9d400640 1 --2- 172.21.15.62:0/4250395159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff9819d7d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009e50 tx=0x7eff8c031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.306+0000 7eff96000640 1 -- 172.21.15.62:0/4250395159 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff8c036050 con 0x7eff98109810 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.306+0000 7eff96000640 1 -- 172.21.15.62:0/4250395159 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7eff8c042070 con 0x7eff98109810 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.306+0000 7eff9fe00640 1 -- 172.21.15.62:0/4250395159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9819dfa0 con 0x7eff98109810 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.306+0000 7eff96000640 1 -- 172.21.15.62:0/4250395159 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff8c03d8e0 con 0x7eff98109810 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.306+0000 7eff9fe00640 1 -- 172.21.15.62:0/4250395159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff981a0c90 con 0x7eff98109810 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.307+0000 7eff96000640 1 -- 172.21.15.62:0/4250395159 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7eff8c03dbe0 con 0x7eff98109810 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.307+0000 7eff9fe00640 1 -- 172.21.15.62:0/4250395159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff98109c10 con 0x7eff98109810 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.307+0000 7eff96000640 1 --2- 172.21.15.62:0/4250395159 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7eff80038f70 0x7eff8003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.307+0000 7eff96000640 1 -- 172.21.15.62:0/4250395159 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7eff8c06d390 con 0x7eff98109810 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.307+0000 7eff9ca00640 1 --2- 172.21.15.62:0/4250395159 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7eff80038f70 0x7eff8003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.308+0000 7eff9ca00640 1 --2- 172.21.15.62:0/4250395159 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7eff80038f70 0x7eff8003b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7eff840098c0 tx=0x7eff84006db0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.312+0000 7eff96000640 1 -- 172.21.15.62:0/4250395159 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff8c06cce0 con 0x7eff98109810 2024-09-12T01:49:08.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.575+0000 7eff9fe00640 1 -- 172.21.15.62:0/4250395159 --> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7eff98107be0 con 0x7eff80038f70 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.580+0000 7eff96000640 1 -- 172.21.15.62:0/4250395159 <== mgr.14120 v2:172.21.15.62:6800/1515578586 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7eff98107be0 con 0x7eff80038f70 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.582+0000 7eff9fe00640 1 -- 172.21.15.62:0/4250395159 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7eff80038f70 msgr2=0x7eff8003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.582+0000 7eff9fe00640 1 --2- 172.21.15.62:0/4250395159 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7eff80038f70 0x7eff8003b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7eff840098c0 tx=0x7eff84006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.582+0000 7eff9fe00640 1 -- 172.21.15.62:0/4250395159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 msgr2=0x7eff9819d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.582+0000 7eff9fe00640 1 --2- 172.21.15.62:0/4250395159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff9819d7d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009e50 tx=0x7eff8c031ca0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.582+0000 7eff9fe00640 1 -- 172.21.15.62:0/4250395159 shutdown_connections 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.582+0000 7eff9fe00640 1 --2- 172.21.15.62:0/4250395159 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7eff80038f70 0x7eff8003b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.582+0000 7eff9fe00640 1 --2- 172.21.15.62:0/4250395159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff98109810 0x7eff9819d7d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.582+0000 7eff9fe00640 1 -- 172.21.15.62:0/4250395159 >> 172.21.15.62:0/4250395159 conn(0x7eff9807ccf0 msgr2=0x7eff981074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.583+0000 7eff9fe00640 1 -- 172.21.15.62:0/4250395159 shutdown_connections 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:07.583+0000 7eff9fe00640 1 -- 172.21.15.62:0/4250395159 wait complete. 2024-09-12T01:49:08.463 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying unmanaged mgr service... 2024-09-12T01:49:08.706 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:08 smithi062 ceph-mon[30666]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:08.707 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:08 smithi062 ceph-mon[30666]: Saving service mon spec with placement count:5 2024-09-12T01:49:08.707 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:08 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:49:10.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T01:49:10.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.330+0000 7f6136600640 1 Processor -- start 2024-09-12T01:49:10.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.330+0000 7f6136600640 1 -- start start 2024-09-12T01:49:10.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.331+0000 7f6136600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f6130109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:10.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.331+0000 7f6136600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f613010a1e0 con 0x7f6130109810 2024-09-12T01:49:10.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.331+0000 7f612f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f6130109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:10.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.331+0000 7f612f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f6130109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56422/0 (socket says 172.21.15.62:56422) 2024-09-12T01:49:10.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.331+0000 7f612f400640 1 -- 172.21.15.62:0/3241654883 learned_addr learned my addr 172.21.15.62:0/3241654883 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:10.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.331+0000 7f612f400640 1 -- 172.21.15.62:0/3241654883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613010a950 con 0x7f6130109810 2024-09-12T01:49:10.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.332+0000 7f612f400640 1 --2- 172.21.15.62:0/3241654883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f6130109c10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6120009e80 tx=0x7f612002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ac3f5c40390735 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.333+0000 7f612ea00640 1 -- 172.21.15.62:0/3241654883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6120036070 con 0x7f6130109810 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.333+0000 7f612ea00640 1 -- 172.21.15.62:0/3241654883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f61200318c0 con 0x7f6130109810 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.333+0000 7f612ea00640 1 -- 172.21.15.62:0/3241654883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6120007ab0 con 0x7f6130109810 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.333+0000 7f6136600640 1 -- 172.21.15.62:0/3241654883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 msgr2=0x7f6130109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.333+0000 7f6136600640 1 --2- 172.21.15.62:0/3241654883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f6130109c10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6120009e80 tx=0x7f612002a7a0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.333+0000 7f6136600640 1 -- 172.21.15.62:0/3241654883 shutdown_connections 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.333+0000 7f6136600640 1 --2- 172.21.15.62:0/3241654883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f6130109c10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.333+0000 7f6136600640 1 -- 172.21.15.62:0/3241654883 >> 172.21.15.62:0/3241654883 conn(0x7f613007ccf0 msgr2=0x7f613007d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.333+0000 7f6136600640 1 -- 172.21.15.62:0/3241654883 shutdown_connections 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.333+0000 7f6136600640 1 -- 172.21.15.62:0/3241654883 wait complete. 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.334+0000 7f6136600640 1 Processor -- start 2024-09-12T01:49:10.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.335+0000 7f6136600640 1 -- start start 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.335+0000 7f6136600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f613019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.335+0000 7f6136600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f613010dd00 con 0x7f6130109810 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.335+0000 7f612f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f613019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.335+0000 7f612f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f613019d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56432/0 (socket says 172.21.15.62:56432) 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.335+0000 7f612f400640 1 -- 172.21.15.62:0/2105044884 learned_addr learned my addr 172.21.15.62:0/2105044884 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.335+0000 7f612f400640 1 -- 172.21.15.62:0/2105044884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613019dd10 con 0x7f6130109810 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.336+0000 7f612f400640 1 --2- 172.21.15.62:0/2105044884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f613019d7d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6120009e50 tx=0x7f6120031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.336+0000 7f612cc00640 1 -- 172.21.15.62:0/2105044884 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6120036050 con 0x7f6130109810 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.336+0000 7f612cc00640 1 -- 172.21.15.62:0/2105044884 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6120042070 con 0x7f6130109810 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.336+0000 7f612cc00640 1 -- 172.21.15.62:0/2105044884 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f612003d8e0 con 0x7f6130109810 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.336+0000 7f6136600640 1 -- 172.21.15.62:0/2105044884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613019dfa0 con 0x7f6130109810 2024-09-12T01:49:10.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.336+0000 7f6136600640 1 -- 172.21.15.62:0/2105044884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61301a0c90 con 0x7f6130109810 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.337+0000 7f612cc00640 1 -- 172.21.15.62:0/2105044884 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f612003b610 con 0x7f6130109810 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.337+0000 7f6136600640 1 -- 172.21.15.62:0/2105044884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6130109c10 con 0x7f6130109810 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.338+0000 7f612cc00640 1 --2- 172.21.15.62:0/2105044884 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f6114038fc0 0x7f611403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.338+0000 7f612cc00640 1 -- 172.21.15.62:0/2105044884 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f612006d330 con 0x7f6130109810 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.338+0000 7f6126a00640 1 --2- 172.21.15.62:0/2105044884 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f6114038fc0 0x7f611403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.339+0000 7f6126a00640 1 --2- 172.21.15.62:0/2105044884 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f6114038fc0 0x7f611403b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61180098c0 tx=0x7f6118006db0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.343+0000 7f612cc00640 1 -- 172.21.15.62:0/2105044884 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6120042220 con 0x7f6130109810 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.541+0000 7f6136600640 1 -- 172.21.15.62:0/2105044884 --> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f6130107be0 con 0x7f6114038fc0 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.546+0000 7f612cc00640 1 -- 172.21.15.62:0/2105044884 <== mgr.14120 v2:172.21.15.62:6800/1515578586 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6130107be0 con 0x7f6114038fc0 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.549+0000 7f6136600640 1 -- 172.21.15.62:0/2105044884 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f6114038fc0 msgr2=0x7f611403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.549+0000 7f6136600640 1 --2- 172.21.15.62:0/2105044884 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f6114038fc0 0x7f611403b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61180098c0 tx=0x7f6118006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.549+0000 7f6136600640 1 -- 172.21.15.62:0/2105044884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 msgr2=0x7f613019d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:10.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.549+0000 7f6136600640 1 --2- 172.21.15.62:0/2105044884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f613019d7d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6120009e50 tx=0x7f6120031ca0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.549+0000 7f6136600640 1 -- 172.21.15.62:0/2105044884 shutdown_connections 2024-09-12T01:49:10.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.549+0000 7f6136600640 1 --2- 172.21.15.62:0/2105044884 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f6114038fc0 0x7f611403b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.549+0000 7f6136600640 1 --2- 172.21.15.62:0/2105044884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6130109810 0x7f613019d7d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.549+0000 7f6136600640 1 -- 172.21.15.62:0/2105044884 >> 172.21.15.62:0/2105044884 conn(0x7f613007ccf0 msgr2=0x7f61301074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:10.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.549+0000 7f6136600640 1 -- 172.21.15.62:0/2105044884 shutdown_connections 2024-09-12T01:49:10.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:09.549+0000 7f6136600640 1 -- 172.21.15.62:0/2105044884 wait complete. 2024-09-12T01:49:10.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:10 smithi062 ceph-mon[30666]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:10.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:10 smithi062 ceph-mon[30666]: Saving service mgr spec with placement count:2 2024-09-12T01:49:10.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:10 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:49:10.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:10 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:49:12.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:11 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:49:12.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:11 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1554484222' entity='client.admin' 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.288+0000 7fb3bc000640 1 Processor -- start 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.288+0000 7fb3bc000640 1 -- start start 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.288+0000 7fb3bc000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b4109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.288+0000 7fb3bc000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b410a1e0 con 0x7fb3b4109810 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.289+0000 7fb3b9600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b4109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.289+0000 7fb3b9600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b4109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56448/0 (socket says 172.21.15.62:56448) 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.289+0000 7fb3b9600640 1 -- 172.21.15.62:0/1559679623 learned_addr learned my addr 172.21.15.62:0/1559679623 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.289+0000 7fb3b9600640 1 -- 172.21.15.62:0/1559679623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b410a950 con 0x7fb3b4109810 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.290+0000 7fb3b9600640 1 --2- 172.21.15.62:0/1559679623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b4109c10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009820 tx=0x7fb3a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f125cf868e2399df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.290+0000 7fb3b3e00640 1 -- 172.21.15.62:0/1559679623 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3a8037070 con 0x7fb3b4109810 2024-09-12T01:49:12.126 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.290+0000 7fb3b3e00640 1 -- 172.21.15.62:0/1559679623 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3a8032920 con 0x7fb3b4109810 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.290+0000 7fb3b3e00640 1 -- 172.21.15.62:0/1559679623 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3a8030810 con 0x7fb3b4109810 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.291+0000 7fb3bc000640 1 -- 172.21.15.62:0/1559679623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 msgr2=0x7fb3b4109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.291+0000 7fb3bc000640 1 --2- 172.21.15.62:0/1559679623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b4109c10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009820 tx=0x7fb3a802a270 comp rx=0 tx=0).stop 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.291+0000 7fb3bc000640 1 -- 172.21.15.62:0/1559679623 shutdown_connections 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.291+0000 7fb3bc000640 1 --2- 172.21.15.62:0/1559679623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b4109c10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.291+0000 7fb3bc000640 1 -- 172.21.15.62:0/1559679623 >> 172.21.15.62:0/1559679623 conn(0x7fb3b407ccf0 msgr2=0x7fb3b407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.291+0000 7fb3bc000640 1 -- 172.21.15.62:0/1559679623 shutdown_connections 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.291+0000 7fb3bc000640 1 -- 172.21.15.62:0/1559679623 wait complete. 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.292+0000 7fb3bc000640 1 Processor -- start 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.292+0000 7fb3bc000640 1 -- start start 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.292+0000 7fb3bc000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.292+0000 7fb3bc000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b410dd00 con 0x7fb3b4109810 2024-09-12T01:49:12.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.293+0000 7fb3b9600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.293+0000 7fb3b9600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b419d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56458/0 (socket says 172.21.15.62:56458) 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.293+0000 7fb3b9600640 1 -- 172.21.15.62:0/1554484222 learned_addr learned my addr 172.21.15.62:0/1554484222 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.293+0000 7fb3b9600640 1 -- 172.21.15.62:0/1554484222 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b419dcf0 con 0x7fb3b4109810 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.293+0000 7fb3b9600640 1 --2- 172.21.15.62:0/1554484222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b419d7b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80097f0 tx=0x7fb3a80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.294+0000 7fb3b2000640 1 -- 172.21.15.62:0/1554484222 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3a8037040 con 0x7fb3b4109810 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.294+0000 7fb3b2000640 1 -- 172.21.15.62:0/1554484222 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3a8030c40 con 0x7fb3b4109810 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.294+0000 7fb3bc000640 1 -- 172.21.15.62:0/1554484222 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b419df80 con 0x7fb3b4109810 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.294+0000 7fb3b2000640 1 -- 172.21.15.62:0/1554484222 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3a803a5d0 con 0x7fb3b4109810 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.294+0000 7fb3bc000640 1 -- 172.21.15.62:0/1554484222 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b41a0c70 con 0x7fb3b4109810 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.295+0000 7fb3b2000640 1 -- 172.21.15.62:0/1554484222 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb3a803b3f0 con 0x7fb3b4109810 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.295+0000 7fb3bc000640 1 -- 172.21.15.62:0/1554484222 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b4109c90 con 0x7fb3b4109810 2024-09-12T01:49:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.295+0000 7fb3b2000640 1 --2- 172.21.15.62:0/1554484222 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fb39c038f70 0x7fb39c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.295+0000 7fb3b2000640 1 -- 172.21.15.62:0/1554484222 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb3a806c530 con 0x7fb3b4109810 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.296+0000 7fb3b8c00640 1 --2- 172.21.15.62:0/1554484222 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fb39c038f70 0x7fb39c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.296+0000 7fb3b8c00640 1 --2- 172.21.15.62:0/1554484222 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fb39c038f70 0x7fb39c03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00098c0 tx=0x7fb3a0006db0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.300+0000 7fb3b2000640 1 -- 172.21.15.62:0/1554484222 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3a806be80 con 0x7fb3b4109810 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.496+0000 7fb3bc000640 1 -- 172.21.15.62:0/1554484222 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fb3b41a1260 con 0x7fb3b4109810 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.499+0000 7fb3b2000640 1 -- 172.21.15.62:0/1554484222 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fb3a803b6e0 con 0x7fb3b4109810 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.502+0000 7fb3bc000640 1 -- 172.21.15.62:0/1554484222 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fb39c038f70 msgr2=0x7fb39c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.502+0000 7fb3bc000640 1 --2- 172.21.15.62:0/1554484222 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fb39c038f70 0x7fb39c03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00098c0 tx=0x7fb3a0006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.502+0000 7fb3bc000640 1 -- 172.21.15.62:0/1554484222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 msgr2=0x7fb3b419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.502+0000 7fb3bc000640 1 --2- 172.21.15.62:0/1554484222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b419d7b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80097f0 tx=0x7fb3a80327b0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.502+0000 7fb3bc000640 1 -- 172.21.15.62:0/1554484222 shutdown_connections 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.502+0000 7fb3bc000640 1 --2- 172.21.15.62:0/1554484222 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fb39c038f70 0x7fb39c03b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.129 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.502+0000 7fb3bc000640 1 --2- 172.21.15.62:0/1554484222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b4109810 0x7fb3b419d7b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.130 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.502+0000 7fb3bc000640 1 -- 172.21.15.62:0/1554484222 >> 172.21.15.62:0/1554484222 conn(0x7fb3b407ccf0 msgr2=0x7fb3b41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:12.130 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.502+0000 7fb3bc000640 1 -- 172.21.15.62:0/1554484222 shutdown_connections 2024-09-12T01:49:12.130 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:11.502+0000 7fb3bc000640 1 -- 172.21.15.62:0/1554484222 wait complete. 2024-09-12T01:49:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:13 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:49:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:13 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/167437686' entity='client.admin' 2024-09-12T01:49:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:13 smithi062 ceph-mon[30666]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:14.184 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.275+0000 7fbd6fe00640 1 Processor -- start 2024-09-12T01:49:14.184 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.276+0000 7fbd6fe00640 1 -- start start 2024-09-12T01:49:14.184 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.276+0000 7fbd6fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd70106080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:14.184 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.276+0000 7fbd6fe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbd700757b0 con 0x7fbd70105c80 2024-09-12T01:49:14.184 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.276+0000 7fbd6ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd70106080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:14.184 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.276+0000 7fbd6ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd70106080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56370/0 (socket says 172.21.15.62:56370) 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.276+0000 7fbd6ea00640 1 -- 172.21.15.62:0/2149355282 learned_addr learned my addr 172.21.15.62:0/2149355282 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.277+0000 7fbd6ea00640 1 -- 172.21.15.62:0/2149355282 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd701065c0 con 0x7fbd70105c80 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.278+0000 7fbd6ea00640 1 --2- 172.21.15.62:0/2149355282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd70106080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009820 tx=0x7fbd6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956ffa9effa033ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.278+0000 7fbd6e000640 1 -- 172.21.15.62:0/2149355282 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd60037070 con 0x7fbd70105c80 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.278+0000 7fbd6e000640 1 -- 172.21.15.62:0/2149355282 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd60032920 con 0x7fbd70105c80 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.278+0000 7fbd6e000640 1 -- 172.21.15.62:0/2149355282 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd60030810 con 0x7fbd70105c80 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.279+0000 7fbd6fe00640 1 -- 172.21.15.62:0/2149355282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 msgr2=0x7fbd70106080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.279+0000 7fbd6fe00640 1 --2- 172.21.15.62:0/2149355282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd70106080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009820 tx=0x7fbd6002a270 comp rx=0 tx=0).stop 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.279+0000 7fbd6fe00640 1 -- 172.21.15.62:0/2149355282 shutdown_connections 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.279+0000 7fbd6fe00640 1 --2- 172.21.15.62:0/2149355282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd70106080 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.185 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.279+0000 7fbd6fe00640 1 -- 172.21.15.62:0/2149355282 >> 172.21.15.62:0/2149355282 conn(0x7fbd70101ab0 msgr2=0x7fbd70103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.279+0000 7fbd6fe00640 1 -- 172.21.15.62:0/2149355282 shutdown_connections 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.279+0000 7fbd6fe00640 1 -- 172.21.15.62:0/2149355282 wait complete. 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.280+0000 7fbd6fe00640 1 Processor -- start 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.280+0000 7fbd6fe00640 1 -- start start 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.281+0000 7fbd6fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd7019d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.281+0000 7fbd6fe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbd70107700 con 0x7fbd70105c80 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.281+0000 7fbd6ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd7019d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.281+0000 7fbd6ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd7019d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56384/0 (socket says 172.21.15.62:56384) 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.281+0000 7fbd6ea00640 1 -- 172.21.15.62:0/167437686 learned_addr learned my addr 172.21.15.62:0/167437686 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.281+0000 7fbd6ea00640 1 -- 172.21.15.62:0/167437686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7019dac0 con 0x7fbd70105c80 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.282+0000 7fbd6ea00640 1 --2- 172.21.15.62:0/167437686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd7019d580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd600097f0 tx=0x7fbd600327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.282+0000 7fbd67400640 1 -- 172.21.15.62:0/167437686 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd60037040 con 0x7fbd70105c80 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.282+0000 7fbd67400640 1 -- 172.21.15.62:0/167437686 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd60030cc0 con 0x7fbd70105c80 2024-09-12T01:49:14.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.282+0000 7fbd6fe00640 1 -- 172.21.15.62:0/167437686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7019dd50 con 0x7fbd70105c80 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.282+0000 7fbd67400640 1 -- 172.21.15.62:0/167437686 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6003a6b0 con 0x7fbd70105c80 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.282+0000 7fbd6fe00640 1 -- 172.21.15.62:0/167437686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd701a0a40 con 0x7fbd70105c80 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.283+0000 7fbd67400640 1 -- 172.21.15.62:0/167437686 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fbd6003a8a0 con 0x7fbd70105c80 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.283+0000 7fbd6fe00640 1 -- 172.21.15.62:0/167437686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd70106080 con 0x7fbd70105c80 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.284+0000 7fbd67400640 1 --2- 172.21.15.62:0/167437686 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fbd54038f70 0x7fbd5403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.284+0000 7fbd67400640 1 -- 172.21.15.62:0/167437686 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbd6006c670 con 0x7fbd70105c80 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.284+0000 7fbd67e00640 1 --2- 172.21.15.62:0/167437686 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fbd54038f70 0x7fbd5403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.285+0000 7fbd67e00640 1 --2- 172.21.15.62:0/167437686 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fbd54038f70 0x7fbd5403b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbd580098c0 tx=0x7fbd58006db0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.289+0000 7fbd67400640 1 -- 172.21.15.62:0/167437686 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd6003b7b0 con 0x7fbd70105c80 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.476+0000 7fbd6fe00640 1 -- 172.21.15.62:0/167437686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fbd701969f0 con 0x7fbd70105c80 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.478+0000 7fbd67400640 1 -- 172.21.15.62:0/167437686 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fbd60044920 con 0x7fbd70105c80 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.481+0000 7fbd6fe00640 1 -- 172.21.15.62:0/167437686 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fbd54038f70 msgr2=0x7fbd5403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:14.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.481+0000 7fbd6fe00640 1 --2- 172.21.15.62:0/167437686 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fbd54038f70 0x7fbd5403b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbd580098c0 tx=0x7fbd58006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.481+0000 7fbd6fe00640 1 -- 172.21.15.62:0/167437686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 msgr2=0x7fbd7019d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:14.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.481+0000 7fbd6fe00640 1 --2- 172.21.15.62:0/167437686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd7019d580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd600097f0 tx=0x7fbd600327b0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.481+0000 7fbd6fe00640 1 -- 172.21.15.62:0/167437686 shutdown_connections 2024-09-12T01:49:14.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.481+0000 7fbd6fe00640 1 --2- 172.21.15.62:0/167437686 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fbd54038f70 0x7fbd5403b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.481+0000 7fbd6fe00640 1 --2- 172.21.15.62:0/167437686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd70105c80 0x7fbd7019d580 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.481+0000 7fbd6fe00640 1 -- 172.21.15.62:0/167437686 >> 172.21.15.62:0/167437686 conn(0x7fbd70101ab0 msgr2=0x7fbd701918e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:14.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.482+0000 7fbd6fe00640 1 -- 172.21.15.62:0/167437686 shutdown_connections 2024-09-12T01:49:14.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:13.482+0000 7fbd6fe00640 1 -- 172.21.15.62:0/167437686 wait complete. 2024-09-12T01:49:14.188 INFO:teuthology.orchestra.run.smithi062.stdout:Enabling the dashboard module... 2024-09-12T01:49:15.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:15 smithi062 ceph-mon[30666]: from='mgr.14120 172.21.15.62:0/2477054289' entity='mgr.x' 2024-09-12T01:49:15.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:15 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3141591252' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T01:49:15.529 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: ignoring --setuser ceph since I am not root 2024-09-12T01:49:15.529 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: ignoring --setgroup ceph since I am not root 2024-09-12T01:49:15.796 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:15.530+0000 7f1fc6230040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:49:15.796 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:15.603+0000 7f1fc6230040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:49:15.797 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:15.795+0000 7f1fc6230040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:49:16.064 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:15.878+0000 7f1fc6230040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:49:16.064 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:16.063+0000 7f1fc6230040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:49:16.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.735+0000 7f9609400640 1 Processor -- start 2024-09-12T01:49:16.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.735+0000 7f9609400640 1 -- start start 2024-09-12T01:49:16.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.735+0000 7f9609400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f9604109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:16.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.735+0000 7f9609400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f960410a1e0 con 0x7f9604109810 2024-09-12T01:49:16.167 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.736+0000 7f9602800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f9604109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.736+0000 7f9602800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f9604109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56400/0 (socket says 172.21.15.62:56400) 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.736+0000 7f9602800640 1 -- 172.21.15.62:0/3215865952 learned_addr learned my addr 172.21.15.62:0/3215865952 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.736+0000 7f9602800640 1 -- 172.21.15.62:0/3215865952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960410a950 con 0x7f9604109810 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.738+0000 7f9602800640 1 --2- 172.21.15.62:0/3215865952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f9604109c10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009820 tx=0x7f95f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd2780c9247242 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.738+0000 7f9601400640 1 -- 172.21.15.62:0/3215865952 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95f4037070 con 0x7f9604109810 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.738+0000 7f9601400640 1 -- 172.21.15.62:0/3215865952 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95f4032920 con 0x7f9604109810 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.738+0000 7f9601400640 1 -- 172.21.15.62:0/3215865952 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95f4030810 con 0x7f9604109810 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.739+0000 7f9609400640 1 -- 172.21.15.62:0/3215865952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 msgr2=0x7f9604109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.739+0000 7f9609400640 1 --2- 172.21.15.62:0/3215865952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f9604109c10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009820 tx=0x7f95f402a270 comp rx=0 tx=0).stop 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.739+0000 7f9609400640 1 -- 172.21.15.62:0/3215865952 shutdown_connections 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.739+0000 7f9609400640 1 --2- 172.21.15.62:0/3215865952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f9604109c10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.168 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.739+0000 7f9609400640 1 -- 172.21.15.62:0/3215865952 >> 172.21.15.62:0/3215865952 conn(0x7f960407ccf0 msgr2=0x7f960407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.739+0000 7f9609400640 1 -- 172.21.15.62:0/3215865952 shutdown_connections 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.739+0000 7f9609400640 1 -- 172.21.15.62:0/3215865952 wait complete. 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.740+0000 7f9609400640 1 Processor -- start 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.740+0000 7f9609400640 1 -- start start 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.740+0000 7f9609400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f960419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.741+0000 7f9609400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f960410dd00 con 0x7f9604109810 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.741+0000 7f9602800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f960419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.741+0000 7f9602800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f960419d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56406/0 (socket says 172.21.15.62:56406) 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.741+0000 7f9602800640 1 -- 172.21.15.62:0/3141591252 learned_addr learned my addr 172.21.15.62:0/3141591252 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.741+0000 7f9602800640 1 -- 172.21.15.62:0/3141591252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960419dcf0 con 0x7f9604109810 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.741+0000 7f9602800640 1 --2- 172.21.15.62:0/3141591252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f960419d7b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f95f40097f0 tx=0x7f95f40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:16.169 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.742+0000 7f95fb400640 1 -- 172.21.15.62:0/3141591252 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95f4037040 con 0x7f9604109810 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.742+0000 7f95fb400640 1 -- 172.21.15.62:0/3141591252 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95f4030c40 con 0x7f9604109810 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.742+0000 7f95fb400640 1 -- 172.21.15.62:0/3141591252 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95f403a5d0 con 0x7f9604109810 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.742+0000 7f9609400640 1 -- 172.21.15.62:0/3141591252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960419df80 con 0x7f9604109810 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.742+0000 7f9609400640 1 -- 172.21.15.62:0/3141591252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96041a0c70 con 0x7f9604109810 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.743+0000 7f9609400640 1 -- 172.21.15.62:0/3141591252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9604109c90 con 0x7f9604109810 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.744+0000 7f95fb400640 1 -- 172.21.15.62:0/3141591252 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f95f403b3f0 con 0x7f9604109810 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.744+0000 7f95fb400640 1 --2- 172.21.15.62:0/3141591252 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f95e8038fc0 0x7f95e803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.744+0000 7f95fb400640 1 -- 172.21.15.62:0/3141591252 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f95f406c4f0 con 0x7f9604109810 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.745+0000 7f9601e00640 1 --2- 172.21.15.62:0/3141591252 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f95e8038fc0 0x7f95e803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.745+0000 7f9601e00640 1 --2- 172.21.15.62:0/3141591252 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f95e8038fc0 0x7f95e803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f95f00098c0 tx=0x7f95f0006db0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:14.750+0000 7f95fb400640 1 -- 172.21.15.62:0/3141591252 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95f406be40 con 0x7f9604109810 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.003+0000 7f9609400640 1 -- 172.21.15.62:0/3141591252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f96041a0e40 con 0x7f9604109810 2024-09-12T01:49:16.170 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.281+0000 7f95fb400640 1 -- 172.21.15.62:0/3141591252 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f95f403b6e0 con 0x7f9604109810 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.283+0000 7f95fb400640 1 -- 172.21.15.62:0/3141591252 <== mon.0 v2:172.21.15.62:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f95f403a7c0 con 0x7f9604109810 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.285+0000 7f9609400640 1 -- 172.21.15.62:0/3141591252 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f95e8038fc0 msgr2=0x7f95e803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.285+0000 7f9609400640 1 --2- 172.21.15.62:0/3141591252 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f95e8038fc0 0x7f95e803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f95f00098c0 tx=0x7f95f0006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.285+0000 7f9609400640 1 -- 172.21.15.62:0/3141591252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 msgr2=0x7f960419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.285+0000 7f9609400640 1 --2- 172.21.15.62:0/3141591252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f960419d7b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f95f40097f0 tx=0x7f95f40327b0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.285+0000 7f9609400640 1 -- 172.21.15.62:0/3141591252 shutdown_connections 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.285+0000 7f9609400640 1 --2- 172.21.15.62:0/3141591252 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7f95e8038fc0 0x7f95e803b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.285+0000 7f9609400640 1 --2- 172.21.15.62:0/3141591252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9604109810 0x7f960419d7b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.285+0000 7f9609400640 1 -- 172.21.15.62:0/3141591252 >> 172.21.15.62:0/3141591252 conn(0x7f960407ccf0 msgr2=0x7f9604107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.285+0000 7f9609400640 1 -- 172.21.15.62:0/3141591252 shutdown_connections 2024-09-12T01:49:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:15.285+0000 7f9609400640 1 -- 172.21.15.62:0/3141591252 wait complete. 2024-09-12T01:49:16.327 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:16 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3141591252' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T01:49:16.328 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:16 smithi062 ceph-mon[30666]: mgrmap e9: x(active, since 21s) 2024-09-12T01:49:16.328 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:16.239+0000 7f1fc6230040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:49:16.861 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:16.633+0000 7f1fc6230040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:49:16.862 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:16.709+0000 7f1fc6230040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:49:17.199 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:16.953+0000 7f1fc6230040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:49:17.511 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:17 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3919442578' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:49:17.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:49:17.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T01:49:17.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:49:17.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T01:49:17.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:49:17.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.706+0000 7fa7d1e00640 1 Processor -- start 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.706+0000 7fa7d1e00640 1 -- start start 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.706+0000 7fa7d1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.706+0000 7fa7d1e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc10a1e0 con 0x7fa7cc109810 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.707+0000 7fa7caa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.707+0000 7fa7caa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56424/0 (socket says 172.21.15.62:56424) 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.707+0000 7fa7caa00640 1 -- 172.21.15.62:0/3846124967 learned_addr learned my addr 172.21.15.62:0/3846124967 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.707+0000 7fa7caa00640 1 -- 172.21.15.62:0/3846124967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc10a950 con 0x7fa7cc109810 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.708+0000 7fa7caa00640 1 --2- 172.21.15.62:0/3846124967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc109c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009820 tx=0x7fa7bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2cc8d7e5b94606 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.709+0000 7fa7c9600640 1 -- 172.21.15.62:0/3846124967 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7bc037070 con 0x7fa7cc109810 2024-09-12T01:49:17.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.709+0000 7fa7c9600640 1 -- 172.21.15.62:0/3846124967 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7bc032920 con 0x7fa7cc109810 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.709+0000 7fa7c9600640 1 -- 172.21.15.62:0/3846124967 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7bc030810 con 0x7fa7cc109810 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.709+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3846124967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 msgr2=0x7fa7cc109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.709+0000 7fa7d1e00640 1 --2- 172.21.15.62:0/3846124967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc109c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009820 tx=0x7fa7bc02a270 comp rx=0 tx=0).stop 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.709+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3846124967 shutdown_connections 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.709+0000 7fa7d1e00640 1 --2- 172.21.15.62:0/3846124967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc109c10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.709+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3846124967 >> 172.21.15.62:0/3846124967 conn(0x7fa7cc07ccf0 msgr2=0x7fa7cc07d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.710+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3846124967 shutdown_connections 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.710+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3846124967 wait complete. 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.710+0000 7fa7d1e00640 1 Processor -- start 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.711+0000 7fa7d1e00640 1 -- start start 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.711+0000 7fa7d1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc19d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:17.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.711+0000 7fa7d1e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc10dd00 con 0x7fa7cc109810 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.711+0000 7fa7caa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc19d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.711+0000 7fa7caa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc19d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56426/0 (socket says 172.21.15.62:56426) 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.711+0000 7fa7caa00640 1 -- 172.21.15.62:0/3919442578 learned_addr learned my addr 172.21.15.62:0/3919442578 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.712+0000 7fa7caa00640 1 -- 172.21.15.62:0/3919442578 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc19dcf0 con 0x7fa7cc109810 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.712+0000 7fa7caa00640 1 --2- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc19d7b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc030420 tx=0x7fa7bc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.712+0000 7fa7d0a00640 1 -- 172.21.15.62:0/3919442578 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7bc037040 con 0x7fa7cc109810 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.712+0000 7fa7d0a00640 1 -- 172.21.15.62:0/3919442578 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7bc040070 con 0x7fa7cc109810 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.712+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3919442578 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7cc19df80 con 0x7fa7cc109810 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.712+0000 7fa7d0a00640 1 -- 172.21.15.62:0/3919442578 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7bc03a6e0 con 0x7fa7cc109810 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.712+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3919442578 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7cc1a0c70 con 0x7fa7cc109810 2024-09-12T01:49:17.757 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.713+0000 7fa7d0a00640 1 -- 172.21.15.62:0/3919442578 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fa7bc03b420 con 0x7fa7cc109810 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.714+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3919442578 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7cc109c90 con 0x7fa7cc109810 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.714+0000 7fa7d0a00640 1 --2- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa7b0039020 0x7fa7b003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.714+0000 7fa7d0a00640 1 -- 172.21.15.62:0/3919442578 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa7bc06c660 con 0x7fa7cc109810 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.714+0000 7fa7ca000640 1 -- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa7b0039020 msgr2=0x7fa7b003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1515578586 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.714+0000 7fa7ca000640 1 --2- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa7b0039020 0x7fa7b003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.719+0000 7fa7d0a00640 1 -- 172.21.15.62:0/3919442578 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7bc02e900 con 0x7fa7cc109810 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.915+0000 7fa7ca000640 1 -- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa7b0039020 msgr2=0x7fa7b003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1515578586 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.915+0000 7fa7ca000640 1 --2- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa7b0039020 0x7fa7b003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.984+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3919442578 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fa7cc1a1260 con 0x7fa7cc109810 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.985+0000 7fa7d0a00640 1 -- 172.21.15.62:0/3919442578 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fa7bc02ed30 con 0x7fa7cc109810 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.987+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa7b0039020 msgr2=0x7fa7b003b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:49:17.758 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.987+0000 7fa7d1e00640 1 --2- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa7b0039020 0x7fa7b003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.987+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 msgr2=0x7fa7cc19d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.987+0000 7fa7d1e00640 1 --2- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc19d7b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc030420 tx=0x7fa7bc032670 comp rx=0 tx=0).stop 2024-09-12T01:49:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.988+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3919442578 shutdown_connections 2024-09-12T01:49:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.988+0000 7fa7d1e00640 1 --2- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7fa7b0039020 0x7fa7b003b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.988+0000 7fa7d1e00640 1 --2- 172.21.15.62:0/3919442578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7cc109810 0x7fa7cc19d7b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.988+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3919442578 >> 172.21.15.62:0/3919442578 conn(0x7fa7cc07ccf0 msgr2=0x7fa7cc107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.988+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3919442578 shutdown_connections 2024-09-12T01:49:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:16.988+0000 7fa7d1e00640 1 -- 172.21.15.62:0/3919442578 wait complete. 2024-09-12T01:49:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for the mgr to restart... 2024-09-12T01:49:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr epoch 9... 2024-09-12T01:49:18.215 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:18 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:18.131+0000 7f1fc6230040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:49:18.215 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:18 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:18.214+0000 7f1fc6230040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:49:19.307 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:19.165+0000 7f1fc6230040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:49:19.308 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:19.307+0000 7f1fc6230040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:49:19.591 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:19.476+0000 7f1fc6230040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:49:19.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:19.551+0000 7f1fc6230040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:49:20.076 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:19.728+0000 7f1fc6230040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:49:20.076 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:19.813+0000 7f1fc6230040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:49:20.076 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:19.887+0000 7f1fc6230040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:49:20.076 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:20.075+0000 7f1fc6230040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:49:20.338 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:20.155+0000 7f1fc6230040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:49:20.339 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:20.237+0000 7f1fc6230040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:49:20.339 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:20.338+0000 7f1fc6230040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:49:20.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:20.411+0000 7f1fc6230040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:49:20.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:20.484+0000 7f1fc6230040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:49:21.669 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:21.436+0000 7f1fc6230040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: Active manager daemon x restarted 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: Activating manager daemon x 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: mgrmap e10: x(active, starting, since 0.00400167s) 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: Manager daemon x is now available 2024-09-12T01:49:21.670 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:22.797 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:49:22.797 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:49:22.797 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:22 smithi062 ceph-mon[30666]: mgrmap e11: x(active, since 1.0093s) 2024-09-12T01:49:23.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-mon[30666]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T01:49:23.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-mon[30666]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T01:49:23.829 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:23.636+0000 7f1f23600640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:49:23] ENGINE Error in HTTPServer.serve 2024-09-12T01:49:23.829 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: Traceback (most recent call last): 2024-09-12T01:49:23.829 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self._connections.run(self.expiration_interval) 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self._run(expiration_interval) 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: s = self.context.wrap_socket( 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: return self.sslsocket_class._create( 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:49:23.830 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self.do_handshake() 2024-09-12T01:49:23.831 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:49:23.831 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self._sslobj.do_handshake() 2024-09-12T01:49:23.831 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:49:23.831 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:49:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:49:23.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:49:23.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T01:49:23.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:49:23.836 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:49:23.843 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.333+0000 7feac2000640 1 Processor -- start 2024-09-12T01:49:23.843 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.333+0000 7feac2000640 1 -- start start 2024-09-12T01:49:23.843 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.333+0000 7feac2000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc1060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:23.843 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.333+0000 7feac2000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feabc075790 con 0x7feabc105ca0 2024-09-12T01:49:23.843 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.334+0000 7feac0c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc1060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:23.843 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.334+0000 7feac0c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc1060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56428/0 (socket says 172.21.15.62:56428) 2024-09-12T01:49:23.843 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.334+0000 7feac0c00640 1 -- 172.21.15.62:0/3549536144 learned_addr learned my addr 172.21.15.62:0/3549536144 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.334+0000 7feac0c00640 1 -- 172.21.15.62:0/3549536144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feabc1065e0 con 0x7feabc105ca0 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.335+0000 7feac0c00640 1 --2- 172.21.15.62:0/3549536144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc1060a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feab0009820 tx=0x7feab002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f387a8c2d0b5e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.335+0000 7feabb400640 1 -- 172.21.15.62:0/3549536144 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0037070 con 0x7feabc105ca0 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.335+0000 7feabb400640 1 -- 172.21.15.62:0/3549536144 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feab0032920 con 0x7feabc105ca0 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.335+0000 7feabb400640 1 -- 172.21.15.62:0/3549536144 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0030810 con 0x7feabc105ca0 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.336+0000 7feac2000640 1 -- 172.21.15.62:0/3549536144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 msgr2=0x7feabc1060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.336+0000 7feac2000640 1 --2- 172.21.15.62:0/3549536144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc1060a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feab0009820 tx=0x7feab002a270 comp rx=0 tx=0).stop 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.336+0000 7feac2000640 1 -- 172.21.15.62:0/3549536144 shutdown_connections 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.336+0000 7feac2000640 1 --2- 172.21.15.62:0/3549536144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc1060a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.336+0000 7feac2000640 1 -- 172.21.15.62:0/3549536144 >> 172.21.15.62:0/3549536144 conn(0x7feabc101ab0 msgr2=0x7feabc103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.336+0000 7feac2000640 1 -- 172.21.15.62:0/3549536144 shutdown_connections 2024-09-12T01:49:23.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.336+0000 7feac2000640 1 -- 172.21.15.62:0/3549536144 wait complete. 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.337+0000 7feac2000640 1 Processor -- start 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.337+0000 7feac2000640 1 -- start start 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.338+0000 7feac2000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc19d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.338+0000 7feac2000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feabc107720 con 0x7feabc105ca0 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.338+0000 7feac0c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc19d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.338+0000 7feac0c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc19d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56442/0 (socket says 172.21.15.62:56442) 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.338+0000 7feac0c00640 1 -- 172.21.15.62:0/946607803 learned_addr learned my addr 172.21.15.62:0/946607803 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.338+0000 7feac0c00640 1 -- 172.21.15.62:0/946607803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feabc19dad0 con 0x7feabc105ca0 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.339+0000 7feac0c00640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc19d590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feab00097f0 tx=0x7feab00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.339+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0037040 con 0x7feabc105ca0 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.339+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feab0030cc0 con 0x7feabc105ca0 2024-09-12T01:49:23.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.339+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab003a6b0 con 0x7feabc105ca0 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.339+0000 7feac2000640 1 -- 172.21.15.62:0/946607803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feabc19dd60 con 0x7feabc105ca0 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.339+0000 7feac2000640 1 -- 172.21.15.62:0/946607803 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feabc1a0a50 con 0x7feabc105ca0 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.340+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7feab003baf0 con 0x7feabc105ca0 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.341+0000 7feab9600640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 0x7feaa403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.341+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 --> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7feaa403bbf0 con 0x7feaa4039020 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.341+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7feab006c5a0 con 0x7feabc105ca0 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.341+0000 7feabbe00640 1 -- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 msgr2=0x7feaa403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1515578586 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.341+0000 7feabbe00640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 0x7feaa403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.542+0000 7feabbe00640 1 -- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 msgr2=0x7feaa403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1515578586 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.542+0000 7feabbe00640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 0x7feaa403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.943+0000 7feabbe00640 1 -- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 msgr2=0x7feaa403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1515578586 2024-09-12T01:49:23.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:18.943+0000 7feabbe00640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 0x7feaa403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:49:23.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:19.744+0000 7feabbe00640 1 -- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 msgr2=0x7feaa403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1515578586 2024-09-12T01:49:23.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:19.744+0000 7feabbe00640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 0x7feaa403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:49:23.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:21.345+0000 7feabbe00640 1 -- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 msgr2=0x7feaa403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1515578586 2024-09-12T01:49:23.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:21.345+0000 7feabbe00640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 0x7feaa403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-12T01:49:23.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:21.440+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7feab003b3f0 con 0x7feabc105ca0 2024-09-12T01:49:23.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:21.441+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 msgr2=0x7feaa403b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:49:23.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:21.441+0000 7feab9600640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 0x7feaa403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:23.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.443+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7feab00405a0 con 0x7feabc105ca0 2024-09-12T01:49:23.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.444+0000 7feab9600640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7feaa403cae0 0x7feaa403eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.444+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7feab0047e50 con 0x7feaa403cae0 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.445+0000 7feabbe00640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7feaa403cae0 0x7feaa403eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.446+0000 7feabbe00640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7feaa403cae0 0x7feaa403eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feaa8003980 tx=0x7feaa80092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.447+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7feab0047e50 con 0x7feaa403cae0 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.455+0000 7feac2000640 1 -- 172.21.15.62:0/946607803 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7feabc1060a0 con 0x7feaa403cae0 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.455+0000 7feab9600640 1 -- 172.21.15.62:0/946607803 <== mgr.14152 v2:172.21.15.62:6800/1859863767 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7feabc1060a0 con 0x7feaa403cae0 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.456+0000 7feac2000640 1 -- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7feaa403cae0 msgr2=0x7feaa403eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.456+0000 7feac2000640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7feaa403cae0 0x7feaa403eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feaa8003980 tx=0x7feaa80092b0 comp rx=0 tx=0).stop 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.456+0000 7feac2000640 1 -- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 msgr2=0x7feabc19d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.456+0000 7feac2000640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc19d590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feab00097f0 tx=0x7feab00327b0 comp rx=0 tx=0).stop 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.456+0000 7feac2000640 1 -- 172.21.15.62:0/946607803 shutdown_connections 2024-09-12T01:49:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.456+0000 7feac2000640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7feaa403cae0 0x7feaa403eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:23.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.456+0000 7feac2000640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:6800/1515578586,v1:172.21.15.62:6801/1515578586] conn(0x7feaa4039020 0x7feaa403b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:23.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.456+0000 7feac2000640 1 --2- 172.21.15.62:0/946607803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feabc105ca0 0x7feabc19d590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:23.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.456+0000 7feac2000640 1 -- 172.21.15.62:0/946607803 >> 172.21.15.62:0/946607803 conn(0x7feabc101ab0 msgr2=0x7feabc194250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:23.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.456+0000 7feac2000640 1 -- 172.21.15.62:0/946607803 shutdown_connections 2024-09-12T01:49:23.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:22.457+0000 7feac2000640 1 -- 172.21.15.62:0/946607803 wait complete. 2024-09-12T01:49:23.849 INFO:teuthology.orchestra.run.smithi062.stdout:mgr epoch 9 is available 2024-09-12T01:49:23.849 INFO:teuthology.orchestra.run.smithi062.stdout:Generating a dashboard self-signed certificate... 2024-09-12T01:49:24.790 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:24 smithi062 ceph-mon[30666]: mgrmap e12: x(active, since 2s) 2024-09-12T01:49:24.790 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:24 smithi062 ceph-mon[30666]: [12/Sep/2024:01:49:23] ENGINE Bus STARTING 2024-09-12T01:49:24.790 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:24.790 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:24 smithi062 ceph-mon[30666]: [12/Sep/2024:01:49:23] ENGINE Serving on https://172.21.15.62:7150 2024-09-12T01:49:24.790 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:24 smithi062 ceph-mon[30666]: [12/Sep/2024:01:49:23] ENGINE Error in HTTPServer.serve 2024-09-12T01:49:24.790 INFO:journalctl@ceph.mon.a.smithi062.stdout: Traceback (most recent call last): 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: self._run(expiration_interval) 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: s = self.context.wrap_socket( 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: return self.sslsocket_class._create( 2024-09-12T01:49:24.791 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:49:24.792 INFO:journalctl@ceph.mon.a.smithi062.stdout: self.do_handshake() 2024-09-12T01:49:24.792 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:49:24.792 INFO:journalctl@ceph.mon.a.smithi062.stdout: self._sslobj.do_handshake() 2024-09-12T01:49:24.792 INFO:journalctl@ceph.mon.a.smithi062.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:49:24.792 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:24 smithi062 ceph-mon[30666]: [12/Sep/2024:01:49:23] ENGINE Serving on http://172.21.15.62:8765 2024-09-12T01:49:24.792 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:24 smithi062 ceph-mon[30666]: [12/Sep/2024:01:49:23] ENGINE Bus STARTED 2024-09-12T01:49:25.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T01:49:25.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.492+0000 7fb46ac00640 1 Processor -- start 2024-09-12T01:49:25.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.492+0000 7fb46ac00640 1 -- start start 2024-09-12T01:49:25.461 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.493+0000 7fb46ac00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb464109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:25.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.493+0000 7fb46ac00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb46410a1e0 con 0x7fb464109810 2024-09-12T01:49:25.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.493+0000 7fb463e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb464109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:25.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.493+0000 7fb463e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb464109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58820/0 (socket says 172.21.15.62:58820) 2024-09-12T01:49:25.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.493+0000 7fb463e00640 1 -- 172.21.15.62:0/3070216990 learned_addr learned my addr 172.21.15.62:0/3070216990 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:25.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.494+0000 7fb463e00640 1 -- 172.21.15.62:0/3070216990 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46410a950 con 0x7fb464109810 2024-09-12T01:49:25.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.495+0000 7fb463e00640 1 --2- 172.21.15.62:0/3070216990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb464109c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb454009820 tx=0x7fb45402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84dac0cc57e672c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:25.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.495+0000 7fb462a00640 1 -- 172.21.15.62:0/3070216990 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb454037070 con 0x7fb464109810 2024-09-12T01:49:25.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.495+0000 7fb462a00640 1 -- 172.21.15.62:0/3070216990 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb454032920 con 0x7fb464109810 2024-09-12T01:49:25.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.495+0000 7fb462a00640 1 -- 172.21.15.62:0/3070216990 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb454030810 con 0x7fb464109810 2024-09-12T01:49:25.462 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.496+0000 7fb46ac00640 1 -- 172.21.15.62:0/3070216990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 msgr2=0x7fb464109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:25.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.496+0000 7fb46ac00640 1 --2- 172.21.15.62:0/3070216990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb464109c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb454009820 tx=0x7fb45402a270 comp rx=0 tx=0).stop 2024-09-12T01:49:25.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.496+0000 7fb46ac00640 1 -- 172.21.15.62:0/3070216990 shutdown_connections 2024-09-12T01:49:25.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.496+0000 7fb46ac00640 1 --2- 172.21.15.62:0/3070216990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb464109c10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:25.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.496+0000 7fb46ac00640 1 -- 172.21.15.62:0/3070216990 >> 172.21.15.62:0/3070216990 conn(0x7fb46407ccf0 msgr2=0x7fb46407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:25.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.496+0000 7fb46ac00640 1 -- 172.21.15.62:0/3070216990 shutdown_connections 2024-09-12T01:49:25.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.496+0000 7fb46ac00640 1 -- 172.21.15.62:0/3070216990 wait complete. 2024-09-12T01:49:25.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.497+0000 7fb46ac00640 1 Processor -- start 2024-09-12T01:49:25.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.497+0000 7fb46ac00640 1 -- start start 2024-09-12T01:49:25.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.497+0000 7fb46ac00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb46419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:25.463 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.497+0000 7fb46ac00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb46410dd00 con 0x7fb464109810 2024-09-12T01:49:25.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.498+0000 7fb463e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb46419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:25.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.498+0000 7fb463e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb46419d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58834/0 (socket says 172.21.15.62:58834) 2024-09-12T01:49:25.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.498+0000 7fb463e00640 1 -- 172.21.15.62:0/2918732221 learned_addr learned my addr 172.21.15.62:0/2918732221 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:25.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.498+0000 7fb463e00640 1 -- 172.21.15.62:0/2918732221 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46419dcf0 con 0x7fb464109810 2024-09-12T01:49:25.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.498+0000 7fb463e00640 1 --2- 172.21.15.62:0/2918732221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb46419d7b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4540097f0 tx=0x7fb4540327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:25.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.498+0000 7fb460c00640 1 -- 172.21.15.62:0/2918732221 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb454037040 con 0x7fb464109810 2024-09-12T01:49:25.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.499+0000 7fb460c00640 1 -- 172.21.15.62:0/2918732221 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb454030c40 con 0x7fb464109810 2024-09-12T01:49:25.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.499+0000 7fb46ac00640 1 -- 172.21.15.62:0/2918732221 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46419df80 con 0x7fb464109810 2024-09-12T01:49:25.464 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.499+0000 7fb460c00640 1 -- 172.21.15.62:0/2918732221 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb45403a5d0 con 0x7fb464109810 2024-09-12T01:49:25.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.499+0000 7fb46ac00640 1 -- 172.21.15.62:0/2918732221 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4641a0c70 con 0x7fb464109810 2024-09-12T01:49:25.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.500+0000 7fb460c00640 1 -- 172.21.15.62:0/2918732221 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fb45403b3f0 con 0x7fb464109810 2024-09-12T01:49:25.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.500+0000 7fb46ac00640 1 -- 172.21.15.62:0/2918732221 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb464109c90 con 0x7fb464109810 2024-09-12T01:49:25.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.500+0000 7fb460c00640 1 --2- 172.21.15.62:0/2918732221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb448039020 0x7fb44803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:25.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.500+0000 7fb460c00640 1 -- 172.21.15.62:0/2918732221 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb45406c610 con 0x7fb464109810 2024-09-12T01:49:25.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.501+0000 7fb463400640 1 --2- 172.21.15.62:0/2918732221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb448039020 0x7fb44803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:25.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.501+0000 7fb463400640 1 --2- 172.21.15.62:0/2918732221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb448039020 0x7fb44803b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4500098c0 tx=0x7fb450006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:25.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.506+0000 7fb460c00640 1 -- 172.21.15.62:0/2918732221 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb45403b6e0 con 0x7fb464109810 2024-09-12T01:49:25.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.696+0000 7fb46ac00640 1 -- 172.21.15.62:0/2918732221 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fb464107c70 con 0x7fb448039020 2024-09-12T01:49:25.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.789+0000 7fb460c00640 1 -- 172.21.15.62:0/2918732221 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fb464107c70 con 0x7fb448039020 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.791+0000 7fb46ac00640 1 -- 172.21.15.62:0/2918732221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb448039020 msgr2=0x7fb44803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.792+0000 7fb46ac00640 1 --2- 172.21.15.62:0/2918732221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb448039020 0x7fb44803b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4500098c0 tx=0x7fb450006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.792+0000 7fb46ac00640 1 -- 172.21.15.62:0/2918732221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 msgr2=0x7fb46419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.792+0000 7fb46ac00640 1 --2- 172.21.15.62:0/2918732221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb46419d7b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4540097f0 tx=0x7fb4540327b0 comp rx=0 tx=0).stop 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.792+0000 7fb46ac00640 1 -- 172.21.15.62:0/2918732221 shutdown_connections 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.792+0000 7fb46ac00640 1 --2- 172.21.15.62:0/2918732221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb448039020 0x7fb44803b4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.792+0000 7fb46ac00640 1 --2- 172.21.15.62:0/2918732221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb464109810 0x7fb46419d7b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.792+0000 7fb46ac00640 1 -- 172.21.15.62:0/2918732221 >> 172.21.15.62:0/2918732221 conn(0x7fb46407ccf0 msgr2=0x7fb464107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.792+0000 7fb46ac00640 1 -- 172.21.15.62:0/2918732221 shutdown_connections 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:24.792+0000 7fb46ac00640 1 -- 172.21.15.62:0/2918732221 wait complete. 2024-09-12T01:49:25.466 INFO:teuthology.orchestra.run.smithi062.stdout:Creating initial admin user... 2024-09-12T01:49:26.070 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:25 smithi062 ceph-mon[30666]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:26.070 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:25 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:26.071 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:25 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:26.071 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:25 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:27.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:26 smithi062 ceph-mon[30666]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:27.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:26 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:27.484 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$56Xo6V9bFHdr95I51EPigOL9jAEAJcmRfzNZllvrN38jtB0P6PNhi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726105766, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T01:49:27.484 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.101+0000 7f0b37800640 1 Processor -- start 2024-09-12T01:49:27.484 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.101+0000 7f0b37800640 1 -- start start 2024-09-12T01:49:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.101+0000 7f0b37800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b30109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.101+0000 7f0b37800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3010a1e0 con 0x7f0b30109810 2024-09-12T01:49:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.102+0000 7f0b34e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b30109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.102+0000 7f0b34e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b30109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58848/0 (socket says 172.21.15.62:58848) 2024-09-12T01:49:27.485 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.102+0000 7f0b34e00640 1 -- 172.21.15.62:0/424225409 learned_addr learned my addr 172.21.15.62:0/424225409 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:27.486 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.102+0000 7f0b34e00640 1 -- 172.21.15.62:0/424225409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3010a950 con 0x7f0b30109810 2024-09-12T01:49:27.486 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.104+0000 7f0b34e00640 1 --2- 172.21.15.62:0/424225409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b30109c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009820 tx=0x7f0b2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d404d28e412732a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:27.486 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.104+0000 7f0b2f400640 1 -- 172.21.15.62:0/424225409 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b24037070 con 0x7f0b30109810 2024-09-12T01:49:27.486 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.104+0000 7f0b2f400640 1 -- 172.21.15.62:0/424225409 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b24032920 con 0x7f0b30109810 2024-09-12T01:49:27.486 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.104+0000 7f0b2f400640 1 -- 172.21.15.62:0/424225409 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b24030810 con 0x7f0b30109810 2024-09-12T01:49:27.486 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.105+0000 7f0b37800640 1 -- 172.21.15.62:0/424225409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 msgr2=0x7f0b30109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:27.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.105+0000 7f0b37800640 1 --2- 172.21.15.62:0/424225409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b30109c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009820 tx=0x7f0b2402a270 comp rx=0 tx=0).stop 2024-09-12T01:49:27.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.105+0000 7f0b37800640 1 -- 172.21.15.62:0/424225409 shutdown_connections 2024-09-12T01:49:27.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.105+0000 7f0b37800640 1 --2- 172.21.15.62:0/424225409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b30109c10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.105+0000 7f0b37800640 1 -- 172.21.15.62:0/424225409 >> 172.21.15.62:0/424225409 conn(0x7f0b3007ccf0 msgr2=0x7f0b3007d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:27.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.105+0000 7f0b37800640 1 -- 172.21.15.62:0/424225409 shutdown_connections 2024-09-12T01:49:27.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.105+0000 7f0b37800640 1 -- 172.21.15.62:0/424225409 wait complete. 2024-09-12T01:49:27.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.106+0000 7f0b37800640 1 Processor -- start 2024-09-12T01:49:27.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.106+0000 7f0b37800640 1 -- start start 2024-09-12T01:49:27.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.107+0000 7f0b37800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b3019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:27.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.107+0000 7f0b37800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3010dd00 con 0x7f0b30109810 2024-09-12T01:49:27.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.107+0000 7f0b34e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b3019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:27.489 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.107+0000 7f0b34e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b3019d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58850/0 (socket says 172.21.15.62:58850) 2024-09-12T01:49:27.489 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.107+0000 7f0b34e00640 1 -- 172.21.15.62:0/156203975 learned_addr learned my addr 172.21.15.62:0/156203975 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:27.489 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.107+0000 7f0b34e00640 1 -- 172.21.15.62:0/156203975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3019dcf0 con 0x7f0b30109810 2024-09-12T01:49:27.489 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.108+0000 7f0b34e00640 1 --2- 172.21.15.62:0/156203975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b3019d7b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b240097f0 tx=0x7f0b240327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:27.489 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.108+0000 7f0b2d600640 1 -- 172.21.15.62:0/156203975 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b24037040 con 0x7f0b30109810 2024-09-12T01:49:27.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.108+0000 7f0b2d600640 1 -- 172.21.15.62:0/156203975 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b24030c40 con 0x7f0b30109810 2024-09-12T01:49:27.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.108+0000 7f0b2d600640 1 -- 172.21.15.62:0/156203975 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b2403a5d0 con 0x7f0b30109810 2024-09-12T01:49:27.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.108+0000 7f0b37800640 1 -- 172.21.15.62:0/156203975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3019df80 con 0x7f0b30109810 2024-09-12T01:49:27.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.108+0000 7f0b37800640 1 -- 172.21.15.62:0/156203975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b301a0c70 con 0x7f0b30109810 2024-09-12T01:49:27.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.110+0000 7f0b37800640 1 -- 172.21.15.62:0/156203975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b30109c90 con 0x7f0b30109810 2024-09-12T01:49:27.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.110+0000 7f0b2d600640 1 -- 172.21.15.62:0/156203975 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f0b2403b3f0 con 0x7f0b30109810 2024-09-12T01:49:27.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.110+0000 7f0b2d600640 1 --2- 172.21.15.62:0/156203975 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0b18039020 0x7f0b1803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:27.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.110+0000 7f0b2d600640 1 -- 172.21.15.62:0/156203975 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0b2406c510 con 0x7f0b30109810 2024-09-12T01:49:27.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.111+0000 7f0b2fe00640 1 --2- 172.21.15.62:0/156203975 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0b18039020 0x7f0b1803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:27.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.111+0000 7f0b2fe00640 1 --2- 172.21.15.62:0/156203975 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0b18039020 0x7f0b1803b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0098c0 tx=0x7f0b1c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:27.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.115+0000 7f0b2d600640 1 -- 172.21.15.62:0/156203975 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b24040210 con 0x7f0b30109810 2024-09-12T01:49:27.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.315+0000 7f0b37800640 1 -- 172.21.15.62:0/156203975 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f0b3019e460 con 0x7f0b18039020 2024-09-12T01:49:27.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.586+0000 7f0b2d600640 1 -- 172.21.15.62:0/156203975 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f0b3019e460 con 0x7f0b18039020 2024-09-12T01:49:27.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.588+0000 7f0b37800640 1 -- 172.21.15.62:0/156203975 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0b18039020 msgr2=0x7f0b1803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:27.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.588+0000 7f0b37800640 1 --2- 172.21.15.62:0/156203975 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0b18039020 0x7f0b1803b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0098c0 tx=0x7f0b1c006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.588+0000 7f0b37800640 1 -- 172.21.15.62:0/156203975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 msgr2=0x7f0b3019d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:27.493 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.588+0000 7f0b37800640 1 --2- 172.21.15.62:0/156203975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b3019d7b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b240097f0 tx=0x7f0b240327b0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.493 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.589+0000 7f0b37800640 1 -- 172.21.15.62:0/156203975 shutdown_connections 2024-09-12T01:49:27.493 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.589+0000 7f0b37800640 1 --2- 172.21.15.62:0/156203975 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0b18039020 0x7f0b1803b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.493 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.589+0000 7f0b37800640 1 --2- 172.21.15.62:0/156203975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0b30109810 0x7f0b3019d7b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.493 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.589+0000 7f0b37800640 1 -- 172.21.15.62:0/156203975 >> 172.21.15.62:0/156203975 conn(0x7f0b3007ccf0 msgr2=0x7f0b301075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:27.494 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.589+0000 7f0b37800640 1 -- 172.21.15.62:0/156203975 shutdown_connections 2024-09-12T01:49:27.494 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:26.589+0000 7f0b37800640 1 -- 172.21.15.62:0/156203975 wait complete. 2024-09-12T01:49:27.494 INFO:teuthology.orchestra.run.smithi062.stdout:Fetching dashboard port number... 2024-09-12T01:49:28.934 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:28 smithi062 ceph-mon[30666]: mgrmap e13: x(active, since 6s) 2024-09-12T01:49:28.934 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:28 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3460064381' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T01:49:29.198 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T01:49:29.198 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.400+0000 7f4ffbe00640 1 Processor -- start 2024-09-12T01:49:29.198 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.400+0000 7f4ffbe00640 1 -- start start 2024-09-12T01:49:29.198 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.400+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc07b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:29.198 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.400+0000 7f4ffbe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc07b760 con 0x7f4ffc07cd30 2024-09-12T01:49:29.198 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.400+0000 7f4ffaa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc07b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:29.198 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.400+0000 7f4ffaa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc07b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58866/0 (socket says 172.21.15.62:58866) 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.400+0000 7f4ffaa00640 1 -- 172.21.15.62:0/3183086151 learned_addr learned my addr 172.21.15.62:0/3183086151 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.401+0000 7f4ffaa00640 1 -- 172.21.15.62:0/3183086151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ffc07b8e0 con 0x7f4ffc07cd30 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.402+0000 7f4ffaa00640 1 --2- 172.21.15.62:0/3183086151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc07b190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009820 tx=0x7f4fec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47b5ed34d3269f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.402+0000 7f4ffa000640 1 -- 172.21.15.62:0/3183086151 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec037070 con 0x7f4ffc07cd30 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.402+0000 7f4ffa000640 1 -- 172.21.15.62:0/3183086151 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fec032920 con 0x7f4ffc07cd30 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.402+0000 7f4ffa000640 1 -- 172.21.15.62:0/3183086151 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec030810 con 0x7f4ffc07cd30 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.403+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3183086151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 msgr2=0x7f4ffc07b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.403+0000 7f4ffbe00640 1 --2- 172.21.15.62:0/3183086151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc07b190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009820 tx=0x7f4fec02a270 comp rx=0 tx=0).stop 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.403+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3183086151 shutdown_connections 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.403+0000 7f4ffbe00640 1 --2- 172.21.15.62:0/3183086151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc07b190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.403+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3183086151 >> 172.21.15.62:0/3183086151 conn(0x7f4ffc102b90 msgr2=0x7f4ffc104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.403+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3183086151 shutdown_connections 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.403+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3183086151 wait complete. 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.404+0000 7f4ffbe00640 1 Processor -- start 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.404+0000 7f4ffbe00640 1 -- start start 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.404+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc19d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.404+0000 7f4ffbe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc10da70 con 0x7f4ffc07cd30 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.405+0000 7f4ffaa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc19d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.405+0000 7f4ffaa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc19d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58872/0 (socket says 172.21.15.62:58872) 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.405+0000 7f4ffaa00640 1 -- 172.21.15.62:0/3460064381 learned_addr learned my addr 172.21.15.62:0/3460064381 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.405+0000 7f4ffaa00640 1 -- 172.21.15.62:0/3460064381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ffc19daf0 con 0x7f4ffc07cd30 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.405+0000 7f4ffaa00640 1 --2- 172.21.15.62:0/3460064381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc19d5b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097f0 tx=0x7f4fec0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.405+0000 7f4ff3400640 1 -- 172.21.15.62:0/3460064381 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec037040 con 0x7f4ffc07cd30 2024-09-12T01:49:29.200 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.406+0000 7f4ff3400640 1 -- 172.21.15.62:0/3460064381 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fec030cc0 con 0x7f4ffc07cd30 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.406+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3460064381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ffc19dd80 con 0x7f4ffc07cd30 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.406+0000 7f4ff3400640 1 -- 172.21.15.62:0/3460064381 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec03a6b0 con 0x7f4ffc07cd30 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.406+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3460064381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ffc1a0a70 con 0x7f4ffc07cd30 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.407+0000 7f4ff3400640 1 -- 172.21.15.62:0/3460064381 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4fec03b3f0 con 0x7f4ffc07cd30 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.407+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3460064381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ffc07b210 con 0x7f4ffc07cd30 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.407+0000 7f4ff3400640 1 --2- 172.21.15.62:0/3460064381 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fe00390c0 0x7f4fe003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.407+0000 7f4ff3400640 1 -- 172.21.15.62:0/3460064381 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4fec06c770 con 0x7f4ffc07cd30 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.407+0000 7f4ff3e00640 1 --2- 172.21.15.62:0/3460064381 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fe00390c0 0x7f4fe003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.408+0000 7f4ff3e00640 1 --2- 172.21.15.62:0/3460064381 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fe00390c0 0x7f4fe003b580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40098c0 tx=0x7f4fe4006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.413+0000 7f4ff3400640 1 -- 172.21.15.62:0/3460064381 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fec03a850 con 0x7f4ffc07cd30 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.598+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3460064381 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f4ffc1a1060 con 0x7f4ffc07cd30 2024-09-12T01:49:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.598+0000 7f4ff3400640 1 -- 172.21.15.62:0/3460064381 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f4fec03baf0 con 0x7f4ffc07cd30 2024-09-12T01:49:29.202 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.601+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3460064381 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fe00390c0 msgr2=0x7f4fe003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:29.202 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.601+0000 7f4ffbe00640 1 --2- 172.21.15.62:0/3460064381 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fe00390c0 0x7f4fe003b580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40098c0 tx=0x7f4fe4006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:29.202 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.601+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3460064381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 msgr2=0x7f4ffc19d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:29.202 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.601+0000 7f4ffbe00640 1 --2- 172.21.15.62:0/3460064381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc19d5b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097f0 tx=0x7f4fec0327b0 comp rx=0 tx=0).stop 2024-09-12T01:49:29.202 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.601+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3460064381 shutdown_connections 2024-09-12T01:49:29.202 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.601+0000 7f4ffbe00640 1 --2- 172.21.15.62:0/3460064381 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fe00390c0 0x7f4fe003b580 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:29.202 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.601+0000 7f4ffbe00640 1 --2- 172.21.15.62:0/3460064381 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ffc07cd30 0x7f4ffc19d5b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:29.202 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.601+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3460064381 >> 172.21.15.62:0/3460064381 conn(0x7f4ffc102b90 msgr2=0x7f4ffc1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:29.202 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.601+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3460064381 shutdown_connections 2024-09-12T01:49:29.202 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:28.601+0000 7f4ffbe00640 1 -- 172.21.15.62:0/3460064381 wait complete. 2024-09-12T01:49:29.215 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:49:29.215 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout disabled 2024-09-12T01:49:29.228 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:49:29.229 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-09-12T01:49:29.229 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld.service is not enabled 2024-09-12T01:49:29.229 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T01:49:29.231 INFO:teuthology.orchestra.run.smithi062.stdout:Ceph Dashboard is now available at: 2024-09-12T01:49:29.231 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:29.231 INFO:teuthology.orchestra.run.smithi062.stdout: URL: https://smithi062.front.sepia.ceph.com:8443/ 2024-09-12T01:49:29.231 INFO:teuthology.orchestra.run.smithi062.stdout: User: admin 2024-09-12T01:49:29.231 INFO:teuthology.orchestra.run.smithi062.stdout: Password: k9m8k7lafj 2024-09-12T01:49:29.232 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:29.232 INFO:teuthology.orchestra.run.smithi062.stdout:Saving cluster configuration to /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config directory 2024-09-12T01:49:30.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.866+0000 7f3ed8c00640 1 Processor -- start 2024-09-12T01:49:30.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.866+0000 7f3ed8c00640 1 -- start start 2024-09-12T01:49:30.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.866+0000 7f3ed8c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed4109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:30.844 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.866+0000 7f3ed8c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed410a1e0 con 0x7f3ed4109810 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.867+0000 7f3ed3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed4109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.867+0000 7f3ed3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed4109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58874/0 (socket says 172.21.15.62:58874) 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.867+0000 7f3ed3400640 1 -- 172.21.15.62:0/3522901091 learned_addr learned my addr 172.21.15.62:0/3522901091 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.867+0000 7f3ed3400640 1 -- 172.21.15.62:0/3522901091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed410a730 con 0x7f3ed4109810 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.868+0000 7f3ed3400640 1 --2- 172.21.15.62:0/3522901091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed4109c10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009e80 tx=0x7f3ec402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ca04226286443b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.868+0000 7f3ed2a00640 1 -- 172.21.15.62:0/3522901091 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec4036070 con 0x7f3ed4109810 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.868+0000 7f3ed2a00640 1 -- 172.21.15.62:0/3522901091 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec40318e0 con 0x7f3ed4109810 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.868+0000 7f3ed2a00640 1 -- 172.21.15.62:0/3522901091 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec4007a00 con 0x7f3ed4109810 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.869+0000 7f3ed8c00640 1 -- 172.21.15.62:0/3522901091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 msgr2=0x7f3ed4109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.869+0000 7f3ed8c00640 1 --2- 172.21.15.62:0/3522901091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed4109c10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009e80 tx=0x7f3ec402a7a0 comp rx=0 tx=0).stop 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.869+0000 7f3ed8c00640 1 -- 172.21.15.62:0/3522901091 shutdown_connections 2024-09-12T01:49:30.845 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.869+0000 7f3ed8c00640 1 --2- 172.21.15.62:0/3522901091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed4109c10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.869+0000 7f3ed8c00640 1 -- 172.21.15.62:0/3522901091 >> 172.21.15.62:0/3522901091 conn(0x7f3ed407cb00 msgr2=0x7f3ed407cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.869+0000 7f3ed8c00640 1 -- 172.21.15.62:0/3522901091 shutdown_connections 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.869+0000 7f3ed8c00640 1 -- 172.21.15.62:0/3522901091 wait complete. 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.870+0000 7f3ed8c00640 1 Processor -- start 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.870+0000 7f3ed8c00640 1 -- start start 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.871+0000 7f3ed8c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed419d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.871+0000 7f3ed8c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed410d9f0 con 0x7f3ed4109810 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.871+0000 7f3ed3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed419d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.871+0000 7f3ed3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed419d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58882/0 (socket says 172.21.15.62:58882) 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.871+0000 7f3ed3400640 1 -- 172.21.15.62:0/1844742590 learned_addr learned my addr 172.21.15.62:0/1844742590 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:30.846 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.871+0000 7f3ed3400640 1 -- 172.21.15.62:0/1844742590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed419db30 con 0x7f3ed4109810 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.871+0000 7f3ed3400640 1 --2- 172.21.15.62:0/1844742590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed419d5f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ec402acc0 tx=0x7f3ec4031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.872+0000 7f3ed0c00640 1 -- 172.21.15.62:0/1844742590 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec4036050 con 0x7f3ed4109810 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.872+0000 7f3ed0c00640 1 -- 172.21.15.62:0/1844742590 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec4037040 con 0x7f3ed4109810 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.872+0000 7f3ed0c00640 1 -- 172.21.15.62:0/1844742590 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec403d970 con 0x7f3ed4109810 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.872+0000 7f3ed8c00640 1 -- 172.21.15.62:0/1844742590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed419ddc0 con 0x7f3ed4109810 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.872+0000 7f3ed8c00640 1 -- 172.21.15.62:0/1844742590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed41a0ab0 con 0x7f3ed4109810 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.873+0000 7f3ed8c00640 1 -- 172.21.15.62:0/1844742590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed4109c90 con 0x7f3ed4109810 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.873+0000 7f3ed0c00640 1 -- 172.21.15.62:0/1844742590 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3ec4044020 con 0x7f3ed4109810 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.874+0000 7f3ed0c00640 1 --2- 172.21.15.62:0/1844742590 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3eb8039060 0x7f3eb803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.874+0000 7f3ed0c00640 1 -- 172.21.15.62:0/1844742590 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3ec4042020 con 0x7f3ed4109810 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.874+0000 7f3ecaa00640 1 --2- 172.21.15.62:0/1844742590 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3eb8039060 0x7f3eb803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.875+0000 7f3ecaa00640 1 --2- 172.21.15.62:0/1844742590 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3eb8039060 0x7f3eb803b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0098c0 tx=0x7f3ebc006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:30.847 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:29.879+0000 7f3ed0c00640 1 -- 172.21.15.62:0/1844742590 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ec404b020 con 0x7f3ed4109810 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.161+0000 7f3ed8c00640 1 -- 172.21.15.62:0/1844742590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f3ed41a0c80 con 0x7f3ed4109810 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.163+0000 7f3ed0c00640 1 -- 172.21.15.62:0/1844742590 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f3ec403bc60 con 0x7f3ed4109810 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.165+0000 7f3ed8c00640 1 -- 172.21.15.62:0/1844742590 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3eb8039060 msgr2=0x7f3eb803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.166+0000 7f3ed8c00640 1 --2- 172.21.15.62:0/1844742590 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3eb8039060 0x7f3eb803b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0098c0 tx=0x7f3ebc006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.166+0000 7f3ed8c00640 1 -- 172.21.15.62:0/1844742590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 msgr2=0x7f3ed419d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.166+0000 7f3ed8c00640 1 --2- 172.21.15.62:0/1844742590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed419d5f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ec402acc0 tx=0x7f3ec4031cc0 comp rx=0 tx=0).stop 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.166+0000 7f3ed8c00640 1 -- 172.21.15.62:0/1844742590 shutdown_connections 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.166+0000 7f3ed8c00640 1 --2- 172.21.15.62:0/1844742590 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3eb8039060 0x7f3eb803b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.166+0000 7f3ed8c00640 1 --2- 172.21.15.62:0/1844742590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ed4109810 0x7f3ed419d5f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.166+0000 7f3ed8c00640 1 -- 172.21.15.62:0/1844742590 >> 172.21.15.62:0/1844742590 conn(0x7f3ed407cb00 msgr2=0x7f3ed4107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.166+0000 7f3ed8c00640 1 -- 172.21.15.62:0/1844742590 shutdown_connections 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-09-12T01:49:30.166+0000 7f3ed8c00640 1 -- 172.21.15.62:0/1844742590 wait complete. 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: ceph telemetry on 2024-09-12T01:49:30.849 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:30.850 INFO:teuthology.orchestra.run.smithi062.stdout:For more information see: 2024-09-12T01:49:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T01:49:30.850 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:30.850 INFO:teuthology.orchestra.run.smithi062.stdout:Bootstrap complete. 2024-09-12T01:49:30.899 INFO:tasks.cephadm:Fetching config... 2024-09-12T01:49:30.900 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:49:30.900 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T01:49:30.935 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T01:49:30.935 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:49:30.936 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T01:49:31.012 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T01:49:31.012 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:49:31.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T01:49:31.109 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T01:49:31.110 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:49:31.110 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T01:49:31.184 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T01:49:31.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcdAegYgT5fjdv3h4TUlbrW8DRxwDLZlljgZPitutIhJr1dwNSl+VVxGHevZpFtkzqy7Jn83cRjbce+nWQkPTkA0FzGBLT1cDgwMkFV78tvjBkjaid13kBkEsqk8oXKyesxTXp+FZXUJFbuyIJ5v3NxG7OLJmZijtAM5WsEHEcXgoQi5BtWh3uqH3CPCYzfRZll6ldzPtFh+zH9OFO2cGMVJn3KUNYralB+FcDgGfmhHM8r5vQGgzPXUoSWI17XSVSJrJ3WRiikMXxIF8Goel6QFmDKUCkapOjUwr36fF6STF7/kVfCdUtK2626g6bQkS1QsCkefn2XCtkNfyplGfrKhkSUpOnq9UM0i3yQlbdC+jCo9De0vgSSN+3jeBua59NYYspBe46dWLC6Ucx8MlHeu0ko7/b/sUQ/9y1TYw7Hh6ZIdFPeoFb02l0DVE9dLJM9jF8Uzwxqyy05akJlYJtyNx2sGLshgTiGOTSloivUQwdv19WopD2fpLk5+RCVls= ceph-f18ee350-70a8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:49:31.301 INFO:teuthology.orchestra.run.smithi062.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcdAegYgT5fjdv3h4TUlbrW8DRxwDLZlljgZPitutIhJr1dwNSl+VVxGHevZpFtkzqy7Jn83cRjbce+nWQkPTkA0FzGBLT1cDgwMkFV78tvjBkjaid13kBkEsqk8oXKyesxTXp+FZXUJFbuyIJ5v3NxG7OLJmZijtAM5WsEHEcXgoQi5BtWh3uqH3CPCYzfRZll6ldzPtFh+zH9OFO2cGMVJn3KUNYralB+FcDgGfmhHM8r5vQGgzPXUoSWI17XSVSJrJ3WRiikMXxIF8Goel6QFmDKUCkapOjUwr36fF6STF7/kVfCdUtK2626g6bQkS1QsCkefn2XCtkNfyplGfrKhkSUpOnq9UM0i3yQlbdC+jCo9De0vgSSN+3jeBua59NYYspBe46dWLC6Ucx8MlHeu0ko7/b/sUQ/9y1TYw7Hh6ZIdFPeoFb02l0DVE9dLJM9jF8Uzwxqyy05akJlYJtyNx2sGLshgTiGOTSloivUQwdv19WopD2fpLk5+RCVls= ceph-f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:49:31.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcdAegYgT5fjdv3h4TUlbrW8DRxwDLZlljgZPitutIhJr1dwNSl+VVxGHevZpFtkzqy7Jn83cRjbce+nWQkPTkA0FzGBLT1cDgwMkFV78tvjBkjaid13kBkEsqk8oXKyesxTXp+FZXUJFbuyIJ5v3NxG7OLJmZijtAM5WsEHEcXgoQi5BtWh3uqH3CPCYzfRZll6ldzPtFh+zH9OFO2cGMVJn3KUNYralB+FcDgGfmhHM8r5vQGgzPXUoSWI17XSVSJrJ3WRiikMXxIF8Goel6QFmDKUCkapOjUwr36fF6STF7/kVfCdUtK2626g6bQkS1QsCkefn2XCtkNfyplGfrKhkSUpOnq9UM0i3yQlbdC+jCo9De0vgSSN+3jeBua59NYYspBe46dWLC6Ucx8MlHeu0ko7/b/sUQ/9y1TYw7Hh6ZIdFPeoFb02l0DVE9dLJM9jF8Uzwxqyy05akJlYJtyNx2sGLshgTiGOTSloivUQwdv19WopD2fpLk5+RCVls= ceph-f18ee350-70a8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:49:31.368 INFO:teuthology.orchestra.run.smithi077.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcdAegYgT5fjdv3h4TUlbrW8DRxwDLZlljgZPitutIhJr1dwNSl+VVxGHevZpFtkzqy7Jn83cRjbce+nWQkPTkA0FzGBLT1cDgwMkFV78tvjBkjaid13kBkEsqk8oXKyesxTXp+FZXUJFbuyIJ5v3NxG7OLJmZijtAM5WsEHEcXgoQi5BtWh3uqH3CPCYzfRZll6ldzPtFh+zH9OFO2cGMVJn3KUNYralB+FcDgGfmhHM8r5vQGgzPXUoSWI17XSVSJrJ3WRiikMXxIF8Goel6QFmDKUCkapOjUwr36fF6STF7/kVfCdUtK2626g6bQkS1QsCkefn2XCtkNfyplGfrKhkSUpOnq9UM0i3yQlbdC+jCo9De0vgSSN+3jeBua59NYYspBe46dWLC6Ucx8MlHeu0ko7/b/sUQ/9y1TYw7Hh6ZIdFPeoFb02l0DVE9dLJM9jF8Uzwxqyy05akJlYJtyNx2sGLshgTiGOTSloivUQwdv19WopD2fpLk5+RCVls= ceph-f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:49:31.368 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:31 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1844742590' entity='client.admin' 2024-09-12T01:49:31.380 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcdAegYgT5fjdv3h4TUlbrW8DRxwDLZlljgZPitutIhJr1dwNSl+VVxGHevZpFtkzqy7Jn83cRjbce+nWQkPTkA0FzGBLT1cDgwMkFV78tvjBkjaid13kBkEsqk8oXKyesxTXp+FZXUJFbuyIJ5v3NxG7OLJmZijtAM5WsEHEcXgoQi5BtWh3uqH3CPCYzfRZll6ldzPtFh+zH9OFO2cGMVJn3KUNYralB+FcDgGfmhHM8r5vQGgzPXUoSWI17XSVSJrJ3WRiikMXxIF8Goel6QFmDKUCkapOjUwr36fF6STF7/kVfCdUtK2626g6bQkS1QsCkefn2XCtkNfyplGfrKhkSUpOnq9UM0i3yQlbdC+jCo9De0vgSSN+3jeBua59NYYspBe46dWLC6Ucx8MlHeu0ko7/b/sUQ/9y1TYw7Hh6ZIdFPeoFb02l0DVE9dLJM9jF8Uzwxqyy05akJlYJtyNx2sGLshgTiGOTSloivUQwdv19WopD2fpLk5+RCVls= ceph-f18ee350-70a8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:49:31.422 INFO:teuthology.orchestra.run.smithi107.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcdAegYgT5fjdv3h4TUlbrW8DRxwDLZlljgZPitutIhJr1dwNSl+VVxGHevZpFtkzqy7Jn83cRjbce+nWQkPTkA0FzGBLT1cDgwMkFV78tvjBkjaid13kBkEsqk8oXKyesxTXp+FZXUJFbuyIJ5v3NxG7OLJmZijtAM5WsEHEcXgoQi5BtWh3uqH3CPCYzfRZll6ldzPtFh+zH9OFO2cGMVJn3KUNYralB+FcDgGfmhHM8r5vQGgzPXUoSWI17XSVSJrJ3WRiikMXxIF8Goel6QFmDKUCkapOjUwr36fF6STF7/kVfCdUtK2626g6bQkS1QsCkefn2XCtkNfyplGfrKhkSUpOnq9UM0i3yQlbdC+jCo9De0vgSSN+3jeBua59NYYspBe46dWLC6Ucx8MlHeu0ko7/b/sUQ/9y1TYw7Hh6ZIdFPeoFb02l0DVE9dLJM9jF8Uzwxqyy05akJlYJtyNx2sGLshgTiGOTSloivUQwdv19WopD2fpLk5+RCVls= ceph-f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:49:31.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T01:49:31.802 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:32.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.356+0000 7ff63f200640 1 -- 172.21.15.62:0/515052412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff640103640 msgr2=0x7ff640103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:32.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.356+0000 7ff63f200640 1 --2- 172.21.15.62:0/515052412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff640103640 0x7ff640103a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff630009880 tx=0x7ff63002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:49:32.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.356+0000 7ff63f200640 1 -- 172.21.15.62:0/515052412 shutdown_connections 2024-09-12T01:49:32.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.356+0000 7ff63f200640 1 --2- 172.21.15.62:0/515052412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff640103640 0x7ff640103a40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:32.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.356+0000 7ff63f200640 1 -- 172.21.15.62:0/515052412 >> 172.21.15.62:0/515052412 conn(0x7ff6400fedd0 msgr2=0x7ff640101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:32.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.356+0000 7ff63f200640 1 -- 172.21.15.62:0/515052412 shutdown_connections 2024-09-12T01:49:32.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.356+0000 7ff63f200640 1 -- 172.21.15.62:0/515052412 wait complete. 2024-09-12T01:49:32.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.357+0000 7ff63f200640 1 Processor -- start 2024-09-12T01:49:32.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.357+0000 7ff63f200640 1 -- start start 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.358+0000 7ff63f200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff640103640 0x7ff640198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.358+0000 7ff63f200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff640109750 con 0x7ff640103640 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.358+0000 7ff63de00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff640103640 0x7ff640198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.358+0000 7ff63de00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff640103640 0x7ff640198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54662/0 (socket says 172.21.15.62:54662) 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.358+0000 7ff63de00640 1 -- 172.21.15.62:0/984030057 learned_addr learned my addr 172.21.15.62:0/984030057 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.358+0000 7ff63de00640 1 -- 172.21.15.62:0/984030057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff640199300 con 0x7ff640103640 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.359+0000 7ff63de00640 1 --2- 172.21.15.62:0/984030057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff640103640 0x7ff640198dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff630004f60 tx=0x7ff6300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.359+0000 7ff636a00640 1 -- 172.21.15.62:0/984030057 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff63003f070 con 0x7ff640103640 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.359+0000 7ff636a00640 1 -- 172.21.15.62:0/984030057 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff630004cc0 con 0x7ff640103640 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.359+0000 7ff636a00640 1 -- 172.21.15.62:0/984030057 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff630035030 con 0x7ff640103640 2024-09-12T01:49:32.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.359+0000 7ff63f200640 1 -- 172.21.15.62:0/984030057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff640199590 con 0x7ff640103640 2024-09-12T01:49:32.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.359+0000 7ff63f200640 1 -- 172.21.15.62:0/984030057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff64019c280 con 0x7ff640103640 2024-09-12T01:49:32.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.360+0000 7ff63f200640 1 -- 172.21.15.62:0/984030057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff640109ed0 con 0x7ff640103640 2024-09-12T01:49:32.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.360+0000 7ff636a00640 1 -- 172.21.15.62:0/984030057 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff630042070 con 0x7ff640103640 2024-09-12T01:49:32.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.361+0000 7ff636a00640 1 --2- 172.21.15.62:0/984030057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff6240390c0 0x7ff62403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:32.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.361+0000 7ff636a00640 1 -- 172.21.15.62:0/984030057 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff63006cdd0 con 0x7ff640103640 2024-09-12T01:49:32.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.361+0000 7ff63d400640 1 --2- 172.21.15.62:0/984030057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff6240390c0 0x7ff62403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:32.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.362+0000 7ff63d400640 1 --2- 172.21.15.62:0/984030057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff6240390c0 0x7ff62403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0098c0 tx=0x7ff62c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:32.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.367+0000 7ff636a00640 1 -- 172.21.15.62:0/984030057 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff630040260 con 0x7ff640103640 2024-09-12T01:49:32.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.558+0000 7ff63f200640 1 -- 172.21.15.62:0/984030057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7ff64002d830 con 0x7ff640103640 2024-09-12T01:49:32.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.561+0000 7ff636a00640 1 -- 172.21.15.62:0/984030057 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7ff630003dd0 con 0x7ff640103640 2024-09-12T01:49:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.563+0000 7ff63f200640 1 -- 172.21.15.62:0/984030057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff6240390c0 msgr2=0x7ff62403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.563+0000 7ff63f200640 1 --2- 172.21.15.62:0/984030057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff6240390c0 0x7ff62403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0098c0 tx=0x7ff62c006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:32.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.563+0000 7ff63f200640 1 -- 172.21.15.62:0/984030057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff640103640 msgr2=0x7ff640198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.563+0000 7ff63f200640 1 --2- 172.21.15.62:0/984030057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff640103640 0x7ff640198dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff630004f60 tx=0x7ff6300048f0 comp rx=0 tx=0).stop 2024-09-12T01:49:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.564+0000 7ff63f200640 1 -- 172.21.15.62:0/984030057 shutdown_connections 2024-09-12T01:49:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.564+0000 7ff63f200640 1 --2- 172.21.15.62:0/984030057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff6240390c0 0x7ff62403b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.564+0000 7ff63f200640 1 --2- 172.21.15.62:0/984030057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff640103640 0x7ff640198dc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.564+0000 7ff63f200640 1 -- 172.21.15.62:0/984030057 >> 172.21.15.62:0/984030057 conn(0x7ff6400fedd0 msgr2=0x7ff6400ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.564+0000 7ff63f200640 1 -- 172.21.15.62:0/984030057 shutdown_connections 2024-09-12T01:49:32.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:32.564+0000 7ff63f200640 1 -- 172.21.15.62:0/984030057 wait complete. 2024-09-12T01:49:33.215 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T01:49:33.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T01:49:33.726 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:33.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:33 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/984030057' entity='client.admin' 2024-09-12T01:49:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.427+0000 7fb781400640 1 -- 172.21.15.62:0/1174899792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c1015f0 msgr2=0x7fb77c1019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.427+0000 7fb781400640 1 --2- 172.21.15.62:0/1174899792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c1015f0 0x7fb77c1019f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009880 tx=0x7fb76c02a5d0 comp rx=0 tx=0).stop 2024-09-12T01:49:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.427+0000 7fb781400640 1 -- 172.21.15.62:0/1174899792 shutdown_connections 2024-09-12T01:49:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.427+0000 7fb781400640 1 --2- 172.21.15.62:0/1174899792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c1015f0 0x7fb77c1019f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.427+0000 7fb781400640 1 -- 172.21.15.62:0/1174899792 >> 172.21.15.62:0/1174899792 conn(0x7fb77c0fcd80 msgr2=0x7fb77c0ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.427+0000 7fb781400640 1 -- 172.21.15.62:0/1174899792 shutdown_connections 2024-09-12T01:49:34.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.427+0000 7fb781400640 1 -- 172.21.15.62:0/1174899792 wait complete. 2024-09-12T01:49:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.428+0000 7fb781400640 1 Processor -- start 2024-09-12T01:49:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.428+0000 7fb781400640 1 -- start start 2024-09-12T01:49:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.428+0000 7fb781400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c1015f0 0x7fb77c196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.428+0000 7fb781400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c107700 con 0x7fb77c1015f0 2024-09-12T01:49:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.428+0000 7fb77a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c1015f0 0x7fb77c196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.428+0000 7fb77a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c1015f0 0x7fb77c196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54682/0 (socket says 172.21.15.62:54682) 2024-09-12T01:49:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.428+0000 7fb77a800640 1 -- 172.21.15.62:0/2908632948 learned_addr learned my addr 172.21.15.62:0/2908632948 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.429+0000 7fb77a800640 1 -- 172.21.15.62:0/2908632948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77c1972d0 con 0x7fb77c1015f0 2024-09-12T01:49:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.429+0000 7fb77a800640 1 --2- 172.21.15.62:0/2908632948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c1015f0 0x7fb77c196d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb76c004f60 tx=0x7fb76c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.429+0000 7fb773400640 1 -- 172.21.15.62:0/2908632948 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb76c03f070 con 0x7fb77c1015f0 2024-09-12T01:49:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.429+0000 7fb773400640 1 -- 172.21.15.62:0/2908632948 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb76c004cc0 con 0x7fb77c1015f0 2024-09-12T01:49:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.429+0000 7fb773400640 1 -- 172.21.15.62:0/2908632948 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb76c035030 con 0x7fb77c1015f0 2024-09-12T01:49:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.429+0000 7fb781400640 1 -- 172.21.15.62:0/2908632948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77c197560 con 0x7fb77c1015f0 2024-09-12T01:49:34.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.430+0000 7fb781400640 1 -- 172.21.15.62:0/2908632948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77c19a210 con 0x7fb77c1015f0 2024-09-12T01:49:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.431+0000 7fb773400640 1 -- 172.21.15.62:0/2908632948 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb76c042070 con 0x7fb77c1015f0 2024-09-12T01:49:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.431+0000 7fb781400640 1 -- 172.21.15.62:0/2908632948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77c107e80 con 0x7fb77c1015f0 2024-09-12T01:49:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.431+0000 7fb773400640 1 --2- 172.21.15.62:0/2908632948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb760039060 0x7fb76003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.431+0000 7fb773400640 1 -- 172.21.15.62:0/2908632948 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb76c06cd40 con 0x7fb77c1015f0 2024-09-12T01:49:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.431+0000 7fb773e00640 1 --2- 172.21.15.62:0/2908632948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb760039060 0x7fb76003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:34.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.432+0000 7fb773e00640 1 --2- 172.21.15.62:0/2908632948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb760039060 0x7fb76003b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb7640098c0 tx=0x7fb764006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:34.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.436+0000 7fb773400640 1 -- 172.21.15.62:0/2908632948 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb76c0035f0 con 0x7fb77c1015f0 2024-09-12T01:49:34.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.628+0000 7fb781400640 1 -- 172.21.15.62:0/2908632948 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fb77c02d8a0 con 0x7fb760039060 2024-09-12T01:49:34.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.632+0000 7fb773400640 1 -- 172.21.15.62:0/2908632948 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb77c02d8a0 con 0x7fb760039060 2024-09-12T01:49:34.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.634+0000 7fb781400640 1 -- 172.21.15.62:0/2908632948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb760039060 msgr2=0x7fb76003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:34.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.634+0000 7fb781400640 1 --2- 172.21.15.62:0/2908632948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb760039060 0x7fb76003b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb7640098c0 tx=0x7fb764006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:34.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.634+0000 7fb781400640 1 -- 172.21.15.62:0/2908632948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c1015f0 msgr2=0x7fb77c196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:34.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.634+0000 7fb781400640 1 --2- 172.21.15.62:0/2908632948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c1015f0 0x7fb77c196d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb76c004f60 tx=0x7fb76c0048f0 comp rx=0 tx=0).stop 2024-09-12T01:49:34.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.634+0000 7fb781400640 1 -- 172.21.15.62:0/2908632948 shutdown_connections 2024-09-12T01:49:34.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.634+0000 7fb781400640 1 --2- 172.21.15.62:0/2908632948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb760039060 0x7fb76003b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:34.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.634+0000 7fb781400640 1 --2- 172.21.15.62:0/2908632948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb77c1015f0 0x7fb77c196d90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:34.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.634+0000 7fb781400640 1 -- 172.21.15.62:0/2908632948 >> 172.21.15.62:0/2908632948 conn(0x7fb77c0fcd80 msgr2=0x7fb77c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:34.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.635+0000 7fb781400640 1 -- 172.21.15.62:0/2908632948 shutdown_connections 2024-09-12T01:49:34.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:34.635+0000 7fb781400640 1 -- 172.21.15.62:0/2908632948 wait complete. 2024-09-12T01:49:34.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi062", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:35.471 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi077 2024-09-12T01:49:35.471 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:49:35.471 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:49:35.490 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:49:35.491 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:49:35.549 INFO:tasks.cephadm:Adding host smithi077 to orchestrator... 2024-09-12T01:49:35.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch host add smithi077 2024-09-12T01:49:36.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:35 smithi062 ceph-mon[30666]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:36.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:35 smithi062 ceph-mon[30666]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T01:49:36.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:35 smithi062 ceph-mon[30666]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:49:36.452 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:36.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.966+0000 7f0d37800640 1 -- 172.21.15.62:0/724936140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d30107640 msgr2=0x7f0d30107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:36.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.966+0000 7f0d37800640 1 --2- 172.21.15.62:0/724936140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d30107640 0x7f0d30107a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009880 tx=0x7f0d2402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:49:36.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.967+0000 7f0d37800640 1 -- 172.21.15.62:0/724936140 shutdown_connections 2024-09-12T01:49:36.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.967+0000 7f0d37800640 1 --2- 172.21.15.62:0/724936140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d30107640 0x7f0d30107a20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:36.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.967+0000 7f0d37800640 1 -- 172.21.15.62:0/724936140 >> 172.21.15.62:0/724936140 conn(0x7f0d300fd230 msgr2=0x7f0d300ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:36.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.967+0000 7f0d37800640 1 -- 172.21.15.62:0/724936140 shutdown_connections 2024-09-12T01:49:36.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.967+0000 7f0d37800640 1 -- 172.21.15.62:0/724936140 wait complete. 2024-09-12T01:49:36.969 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:36 smithi062 ceph-mon[30666]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:49:36.969 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:36 smithi062 ceph-mon[30666]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:49:36.969 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:36 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:36.969 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:36 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:36.969 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:36 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.968+0000 7f0d37800640 1 Processor -- start 2024-09-12T01:49:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.968+0000 7f0d37800640 1 -- start start 2024-09-12T01:49:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.968+0000 7f0d37800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d30107640 0x7f0d3019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.968+0000 7f0d37800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3010bc70 con 0x7f0d30107640 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.969+0000 7f0d34e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d30107640 0x7f0d3019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.969+0000 7f0d34e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d30107640 0x7f0d3019e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54704/0 (socket says 172.21.15.62:54704) 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.969+0000 7f0d34e00640 1 -- 172.21.15.62:0/218810948 learned_addr learned my addr 172.21.15.62:0/218810948 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.969+0000 7f0d34e00640 1 -- 172.21.15.62:0/218810948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3019e630 con 0x7f0d30107640 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.969+0000 7f0d34e00640 1 --2- 172.21.15.62:0/218810948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d30107640 0x7f0d3019e0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009230 tx=0x7f0d24003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.970+0000 7f0d2d600640 1 -- 172.21.15.62:0/218810948 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2403f070 con 0x7f0d30107640 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.970+0000 7f0d2d600640 1 -- 172.21.15.62:0/218810948 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d2403bc80 con 0x7f0d30107640 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.970+0000 7f0d2d600640 1 -- 172.21.15.62:0/218810948 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d24035030 con 0x7f0d30107640 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.970+0000 7f0d37800640 1 -- 172.21.15.62:0/218810948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3019e8c0 con 0x7f0d30107640 2024-09-12T01:49:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.970+0000 7f0d37800640 1 -- 172.21.15.62:0/218810948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d301a30c0 con 0x7f0d30107640 2024-09-12T01:49:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.971+0000 7f0d2d600640 1 -- 172.21.15.62:0/218810948 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0d24042070 con 0x7f0d30107640 2024-09-12T01:49:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.971+0000 7f0d37800640 1 -- 172.21.15.62:0/218810948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d30102cb0 con 0x7f0d30107640 2024-09-12T01:49:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.971+0000 7f0d2d600640 1 --2- 172.21.15.62:0/218810948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0d180390c0 0x7f0d1803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.971+0000 7f0d2d600640 1 -- 172.21.15.62:0/218810948 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0d2406cdb0 con 0x7f0d30107640 2024-09-12T01:49:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.972+0000 7f0d2fe00640 1 --2- 172.21.15.62:0/218810948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0d180390c0 0x7f0d1803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:36.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.972+0000 7f0d2fe00640 1 --2- 172.21.15.62:0/218810948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0d180390c0 0x7f0d1803b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0098c0 tx=0x7f0d1c006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:36.977+0000 7f0d2d600640 1 -- 172.21.15.62:0/218810948 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d240372d0 con 0x7f0d30107640 2024-09-12T01:49:37.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:37.164+0000 7f0d37800640 1 -- 172.21.15.62:0/218810948 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi077", "target": ["mon-mgr", ""]}) -- 0x7f0d30195270 con 0x7f0d180390c0 2024-09-12T01:49:38.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:37 smithi062 ceph-mon[30666]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi077", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:39.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:38 smithi062 ceph-mon[30666]: Deploying cephadm binary to smithi077 2024-09-12T01:49:40.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.992+0000 7f0d2d600640 1 -- 172.21.15.62:0/218810948 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f0d30195270 con 0x7f0d180390c0 2024-09-12T01:49:40.993 INFO:teuthology.orchestra.run.smithi062.stdout:Added host 'smithi077' with addr '172.21.15.77' 2024-09-12T01:49:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.994+0000 7f0d37800640 1 -- 172.21.15.62:0/218810948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0d180390c0 msgr2=0x7f0d1803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.994+0000 7f0d37800640 1 --2- 172.21.15.62:0/218810948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0d180390c0 0x7f0d1803b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0098c0 tx=0x7f0d1c006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.994+0000 7f0d37800640 1 -- 172.21.15.62:0/218810948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d30107640 msgr2=0x7f0d3019e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.994+0000 7f0d37800640 1 --2- 172.21.15.62:0/218810948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d30107640 0x7f0d3019e0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009230 tx=0x7f0d24003d40 comp rx=0 tx=0).stop 2024-09-12T01:49:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.994+0000 7f0d37800640 1 -- 172.21.15.62:0/218810948 shutdown_connections 2024-09-12T01:49:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.994+0000 7f0d37800640 1 --2- 172.21.15.62:0/218810948 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0d180390c0 0x7f0d1803b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.994+0000 7f0d37800640 1 --2- 172.21.15.62:0/218810948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d30107640 0x7f0d3019e0f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.994+0000 7f0d37800640 1 -- 172.21.15.62:0/218810948 >> 172.21.15.62:0/218810948 conn(0x7f0d300fd230 msgr2=0x7f0d30075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.995+0000 7f0d37800640 1 -- 172.21.15.62:0/218810948 shutdown_connections 2024-09-12T01:49:40.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:40.995+0000 7f0d37800640 1 -- 172.21.15.62:0/218810948 wait complete. 2024-09-12T01:49:41.629 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:49:41.995 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:42.254 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:41 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:42.255 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:41 smithi062 ceph-mon[30666]: Added host smithi077 2024-09-12T01:49:42.255 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:41 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:42.255 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:41 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:42.255 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:41 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:42.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.519+0000 7f9f7c200640 1 -- 172.21.15.62:0/2663006990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74107660 msgr2=0x7f9f74107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:42.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.519+0000 7f9f7c200640 1 --2- 172.21.15.62:0/2663006990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74107660 0x7f9f74107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009880 tx=0x7f9f6802a5d0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.519+0000 7f9f7c200640 1 -- 172.21.15.62:0/2663006990 shutdown_connections 2024-09-12T01:49:42.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.519+0000 7f9f7c200640 1 --2- 172.21.15.62:0/2663006990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74107660 0x7f9f74107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.519+0000 7f9f7c200640 1 -- 172.21.15.62:0/2663006990 >> 172.21.15.62:0/2663006990 conn(0x7f9f740fd290 msgr2=0x7f9f740ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:42.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.519+0000 7f9f7c200640 1 -- 172.21.15.62:0/2663006990 shutdown_connections 2024-09-12T01:49:42.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.519+0000 7f9f7c200640 1 -- 172.21.15.62:0/2663006990 wait complete. 2024-09-12T01:49:42.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.520+0000 7f9f7c200640 1 Processor -- start 2024-09-12T01:49:42.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.520+0000 7f9f7c200640 1 -- start start 2024-09-12T01:49:42.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.521+0000 7f9f7c200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74107660 0x7f9f74197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:42.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.521+0000 7f9f7c200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7410bc90 con 0x7f9f74107660 2024-09-12T01:49:42.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.521+0000 7f9f79800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74107660 0x7f9f74197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:42.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.521+0000 7f9f79800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74107660 0x7f9f74197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39378/0 (socket says 172.21.15.62:39378) 2024-09-12T01:49:42.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.521+0000 7f9f79800640 1 -- 172.21.15.62:0/280294740 learned_addr learned my addr 172.21.15.62:0/280294740 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:42.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.521+0000 7f9f79800640 1 -- 172.21.15.62:0/280294740 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f74197670 con 0x7f9f74107660 2024-09-12T01:49:42.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.522+0000 7f9f79800640 1 --2- 172.21.15.62:0/280294740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74107660 0x7f9f74197130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009230 tx=0x7f9f68003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:42.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.522+0000 7f9f72000640 1 -- 172.21.15.62:0/280294740 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f6803f070 con 0x7f9f74107660 2024-09-12T01:49:42.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.522+0000 7f9f7c200640 1 -- 172.21.15.62:0/280294740 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f74197900 con 0x7f9f74107660 2024-09-12T01:49:42.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.522+0000 7f9f72000640 1 -- 172.21.15.62:0/280294740 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f6803bd40 con 0x7f9f74107660 2024-09-12T01:49:42.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.522+0000 7f9f72000640 1 -- 172.21.15.62:0/280294740 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f68035030 con 0x7f9f74107660 2024-09-12T01:49:42.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.522+0000 7f9f7c200640 1 -- 172.21.15.62:0/280294740 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f7419ba00 con 0x7f9f74107660 2024-09-12T01:49:42.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.523+0000 7f9f72000640 1 -- 172.21.15.62:0/280294740 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f9f68042070 con 0x7f9f74107660 2024-09-12T01:49:42.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.523+0000 7f9f7c200640 1 -- 172.21.15.62:0/280294740 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f74102cd0 con 0x7f9f74107660 2024-09-12T01:49:42.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.523+0000 7f9f72000640 1 --2- 172.21.15.62:0/280294740 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9f5c039060 0x7f9f5c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:42.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.524+0000 7f9f72000640 1 -- 172.21.15.62:0/280294740 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9f6806cc40 con 0x7f9f74107660 2024-09-12T01:49:42.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.524+0000 7f9f78e00640 1 --2- 172.21.15.62:0/280294740 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9f5c039060 0x7f9f5c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:42.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.524+0000 7f9f78e00640 1 --2- 172.21.15.62:0/280294740 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9f5c039060 0x7f9f5c03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9f600098c0 tx=0x7f9f60006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:42.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.529+0000 7f9f72000640 1 -- 172.21.15.62:0/280294740 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f68036df0 con 0x7f9f74107660 2024-09-12T01:49:42.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.716+0000 7f9f7c200640 1 -- 172.21.15.62:0/280294740 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f74198490 con 0x7f9f5c039060 2024-09-12T01:49:42.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.717+0000 7f9f72000640 1 -- 172.21.15.62:0/280294740 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f9f74198490 con 0x7f9f5c039060 2024-09-12T01:49:42.718 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:42.718 INFO:teuthology.orchestra.run.smithi062.stdout:[{"addr": "172.21.15.62", "hostname": "smithi062", "labels": [], "status": ""}, {"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}] 2024-09-12T01:49:42.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.719+0000 7f9f7c200640 1 -- 172.21.15.62:0/280294740 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9f5c039060 msgr2=0x7f9f5c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.719+0000 7f9f7c200640 1 --2- 172.21.15.62:0/280294740 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9f5c039060 0x7f9f5c03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9f600098c0 tx=0x7f9f60006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.720+0000 7f9f7c200640 1 -- 172.21.15.62:0/280294740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74107660 msgr2=0x7f9f74197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.720+0000 7f9f7c200640 1 --2- 172.21.15.62:0/280294740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74107660 0x7f9f74197130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009230 tx=0x7f9f68003d80 comp rx=0 tx=0).stop 2024-09-12T01:49:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.720+0000 7f9f7c200640 1 -- 172.21.15.62:0/280294740 shutdown_connections 2024-09-12T01:49:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.720+0000 7f9f7c200640 1 --2- 172.21.15.62:0/280294740 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9f5c039060 0x7f9f5c03b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.720+0000 7f9f7c200640 1 --2- 172.21.15.62:0/280294740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f74107660 0x7f9f74197130 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.720+0000 7f9f7c200640 1 -- 172.21.15.62:0/280294740 >> 172.21.15.62:0/280294740 conn(0x7f9f740fd290 msgr2=0x7f9f740feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.720+0000 7f9f7c200640 1 -- 172.21.15.62:0/280294740 shutdown_connections 2024-09-12T01:49:42.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:42.720+0000 7f9f7c200640 1 -- 172.21.15.62:0/280294740 wait complete. 2024-09-12T01:49:43.345 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi107 2024-09-12T01:49:43.346 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:49:43.346 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:49:43.365 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:49:43.365 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:49:43.422 INFO:tasks.cephadm:Adding host smithi107 to orchestrator... 2024-09-12T01:49:43.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch host add smithi107 2024-09-12T01:49:43.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:43 smithi062 ceph-mon[30666]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:43.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:43 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:43.785 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:44.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.282+0000 7f7bcbc00640 1 -- 172.21.15.62:0/2339985951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc4107660 msgr2=0x7f7bc4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:44.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.282+0000 7f7bcbc00640 1 --2- 172.21.15.62:0/2339985951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc4107660 0x7f7bc4107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009880 tx=0x7f7bb802a5d0 comp rx=0 tx=0).stop 2024-09-12T01:49:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.282+0000 7f7bcbc00640 1 -- 172.21.15.62:0/2339985951 shutdown_connections 2024-09-12T01:49:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.282+0000 7f7bcbc00640 1 --2- 172.21.15.62:0/2339985951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc4107660 0x7f7bc4107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.282+0000 7f7bcbc00640 1 -- 172.21.15.62:0/2339985951 >> 172.21.15.62:0/2339985951 conn(0x7f7bc40fd290 msgr2=0x7f7bc40ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.283+0000 7f7bcbc00640 1 -- 172.21.15.62:0/2339985951 shutdown_connections 2024-09-12T01:49:44.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.283+0000 7f7bcbc00640 1 -- 172.21.15.62:0/2339985951 wait complete. 2024-09-12T01:49:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.283+0000 7f7bcbc00640 1 Processor -- start 2024-09-12T01:49:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.284+0000 7f7bcbc00640 1 -- start start 2024-09-12T01:49:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.284+0000 7f7bcbc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc4107660 0x7f7bc4197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.284+0000 7f7bcbc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc410bc90 con 0x7f7bc4107660 2024-09-12T01:49:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.284+0000 7f7bc9200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc4107660 0x7f7bc4197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.284+0000 7f7bc9200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc4107660 0x7f7bc4197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39390/0 (socket says 172.21.15.62:39390) 2024-09-12T01:49:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.284+0000 7f7bc9200640 1 -- 172.21.15.62:0/3991595985 learned_addr learned my addr 172.21.15.62:0/3991595985 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.285+0000 7f7bc9200640 1 -- 172.21.15.62:0/3991595985 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc4197670 con 0x7f7bc4107660 2024-09-12T01:49:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.285+0000 7f7bc9200640 1 --2- 172.21.15.62:0/3991595985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc4107660 0x7f7bc4197130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009230 tx=0x7f7bb8003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.285+0000 7f7bc1600640 1 -- 172.21.15.62:0/3991595985 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bb803f070 con 0x7f7bc4107660 2024-09-12T01:49:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.285+0000 7f7bc1600640 1 -- 172.21.15.62:0/3991595985 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb803bd40 con 0x7f7bc4107660 2024-09-12T01:49:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.285+0000 7f7bc1600640 1 -- 172.21.15.62:0/3991595985 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bb8035030 con 0x7f7bc4107660 2024-09-12T01:49:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.285+0000 7f7bcbc00640 1 -- 172.21.15.62:0/3991595985 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc4197900 con 0x7f7bc4107660 2024-09-12T01:49:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.285+0000 7f7bcbc00640 1 -- 172.21.15.62:0/3991595985 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc419ba00 con 0x7f7bc4107660 2024-09-12T01:49:44.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.286+0000 7f7bc1600640 1 -- 172.21.15.62:0/3991595985 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7bb8042070 con 0x7f7bc4107660 2024-09-12T01:49:44.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.286+0000 7f7bcbc00640 1 -- 172.21.15.62:0/3991595985 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc4102cd0 con 0x7f7bc4107660 2024-09-12T01:49:44.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.287+0000 7f7bc1600640 1 --2- 172.21.15.62:0/3991595985 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7bac0390c0 0x7f7bac03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:44.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.287+0000 7f7bc1600640 1 -- 172.21.15.62:0/3991595985 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7bb806ccd0 con 0x7f7bc4107660 2024-09-12T01:49:44.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.287+0000 7f7bc3e00640 1 --2- 172.21.15.62:0/3991595985 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7bac0390c0 0x7f7bac03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:44.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.288+0000 7f7bc3e00640 1 --2- 172.21.15.62:0/3991595985 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7bac0390c0 0x7f7bac03b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00098c0 tx=0x7f7bb0006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:44.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.292+0000 7f7bc1600640 1 -- 172.21.15.62:0/3991595985 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bb80412c0 con 0x7f7bc4107660 2024-09-12T01:49:44.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:44.479+0000 7f7bcbc00640 1 -- 172.21.15.62:0/3991595985 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi107", "target": ["mon-mgr", ""]}) -- 0x7f7bc4198490 con 0x7f7bac0390c0 2024-09-12T01:49:44.480 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:44 smithi062 ceph-mon[30666]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:49:45.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:45 smithi062 ceph-mon[30666]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:45.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:45.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:45.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:45.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:45.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:45.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:45.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:46.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:46 smithi062 ceph-mon[30666]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi107", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:46 smithi062 ceph-mon[30666]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-12T01:49:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:46 smithi062 ceph-mon[30666]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:49:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:47.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:47 smithi062 ceph-mon[30666]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:47.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:47 smithi062 ceph-mon[30666]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:49:47.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:47 smithi062 ceph-mon[30666]: Deploying cephadm binary to smithi107 2024-09-12T01:49:47.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:47 smithi062 ceph-mon[30666]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:49:48.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.440+0000 7f7bc1600640 1 -- 172.21.15.62:0/3991595985 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f7bc4198490 con 0x7f7bac0390c0 2024-09-12T01:49:48.440 INFO:teuthology.orchestra.run.smithi062.stdout:Added host 'smithi107' with addr '172.21.15.107' 2024-09-12T01:49:48.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.442+0000 7f7bcbc00640 1 -- 172.21.15.62:0/3991595985 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7bac0390c0 msgr2=0x7f7bac03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:48.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.442+0000 7f7bcbc00640 1 --2- 172.21.15.62:0/3991595985 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7bac0390c0 0x7f7bac03b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00098c0 tx=0x7f7bb0006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.442+0000 7f7bcbc00640 1 -- 172.21.15.62:0/3991595985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc4107660 msgr2=0x7f7bc4197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.442+0000 7f7bcbc00640 1 --2- 172.21.15.62:0/3991595985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc4107660 0x7f7bc4197130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009230 tx=0x7f7bb8003d80 comp rx=0 tx=0).stop 2024-09-12T01:49:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.443+0000 7f7bcbc00640 1 -- 172.21.15.62:0/3991595985 shutdown_connections 2024-09-12T01:49:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.443+0000 7f7bcbc00640 1 --2- 172.21.15.62:0/3991595985 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7bac0390c0 0x7f7bac03b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.443+0000 7f7bcbc00640 1 --2- 172.21.15.62:0/3991595985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bc4107660 0x7f7bc4197130 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.443+0000 7f7bcbc00640 1 -- 172.21.15.62:0/3991595985 >> 172.21.15.62:0/3991595985 conn(0x7f7bc40fd290 msgr2=0x7f7bc40feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.443+0000 7f7bcbc00640 1 -- 172.21.15.62:0/3991595985 shutdown_connections 2024-09-12T01:49:48.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:48.443+0000 7f7bcbc00640 1 -- 172.21.15.62:0/3991595985 wait complete. 2024-09-12T01:49:49.101 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:49:49.466 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:49.605 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:49 smithi062 ceph-mon[30666]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:49.605 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:49.606 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:49.606 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:49.606 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:49.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.972+0000 7fd158800640 1 -- 172.21.15.62:0/2064323508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150074590 msgr2=0x7fd150074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.972+0000 7fd158800640 1 --2- 172.21.15.62:0/2064323508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150074590 0x7fd150074970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd144009880 tx=0x7fd14402a670 comp rx=0 tx=0).stop 2024-09-12T01:49:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.972+0000 7fd158800640 1 -- 172.21.15.62:0/2064323508 shutdown_connections 2024-09-12T01:49:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.972+0000 7fd158800640 1 --2- 172.21.15.62:0/2064323508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150074590 0x7fd150074970 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.972+0000 7fd158800640 1 -- 172.21.15.62:0/2064323508 >> 172.21.15.62:0/2064323508 conn(0x7fd1500fd290 msgr2=0x7fd1500ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.972+0000 7fd158800640 1 -- 172.21.15.62:0/2064323508 shutdown_connections 2024-09-12T01:49:49.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.972+0000 7fd158800640 1 -- 172.21.15.62:0/2064323508 wait complete. 2024-09-12T01:49:49.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.973+0000 7fd158800640 1 Processor -- start 2024-09-12T01:49:49.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.973+0000 7fd158800640 1 -- start start 2024-09-12T01:49:49.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.974+0000 7fd158800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150074590 0x7fd1501a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:49.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.974+0000 7fd158800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd1501122b0 con 0x7fd150074590 2024-09-12T01:49:49.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.974+0000 7fd155e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150074590 0x7fd1501a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:49.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.974+0000 7fd155e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150074590 0x7fd1501a33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39412/0 (socket says 172.21.15.62:39412) 2024-09-12T01:49:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.974+0000 7fd155e00640 1 -- 172.21.15.62:0/1811379521 learned_addr learned my addr 172.21.15.62:0/1811379521 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.974+0000 7fd155e00640 1 -- 172.21.15.62:0/1811379521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1501a3930 con 0x7fd150074590 2024-09-12T01:49:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.975+0000 7fd155e00640 1 --2- 172.21.15.62:0/1811379521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150074590 0x7fd1501a33f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd144009230 tx=0x7fd144003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.975+0000 7fd14aa00640 1 -- 172.21.15.62:0/1811379521 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd14403f070 con 0x7fd150074590 2024-09-12T01:49:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.975+0000 7fd14aa00640 1 -- 172.21.15.62:0/1811379521 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd14403bd40 con 0x7fd150074590 2024-09-12T01:49:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.975+0000 7fd158800640 1 -- 172.21.15.62:0/1811379521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1501a3bc0 con 0x7fd150074590 2024-09-12T01:49:49.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.975+0000 7fd14aa00640 1 -- 172.21.15.62:0/1811379521 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd144035030 con 0x7fd150074590 2024-09-12T01:49:49.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.975+0000 7fd158800640 1 -- 172.21.15.62:0/1811379521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15019d5b0 con 0x7fd150074590 2024-09-12T01:49:49.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.976+0000 7fd158800640 1 -- 172.21.15.62:0/1811379521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd150075cd0 con 0x7fd150074590 2024-09-12T01:49:49.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.976+0000 7fd14aa00640 1 -- 172.21.15.62:0/1811379521 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd144042070 con 0x7fd150074590 2024-09-12T01:49:49.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.977+0000 7fd14aa00640 1 --2- 172.21.15.62:0/1811379521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd138039060 0x7fd13803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:49.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.977+0000 7fd14aa00640 1 -- 172.21.15.62:0/1811379521 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd14406cd20 con 0x7fd150074590 2024-09-12T01:49:49.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.977+0000 7fd155400640 1 --2- 172.21.15.62:0/1811379521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd138039060 0x7fd13803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:49.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.978+0000 7fd155400640 1 --2- 172.21.15.62:0/1811379521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd138039060 0x7fd13803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd1400098c0 tx=0x7fd140006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:49.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:49.982+0000 7fd14aa00640 1 -- 172.21.15.62:0/1811379521 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd144030d60 con 0x7fd150074590 2024-09-12T01:49:50.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.173+0000 7fd158800640 1 -- 172.21.15.62:0/1811379521 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd1500749f0 con 0x7fd138039060 2024-09-12T01:49:50.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.175+0000 7fd14aa00640 1 -- 172.21.15.62:0/1811379521 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fd1500749f0 con 0x7fd138039060 2024-09-12T01:49:50.174 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:49:50.175 INFO:teuthology.orchestra.run.smithi062.stdout:[{"addr": "172.21.15.62", "hostname": "smithi062", "labels": [], "status": ""}, {"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}, {"addr": "172.21.15.107", "hostname": "smithi107", "labels": [], "status": ""}] 2024-09-12T01:49:50.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.177+0000 7fd158800640 1 -- 172.21.15.62:0/1811379521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd138039060 msgr2=0x7fd13803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:50.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.177+0000 7fd158800640 1 --2- 172.21.15.62:0/1811379521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd138039060 0x7fd13803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd1400098c0 tx=0x7fd140006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.177+0000 7fd158800640 1 -- 172.21.15.62:0/1811379521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150074590 msgr2=0x7fd1501a33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:50.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.177+0000 7fd158800640 1 --2- 172.21.15.62:0/1811379521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150074590 0x7fd1501a33f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd144009230 tx=0x7fd144003d80 comp rx=0 tx=0).stop 2024-09-12T01:49:50.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.177+0000 7fd158800640 1 -- 172.21.15.62:0/1811379521 shutdown_connections 2024-09-12T01:49:50.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.177+0000 7fd158800640 1 --2- 172.21.15.62:0/1811379521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd138039060 0x7fd13803b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.177+0000 7fd158800640 1 --2- 172.21.15.62:0/1811379521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150074590 0x7fd1501a33f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.177+0000 7fd158800640 1 -- 172.21.15.62:0/1811379521 >> 172.21.15.62:0/1811379521 conn(0x7fd1500fd290 msgr2=0x7fd1500fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:50.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.177+0000 7fd158800640 1 -- 172.21.15.62:0/1811379521 shutdown_connections 2024-09-12T01:49:50.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:50.178+0000 7fd158800640 1 -- 172.21.15.62:0/1811379521 wait complete. 2024-09-12T01:49:50.569 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:50 smithi062 ceph-mon[30666]: Added host smithi107 2024-09-12T01:49:50.569 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:50 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:50.883 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T01:49:50.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T01:49:51.253 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:51.674 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:51 smithi062 ceph-mon[30666]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:51.674 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:51 smithi062 ceph-mon[30666]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:49:51.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.789+0000 7fcf50e00640 1 -- 172.21.15.62:0/1018101780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf4c074590 msgr2=0x7fcf4c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:51.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.789+0000 7fcf50e00640 1 --2- 172.21.15.62:0/1018101780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf4c074590 0x7fcf4c074970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009880 tx=0x7fcf3c02a670 comp rx=0 tx=0).stop 2024-09-12T01:49:51.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.790+0000 7fcf50e00640 1 -- 172.21.15.62:0/1018101780 shutdown_connections 2024-09-12T01:49:51.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.790+0000 7fcf50e00640 1 --2- 172.21.15.62:0/1018101780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf4c074590 0x7fcf4c074970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:51.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.790+0000 7fcf50e00640 1 -- 172.21.15.62:0/1018101780 >> 172.21.15.62:0/1018101780 conn(0x7fcf4c0fd230 msgr2=0x7fcf4c0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:51.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.790+0000 7fcf50e00640 1 -- 172.21.15.62:0/1018101780 shutdown_connections 2024-09-12T01:49:51.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.790+0000 7fcf50e00640 1 -- 172.21.15.62:0/1018101780 wait complete. 2024-09-12T01:49:51.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.791+0000 7fcf50e00640 1 Processor -- start 2024-09-12T01:49:51.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.791+0000 7fcf50e00640 1 -- start start 2024-09-12T01:49:51.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.791+0000 7fcf50e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf4c074590 0x7fcf4c1a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:51.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.791+0000 7fcf50e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c112290 con 0x7fcf4c074590 2024-09-12T01:49:51.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.791+0000 7fcf49e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf4c074590 0x7fcf4c1a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:51.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.791+0000 7fcf49e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf4c074590 0x7fcf4c1a33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52892/0 (socket says 172.21.15.62:52892) 2024-09-12T01:49:51.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.791+0000 7fcf49e00640 1 -- 172.21.15.62:0/1607673943 learned_addr learned my addr 172.21.15.62:0/1607673943 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:49:51.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.792+0000 7fcf49e00640 1 -- 172.21.15.62:0/1607673943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c1a3910 con 0x7fcf4c074590 2024-09-12T01:49:51.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.792+0000 7fcf49e00640 1 --2- 172.21.15.62:0/1607673943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf4c074590 0x7fcf4c1a33d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009230 tx=0x7fcf3c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:51.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.792+0000 7fcf42a00640 1 -- 172.21.15.62:0/1607673943 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3c03f070 con 0x7fcf4c074590 2024-09-12T01:49:51.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.792+0000 7fcf50e00640 1 -- 172.21.15.62:0/1607673943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4c1a3ba0 con 0x7fcf4c074590 2024-09-12T01:49:51.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.792+0000 7fcf42a00640 1 -- 172.21.15.62:0/1607673943 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf3c03bd40 con 0x7fcf4c074590 2024-09-12T01:49:51.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.792+0000 7fcf42a00640 1 -- 172.21.15.62:0/1607673943 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3c035030 con 0x7fcf4c074590 2024-09-12T01:49:51.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.793+0000 7fcf50e00640 1 -- 172.21.15.62:0/1607673943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf4c19d590 con 0x7fcf4c074590 2024-09-12T01:49:51.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.794+0000 7fcf42a00640 1 -- 172.21.15.62:0/1607673943 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fcf3c042070 con 0x7fcf4c074590 2024-09-12T01:49:51.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.794+0000 7fcf50e00640 1 -- 172.21.15.62:0/1607673943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf4c075cd0 con 0x7fcf4c074590 2024-09-12T01:49:51.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.794+0000 7fcf42a00640 1 --2- 172.21.15.62:0/1607673943 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcf300390c0 0x7fcf3003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:51.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.794+0000 7fcf42a00640 1 -- 172.21.15.62:0/1607673943 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcf3c06ccd0 con 0x7fcf4c074590 2024-09-12T01:49:51.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.794+0000 7fcf43e00640 1 --2- 172.21.15.62:0/1607673943 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcf300390c0 0x7fcf3003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:51.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.795+0000 7fcf43e00640 1 --2- 172.21.15.62:0/1607673943 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcf300390c0 0x7fcf3003b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcf340098c0 tx=0x7fcf34006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:51.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.799+0000 7fcf42a00640 1 -- 172.21.15.62:0/1607673943 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf3c0412c0 con 0x7fcf4c074590 2024-09-12T01:49:51.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:51.986+0000 7fcf50e00640 1 -- 172.21.15.62:0/1607673943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fcf4c0749f0 con 0x7fcf4c074590 2024-09-12T01:49:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.359+0000 7fcf42a00640 1 -- 172.21.15.62:0/1607673943 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fcf3c03b860 con 0x7fcf4c074590 2024-09-12T01:49:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2024-09-12T01:49:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.361+0000 7fcf50e00640 1 -- 172.21.15.62:0/1607673943 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcf300390c0 msgr2=0x7fcf3003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.361+0000 7fcf50e00640 1 --2- 172.21.15.62:0/1607673943 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcf300390c0 0x7fcf3003b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcf340098c0 tx=0x7fcf34006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.361+0000 7fcf50e00640 1 -- 172.21.15.62:0/1607673943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf4c074590 msgr2=0x7fcf4c1a33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.361+0000 7fcf50e00640 1 --2- 172.21.15.62:0/1607673943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf4c074590 0x7fcf4c1a33d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009230 tx=0x7fcf3c003d80 comp rx=0 tx=0).stop 2024-09-12T01:49:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.361+0000 7fcf50e00640 1 -- 172.21.15.62:0/1607673943 shutdown_connections 2024-09-12T01:49:52.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.361+0000 7fcf50e00640 1 --2- 172.21.15.62:0/1607673943 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcf300390c0 0x7fcf3003b580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.362+0000 7fcf50e00640 1 --2- 172.21.15.62:0/1607673943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf4c074590 0x7fcf4c1a33d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.362+0000 7fcf50e00640 1 -- 172.21.15.62:0/1607673943 >> 172.21.15.62:0/1607673943 conn(0x7fcf4c0fd230 msgr2=0x7fcf4c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.362+0000 7fcf50e00640 1 -- 172.21.15.62:0/1607673943 shutdown_connections 2024-09-12T01:49:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:49:52.362+0000 7fcf50e00640 1 -- 172.21.15.62:0/1607673943 wait complete. 2024-09-12T01:49:52.685 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:52 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1607673943' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:49:53.066 INFO:tasks.cephadm:Adding mon.a on smithi062 2024-09-12T01:49:53.066 INFO:tasks.cephadm:Adding mon.b on smithi077 2024-09-12T01:49:53.066 INFO:tasks.cephadm:Adding mon.c on smithi107 2024-09-12T01:49:53.066 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi062:172.21.15.62=a;smithi077:172.21.15.77=b;smithi107:172.21.15.107=c' 2024-09-12T01:49:53.312 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:49:53.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.795+0000 7f326d327640 1 -- 172.21.15.107:0/3265255202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3268106540 msgr2=0x7f3268106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.795+0000 7f326d327640 1 --2- 172.21.15.107:0/3265255202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3268106540 0x7f3268106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3258009810 tx=0x7f325802a540 comp rx=0 tx=0).stop 2024-09-12T01:49:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.795+0000 7f326d327640 1 -- 172.21.15.107:0/3265255202 shutdown_connections 2024-09-12T01:49:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.795+0000 7f326d327640 1 --2- 172.21.15.107:0/3265255202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3268106540 0x7f3268106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.795+0000 7f326d327640 1 -- 172.21.15.107:0/3265255202 >> 172.21.15.107:0/3265255202 conn(0x7f3268077310 msgr2=0x7f32680fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.795+0000 7f326d327640 1 -- 172.21.15.107:0/3265255202 shutdown_connections 2024-09-12T01:49:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.795+0000 7f326d327640 1 -- 172.21.15.107:0/3265255202 wait complete. 2024-09-12T01:49:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.795+0000 7f326d327640 1 Processor -- start 2024-09-12T01:49:53.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.796+0000 7f326d327640 1 -- start start 2024-09-12T01:49:53.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.796+0000 7f326d327640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3268106540 0x7f32680fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:53.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.796+0000 7f326d327640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f326810ab70 con 0x7f3268106540 2024-09-12T01:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.796+0000 7f3266ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3268106540 0x7f32680fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.796+0000 7f3266ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3268106540 0x7f32680fd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.107:52534/0 (socket says 172.21.15.107:52534) 2024-09-12T01:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.796+0000 7f3266ffd640 1 -- 172.21.15.107:0/1432330905 learned_addr learned my addr 172.21.15.107:0/1432330905 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.796+0000 7f3266ffd640 1 -- 172.21.15.107:0/1432330905 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32680ff290 con 0x7f3268106540 2024-09-12T01:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.797+0000 7f3266ffd640 1 --2- 172.21.15.107:0/1432330905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3268106540 0x7f32680fd3a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32580045e0 tx=0x7f3258004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.797+0000 7f3264ff9640 1 -- 172.21.15.107:0/1432330905 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3258030e70 con 0x7f3268106540 2024-09-12T01:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.797+0000 7f326d327640 1 -- 172.21.15.107:0/1432330905 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32680fd8e0 con 0x7f3268106540 2024-09-12T01:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.797+0000 7f3264ff9640 1 -- 172.21.15.107:0/1432330905 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32580318e0 con 0x7f3268106540 2024-09-12T01:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.797+0000 7f3264ff9640 1 -- 172.21.15.107:0/1432330905 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32580049c0 con 0x7f3268106540 2024-09-12T01:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.797+0000 7f326d327640 1 -- 172.21.15.107:0/1432330905 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32680fdda0 con 0x7f3268106540 2024-09-12T01:49:53.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.798+0000 7f3264ff9640 1 -- 172.21.15.107:0/1432330905 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3258039040 con 0x7f3268106540 2024-09-12T01:49:53.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.798+0000 7f3264ff9640 1 --2- 172.21.15.107:0/1432330905 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3254039060 0x7f325403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:53.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.798+0000 7f326d327640 1 -- 172.21.15.107:0/1432330905 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3268101bb0 con 0x7f3268106540 2024-09-12T01:49:53.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.798+0000 7f3264ff9640 1 -- 172.21.15.107:0/1432330905 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f325806d2d0 con 0x7f3268106540 2024-09-12T01:49:53.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.798+0000 7f325e7fc640 1 --2- 172.21.15.107:0/1432330905 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3254039060 0x7f325403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:53.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.799+0000 7f325e7fc640 1 --2- 172.21.15.107:0/1432330905 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3254039060 0x7f325403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f32500098c0 tx=0x7f3250006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:53.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.803+0000 7f3264ff9640 1 -- 172.21.15.107:0/1432330905 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3258040030 con 0x7f3268106540 2024-09-12T01:49:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:53 smithi062 ceph-mon[30666]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:53 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1607673943' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:49:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:53 smithi062 ceph-mon[30666]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:49:53.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:53.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:53.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:53.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:53.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi107", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:53.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:53.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:53.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.980+0000 7f326d327640 1 -- 172.21.15.107:0/1432330905 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi062:172.21.15.62=a;smithi077:172.21.15.77=b;smithi107:172.21.15.107=c", "target": ["mon-mgr", ""]}) -- 0x7f32680fdfd0 con 0x7f3254039060 2024-09-12T01:49:53.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.985+0000 7f3264ff9640 1 -- 172.21.15.107:0/1432330905 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f32680fdfd0 con 0x7f3254039060 2024-09-12T01:49:53.986 INFO:teuthology.orchestra.run.smithi107.stdout:Scheduled mon update... 2024-09-12T01:49:53.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.987+0000 7f326d327640 1 -- 172.21.15.107:0/1432330905 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3254039060 msgr2=0x7f325403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:53.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.987+0000 7f326d327640 1 --2- 172.21.15.107:0/1432330905 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3254039060 0x7f325403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f32500098c0 tx=0x7f3250006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:53.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.987+0000 7f326d327640 1 -- 172.21.15.107:0/1432330905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3268106540 msgr2=0x7f32680fd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:53.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.987+0000 7f326d327640 1 --2- 172.21.15.107:0/1432330905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3268106540 0x7f32680fd3a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32580045e0 tx=0x7f3258004610 comp rx=0 tx=0).stop 2024-09-12T01:49:53.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.987+0000 7f326d327640 1 -- 172.21.15.107:0/1432330905 shutdown_connections 2024-09-12T01:49:53.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.987+0000 7f326d327640 1 --2- 172.21.15.107:0/1432330905 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f3254039060 0x7f325403b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:53.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.987+0000 7f326d327640 1 --2- 172.21.15.107:0/1432330905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3268106540 0x7f32680fd3a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:53.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.987+0000 7f326d327640 1 -- 172.21.15.107:0/1432330905 >> 172.21.15.107:0/1432330905 conn(0x7f3268077310 msgr2=0x7f32680696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:53.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.988+0000 7f326d327640 1 -- 172.21.15.107:0/1432330905 shutdown_connections 2024-09-12T01:49:53.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:53.988+0000 7f326d327640 1 -- 172.21.15.107:0/1432330905 wait complete. 2024-09-12T01:49:54.595 DEBUG:teuthology.orchestra.run.smithi077:mon.b> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T01:49:54.597 DEBUG:teuthology.orchestra.run.smithi107:mon.c> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T01:49:54.600 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:49:54.600 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:49:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-12T01:49:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:49:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:49:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:49:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:54.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:54.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:54.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:49:54.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:49:54.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:55.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:55 smithi062 ceph-mon[30666]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:55.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:55 smithi062 ceph-mon[30666]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi062:172.21.15.62=a;smithi077:172.21.15.77=b;smithi107:172.21.15.107=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:55.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:55 smithi062 ceph-mon[30666]: Saving service mon spec with placement smithi062:172.21.15.62=a;smithi077:172.21.15.77=b;smithi107:172.21.15.107=c;count:3 2024-09-12T01:49:55.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:55 smithi062 ceph-mon[30666]: Deploying daemon mon.c on smithi107 2024-09-12T01:49:56.761 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:49:57.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.332+0000 7f4975a01640 1 -- 172.21.15.107:0/1305324843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49700ffdc0 msgr2=0x7f49701001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:57.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.332+0000 7f4975a01640 1 --2- 172.21.15.107:0/1305324843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49700ffdc0 0x7f49701001a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4960009880 tx=0x7f496002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:49:57.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.333+0000 7f4975a01640 1 -- 172.21.15.107:0/1305324843 shutdown_connections 2024-09-12T01:49:57.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.333+0000 7f4975a01640 1 --2- 172.21.15.107:0/1305324843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49700ffdc0 0x7f49701001a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:57.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.333+0000 7f4975a01640 1 -- 172.21.15.107:0/1305324843 >> 172.21.15.107:0/1305324843 conn(0x7f49700fb820 msgr2=0x7f49700fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:57.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.333+0000 7f4975a01640 1 -- 172.21.15.107:0/1305324843 shutdown_connections 2024-09-12T01:49:57.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.333+0000 7f4975a01640 1 -- 172.21.15.107:0/1305324843 wait complete. 2024-09-12T01:49:57.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.333+0000 7f4975a01640 1 Processor -- start 2024-09-12T01:49:57.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.334+0000 7f4975a01640 1 -- start start 2024-09-12T01:49:57.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.334+0000 7f4975a01640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49700ffdc0 0x7f497019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:57.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.334+0000 7f4975a01640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f497010a210 con 0x7f49700ffdc0 2024-09-12T01:49:57.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.334+0000 7f496effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49700ffdc0 0x7f497019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:57.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.334+0000 7f496effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49700ffdc0 0x7f497019ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.107:33128/0 (socket says 172.21.15.107:33128) 2024-09-12T01:49:57.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.335+0000 7f496effd640 1 -- 172.21.15.107:0/1736435622 learned_addr learned my addr 172.21.15.107:0/1736435622 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:49:57.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.335+0000 7f496effd640 1 -- 172.21.15.107:0/1736435622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497019d350 con 0x7f49700ffdc0 2024-09-12T01:49:57.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.335+0000 7f496effd640 1 --2- 172.21.15.107:0/1736435622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49700ffdc0 0x7f497019ce10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4960009230 tx=0x7f4960003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:57.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.335+0000 7f49749ff640 1 -- 172.21.15.107:0/1736435622 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496003f070 con 0x7f49700ffdc0 2024-09-12T01:49:57.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.335+0000 7f4975a01640 1 -- 172.21.15.107:0/1736435622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497019d640 con 0x7f49700ffdc0 2024-09-12T01:49:57.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.335+0000 7f49749ff640 1 -- 172.21.15.107:0/1736435622 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f496003bd40 con 0x7f49700ffdc0 2024-09-12T01:49:57.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.335+0000 7f49749ff640 1 -- 172.21.15.107:0/1736435622 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4960035030 con 0x7f49700ffdc0 2024-09-12T01:49:57.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.335+0000 7f4975a01640 1 -- 172.21.15.107:0/1736435622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4970195440 con 0x7f49700ffdc0 2024-09-12T01:49:57.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.336+0000 7f4975a01640 1 -- 172.21.15.107:0/1736435622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49701012a0 con 0x7f49700ffdc0 2024-09-12T01:49:57.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.337+0000 7f49749ff640 1 -- 172.21.15.107:0/1736435622 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4960042070 con 0x7f49700ffdc0 2024-09-12T01:49:57.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.337+0000 7f49749ff640 1 --2- 172.21.15.107:0/1736435622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f495c039060 0x7f495c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:57.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.337+0000 7f49749ff640 1 -- 172.21.15.107:0/1736435622 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f496006cc00 con 0x7f49700ffdc0 2024-09-12T01:49:57.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.337+0000 7f496e7fc640 1 --2- 172.21.15.107:0/1736435622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f495c039060 0x7f495c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:57.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.338+0000 7f496e7fc640 1 --2- 172.21.15.107:0/1736435622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f495c039060 0x7f495c03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f49580098c0 tx=0x7f4958006db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:57.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.342+0000 7f49749ff640 1 -- 172.21.15.107:0/1736435622 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4960073080 con 0x7f49700ffdc0 2024-09-12T01:49:57.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.593+0000 7f4975a01640 1 -- 172.21.15.107:0/1736435622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4970100220 con 0x7f49700ffdc0 2024-09-12T01:49:57.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.594+0000 7f49749ff640 1 -- 172.21.15.107:0/1736435622 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f4960030d60 con 0x7f49700ffdc0 2024-09-12T01:49:57.595 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:49:57.595 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:48:22.017888Z","created":"2024-09-12T01:48:22.017888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:49:57.595 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 1 2024-09-12T01:49:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.596+0000 7f4975a01640 1 -- 172.21.15.107:0/1736435622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f495c039060 msgr2=0x7f495c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.596+0000 7f4975a01640 1 --2- 172.21.15.107:0/1736435622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f495c039060 0x7f495c03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f49580098c0 tx=0x7f4958006db0 comp rx=0 tx=0).stop 2024-09-12T01:49:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.596+0000 7f4975a01640 1 -- 172.21.15.107:0/1736435622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49700ffdc0 msgr2=0x7f497019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.596+0000 7f4975a01640 1 --2- 172.21.15.107:0/1736435622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49700ffdc0 0x7f497019ce10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4960009230 tx=0x7f4960003d80 comp rx=0 tx=0).stop 2024-09-12T01:49:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.596+0000 7f4975a01640 1 -- 172.21.15.107:0/1736435622 shutdown_connections 2024-09-12T01:49:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.596+0000 7f4975a01640 1 --2- 172.21.15.107:0/1736435622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f495c039060 0x7f495c03b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.596+0000 7f4975a01640 1 --2- 172.21.15.107:0/1736435622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49700ffdc0 0x7f497019ce10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.596+0000 7f4975a01640 1 -- 172.21.15.107:0/1736435622 >> 172.21.15.107:0/1736435622 conn(0x7f49700fb820 msgr2=0x7f4970107790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.596+0000 7f4975a01640 1 -- 172.21.15.107:0/1736435622 shutdown_connections 2024-09-12T01:49:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:49:57.596+0000 7f4975a01640 1 -- 172.21.15.107:0/1736435622 wait complete. 2024-09-12T01:49:57.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:57 smithi062 ceph-mon[30666]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:58.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:49:58 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/1736435622' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:49:59.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:49:58 smithi107 systemd[1]: Started Ceph mon.c for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:59.207 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:49:59.207 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:49:59.460 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:50:04.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: mon.a calling monitor election 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: mon.c calling monitor election 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:50:04.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: monmap epoch 2 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: last_changed 2024-09-12T01:49:58.814181+0000 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: created 2024-09-12T01:48:22.017888+0000 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: min_mon_release 19 (squid) 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: election_strategy: 1 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: fsmap 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: mgrmap e13: x(active, since 42s) 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: overall HEALTH_OK 2024-09-12T01:50:04.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:04.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:04.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:04.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:04.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:04.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.276+0000 7f0174c3a640 1 -- 172.21.15.107:0/3634327144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0158003530 msgr2=0x7f01580059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:04.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.276+0000 7f0174c3a640 1 --2- 172.21.15.107:0/3634327144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0158003530 0x7f01580059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0170102af0 tx=0x7f016002c490 comp rx=0 tx=0).stop 2024-09-12T01:50:04.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.276+0000 7f0174c3a640 1 -- 172.21.15.107:0/3634327144 shutdown_connections 2024-09-12T01:50:04.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.276+0000 7f0174c3a640 1 --2- 172.21.15.107:0/3634327144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0158003530 0x7f01580059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.277+0000 7f0174c3a640 1 -- 172.21.15.107:0/3634327144 >> 172.21.15.107:0/3634327144 conn(0x7f01700fd320 msgr2=0x7f01700ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:04.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.277+0000 7f0174c3a640 1 -- 172.21.15.107:0/3634327144 shutdown_connections 2024-09-12T01:50:04.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.277+0000 7f0174c3a640 1 -- 172.21.15.107:0/3634327144 wait complete. 2024-09-12T01:50:04.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.278+0000 7f0174c3a640 1 Processor -- start 2024-09-12T01:50:04.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.278+0000 7f0174c3a640 1 -- start start 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.278+0000 7f0174c3a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0158003530 0x7f01701972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.278+0000 7f0174c3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01701977e0 0x7f017019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.278+0000 7f0174c3a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0170109780 con 0x7f01701977e0 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.278+0000 7f0174c3a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0170109600 con 0x7f0158003530 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0158003530 0x7f01701972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0158003530 0x7f01701972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39176/0 (socket says 172.21.15.107:39176) 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016e59c640 1 -- 172.21.15.107:0/580239531 learned_addr learned my addr 172.21.15.107:0/580239531 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016e59c640 1 -- 172.21.15.107:0/580239531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0158003530 msgr2=0x7f01701972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016e59c640 1 -- 172.21.15.107:0/580239531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0158003530 msgr2=0x7f01701972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016e59c640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0158003530 0x7f01701972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016e59c640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0158003530 0x7f01701972a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:50:04.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016dd9b640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01701977e0 0x7f017019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:04.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016dd9b640 1 -- 172.21.15.107:0/580239531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0158003530 msgr2=0x7f01701972a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:50:04.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016dd9b640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0158003530 0x7f01701972a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016dd9b640 1 -- 172.21.15.107:0/580239531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0170197e00 con 0x7f01701977e0 2024-09-12T01:50:04.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.279+0000 7f016dd9b640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01701977e0 0x7f017019bb70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f016400b3d0 tx=0x7f016400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:04.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.280+0000 7f015f7fe640 1 -- 172.21.15.107:0/580239531 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0164011630 con 0x7f01701977e0 2024-09-12T01:50:04.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.280+0000 7f0174c3a640 1 -- 172.21.15.107:0/580239531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017019c0b0 con 0x7f01701977e0 2024-09-12T01:50:04.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.280+0000 7f015f7fe640 1 -- 172.21.15.107:0/580239531 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0164011cb0 con 0x7f01701977e0 2024-09-12T01:50:04.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.280+0000 7f015f7fe640 1 -- 172.21.15.107:0/580239531 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0164010df0 con 0x7f01701977e0 2024-09-12T01:50:04.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.280+0000 7f0174c3a640 1 -- 172.21.15.107:0/580239531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017019c5f0 con 0x7f01701977e0 2024-09-12T01:50:04.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.281+0000 7f015f7fe640 1 -- 172.21.15.107:0/580239531 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0164018020 con 0x7f01701977e0 2024-09-12T01:50:04.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.281+0000 7f0174c3a640 1 -- 172.21.15.107:0/580239531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0170102da0 con 0x7f01701977e0 2024-09-12T01:50:04.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.281+0000 7f015f7fe640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0150038e00 0x7f015003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:04.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.281+0000 7f015f7fe640 1 -- 172.21.15.107:0/580239531 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f016404bc90 con 0x7f01701977e0 2024-09-12T01:50:04.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.282+0000 7f016e59c640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0150038e00 0x7f015003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:04.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.282+0000 7f016e59c640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0150038e00 0x7f015003b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0160012c10 tx=0x7f01600323a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:04.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.287+0000 7f015f7fe640 1 -- 172.21.15.107:0/580239531 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f016401f020 con 0x7f01701977e0 2024-09-12T01:50:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: mon.a calling monitor election 2024-09-12T01:50:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: mon.c calling monitor election 2024-09-12T01:50:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:04.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:04.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:50:04.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: monmap epoch 2 2024-09-12T01:50:04.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:50:04.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: last_changed 2024-09-12T01:49:58.814181+0000 2024-09-12T01:50:04.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: created 2024-09-12T01:48:22.017888+0000 2024-09-12T01:50:04.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: min_mon_release 19 (squid) 2024-09-12T01:50:04.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: election_strategy: 1 2024-09-12T01:50:04.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T01:50:04.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-09-12T01:50:04.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: fsmap 2024-09-12T01:50:04.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:50:04.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: mgrmap e13: x(active, since 42s) 2024-09-12T01:50:04.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: overall HEALTH_OK 2024-09-12T01:50:04.345 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:04.345 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:04.345 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:04.345 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:04.345 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:04.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.517+0000 7f0174c3a640 1 -- 172.21.15.107:0/580239531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0170190f90 con 0x7f01701977e0 2024-09-12T01:50:04.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.518+0000 7f015f7fe640 1 -- 172.21.15.107:0/580239531 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f0164018310 con 0x7f01701977e0 2024-09-12T01:50:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:50:04.519 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":2,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:49:58.814181Z","created":"2024-09-12T01:48:22.017888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:50:04.519 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 2 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 -- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0150038e00 msgr2=0x7f015003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0150038e00 0x7f015003b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0160012c10 tx=0x7f01600323a0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 -- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01701977e0 msgr2=0x7f017019bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01701977e0 0x7f017019bb70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f016400b3d0 tx=0x7f016400b890 comp rx=0 tx=0).stop 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 -- 172.21.15.107:0/580239531 shutdown_connections 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0150038e00 0x7f015003b2c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01701977e0 0x7f017019bb70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 --2- 172.21.15.107:0/580239531 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0158003530 0x7f01701972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 -- 172.21.15.107:0/580239531 >> 172.21.15.107:0/580239531 conn(0x7f01700fd320 msgr2=0x7f01700ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 -- 172.21.15.107:0/580239531 shutdown_connections 2024-09-12T01:50:04.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:04.520+0000 7f0174c3a640 1 -- 172.21.15.107:0/580239531 wait complete. 2024-09-12T01:50:05.094 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:04 smithi107 ceph-mon[35463]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:05.094 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:04 smithi107 ceph-mon[35463]: Deploying daemon mon.b on smithi077 2024-09-12T01:50:05.094 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:04 smithi107 ceph-mon[35463]: from='client.? 172.21.15.107:0/580239531' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:50:05.094 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:04 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:05.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:04 smithi062 ceph-mon[30666]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:05.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:04 smithi062 ceph-mon[30666]: Deploying daemon mon.b on smithi077 2024-09-12T01:50:05.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:04 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/580239531' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:50:05.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:04 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:06.091 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:50:05 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:50:05.814+0000 7f1f63c00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T01:50:06.122 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:50:06.122 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:50:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:50:06.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.784+0000 7fc6d03f9640 1 -- 172.21.15.107:0/3295362350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8106630 msgr2=0x7fc6c8106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:06.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.784+0000 7fc6d03f9640 1 --2- 172.21.15.107:0/3295362350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8106630 0x7fc6c8106a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009880 tx=0x7fc6c002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:50:06.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.784+0000 7fc6d03f9640 1 -- 172.21.15.107:0/3295362350 shutdown_connections 2024-09-12T01:50:06.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.784+0000 7fc6d03f9640 1 --2- 172.21.15.107:0/3295362350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8106630 0x7fc6c8106a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:06.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.784+0000 7fc6d03f9640 1 -- 172.21.15.107:0/3295362350 >> 172.21.15.107:0/3295362350 conn(0x7fc6c80fc220 msgr2=0x7fc6c80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.784+0000 7fc6d03f9640 1 -- 172.21.15.107:0/3295362350 shutdown_connections 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.784+0000 7fc6d03f9640 1 -- 172.21.15.107:0/3295362350 wait complete. 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6d03f9640 1 Processor -- start 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6d03f9640 1 -- start start 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6d03f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6c8106630 0x7fc6c81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6d03f9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8196820 0x7fc6c819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6d03f9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810ac60 con 0x7fc6c8196820 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6d03f9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810aae0 con 0x7fc6c8106630 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6ce195640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6c8106630 0x7fc6c81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6ce195640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6c8106630 0x7fc6c81962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39178/0 (socket says 172.21.15.107:39178) 2024-09-12T01:50:06.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6ce195640 1 -- 172.21.15.107:0/1634555910 learned_addr learned my addr 172.21.15.107:0/1634555910 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:50:06.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6cd994640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8196820 0x7fc6c819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:06.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6ce195640 1 -- 172.21.15.107:0/1634555910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6c8106630 msgr2=0x7fc6c81962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T01:50:06.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6ce195640 1 -- 172.21.15.107:0/1634555910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6c8106630 msgr2=0x7fc6c81962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:50:06.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6ce195640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6c8106630 0x7fc6c81962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:50:06.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.785+0000 7fc6ce195640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6c8106630 0x7fc6c81962e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:50:06.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.786+0000 7fc6cd994640 1 -- 172.21.15.107:0/1634555910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6c8106630 msgr2=0x7fc6c81962e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:50:06.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.786+0000 7fc6cd994640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6c8106630 0x7fc6c81962e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:06.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.786+0000 7fc6cd994640 1 -- 172.21.15.107:0/1634555910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c8196e40 con 0x7fc6c8196820 2024-09-12T01:50:06.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.786+0000 7fc6cd994640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8196820 0x7fc6c819abb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00b3d0 tx=0x7fc6bc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:06.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.786+0000 7fc6c77fe640 1 -- 172.21.15.107:0/1634555910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc6bc011630 con 0x7fc6c8196820 2024-09-12T01:50:06.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.786+0000 7fc6d03f9640 1 -- 172.21.15.107:0/1634555910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c819b0f0 con 0x7fc6c8196820 2024-09-12T01:50:06.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.786+0000 7fc6c77fe640 1 -- 172.21.15.107:0/1634555910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6bc011cb0 con 0x7fc6c8196820 2024-09-12T01:50:06.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.786+0000 7fc6d03f9640 1 -- 172.21.15.107:0/1634555910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c819b630 con 0x7fc6c8196820 2024-09-12T01:50:06.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.786+0000 7fc6c77fe640 1 -- 172.21.15.107:0/1634555910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc6bc0193b0 con 0x7fc6c8196820 2024-09-12T01:50:06.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.787+0000 7fc6d03f9640 1 -- 172.21.15.107:0/1634555910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c8101ca0 con 0x7fc6c8196820 2024-09-12T01:50:06.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.787+0000 7fc6c77fe640 1 -- 172.21.15.107:0/1634555910 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc6bc018020 con 0x7fc6c8196820 2024-09-12T01:50:06.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.787+0000 7fc6c77fe640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc6b0038e00 0x7fc6b003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:06.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.788+0000 7fc6c77fe640 1 -- 172.21.15.107:0/1634555910 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc6bc04bce0 con 0x7fc6c8196820 2024-09-12T01:50:06.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.788+0000 7fc6ce195640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc6b0038e00 0x7fc6b003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:06.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.788+0000 7fc6ce195640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc6b0038e00 0x7fc6b003b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00096c0 tx=0x7fc6c0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:06.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:06.793+0000 7fc6c77fe640 1 -- 172.21.15.107:0/1634555910 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6bc01f020 con 0x7fc6c8196820 2024-09-12T01:50:07.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.022+0000 7fc6d03f9640 1 -- 172.21.15.107:0/1634555910 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc6c819b940 con 0x7fc6c8196820 2024-09-12T01:50:07.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.023+0000 7fc6c77fe640 1 -- 172.21.15.107:0/1634555910 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fc6bc018570 con 0x7fc6c8196820 2024-09-12T01:50:07.024 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:50:07.024 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":2,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:49:58.814181Z","created":"2024-09-12T01:48:22.017888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:50:07.024 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 2 2024-09-12T01:50:07.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.025+0000 7fc6d03f9640 1 -- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc6b0038e00 msgr2=0x7fc6b003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:07.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.025+0000 7fc6d03f9640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc6b0038e00 0x7fc6b003b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00096c0 tx=0x7fc6c0031400 comp rx=0 tx=0).stop 2024-09-12T01:50:07.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.025+0000 7fc6d03f9640 1 -- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8196820 msgr2=0x7fc6c819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:07.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.025+0000 7fc6d03f9640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8196820 0x7fc6c819abb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00b3d0 tx=0x7fc6bc00b890 comp rx=0 tx=0).stop 2024-09-12T01:50:07.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.026+0000 7fc6d03f9640 1 -- 172.21.15.107:0/1634555910 shutdown_connections 2024-09-12T01:50:07.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.026+0000 7fc6d03f9640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc6b0038e00 0x7fc6b003b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:07.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.026+0000 7fc6d03f9640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8196820 0x7fc6c819abb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:07.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.026+0000 7fc6d03f9640 1 --2- 172.21.15.107:0/1634555910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6c8106630 0x7fc6c81962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:07.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.026+0000 7fc6d03f9640 1 -- 172.21.15.107:0/1634555910 >> 172.21.15.107:0/1634555910 conn(0x7fc6c80fc220 msgr2=0x7fc6c80fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:07.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.026+0000 7fc6d03f9640 1 -- 172.21.15.107:0/1634555910 shutdown_connections 2024-09-12T01:50:07.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:07.026+0000 7fc6d03f9640 1 -- 172.21.15.107:0/1634555910 wait complete. 2024-09-12T01:50:07.035 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:06 smithi107 ceph-mon[35463]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:07.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:06 smithi062 ceph-mon[30666]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:07.526 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:07 smithi077 ceph-mon[35095]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T01:50:07.526 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:07 smithi077 bash[35074]: fb80326a66f4b18dcb20ddcf0ec8ac3ce6a5a9d6e6a96d5487d3aa23b1781624 2024-09-12T01:50:07.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:07 smithi077 systemd[1]: Started Ceph mon.b for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:50:08.676 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:50:08.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:50:08.926 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:50:12.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.554+0000 7fd629957640 1 -- 172.21.15.107:0/476752359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd610003530 msgr2=0x7fd6100059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.554+0000 7fd629957640 1 --2- 172.21.15.107:0/476752359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd610003530 0x7fd6100059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd6241016c0 tx=0x7fd61402c150 comp rx=0 tx=0).stop 2024-09-12T01:50:12.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.554+0000 7fd629957640 1 -- 172.21.15.107:0/476752359 shutdown_connections 2024-09-12T01:50:12.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.554+0000 7fd629957640 1 --2- 172.21.15.107:0/476752359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd610003530 0x7fd6100059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.554+0000 7fd629957640 1 -- 172.21.15.107:0/476752359 >> 172.21.15.107:0/476752359 conn(0x7fd6240fc280 msgr2=0x7fd6240fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:12.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.554+0000 7fd629957640 1 -- 172.21.15.107:0/476752359 shutdown_connections 2024-09-12T01:50:12.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.554+0000 7fd629957640 1 -- 172.21.15.107:0/476752359 wait complete. 2024-09-12T01:50:12.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.554+0000 7fd629957640 1 Processor -- start 2024-09-12T01:50:12.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd629957640 1 -- start start 2024-09-12T01:50:12.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd629957640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd610003530 0x7fd624199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd629957640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624199a60 0x7fd62419ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd629957640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd62419e330 0x7fd62419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd629957640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd624108680 con 0x7fd62419e330 2024-09-12T01:50:12.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd629957640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd624108500 con 0x7fd624199a60 2024-09-12T01:50:12.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd629957640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd624108800 con 0x7fd610003530 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd622ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd610003530 0x7fd624199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd622ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd610003530 0x7fd624199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60912/0 (socket says 172.21.15.107:60912) 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd622ffd640 1 -- 172.21.15.107:0/2306036299 learned_addr learned my addr 172.21.15.107:0/2306036299 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.555+0000 7fd6237fe640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd62419e330 0x7fd62419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd622ffd640 1 -- 172.21.15.107:0/2306036299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd610003530 msgr2=0x7fd624199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd622ffd640 1 -- 172.21.15.107:0/2306036299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd610003530 msgr2=0x7fd624199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd622ffd640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd610003530 0x7fd624199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd61a7fc640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624199a60 0x7fd62419ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd622ffd640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd610003530 0x7fd624199520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd61a7fc640 1 -- 172.21.15.107:0/2306036299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624199a60 msgr2=0x7fd62419ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd61a7fc640 1 -- 172.21.15.107:0/2306036299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624199a60 msgr2=0x7fd62419ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd61a7fc640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624199a60 0x7fd62419ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:50:12.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd61a7fc640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624199a60 0x7fd62419ddf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd6237fe640 1 -- 172.21.15.107:0/2306036299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd610003530 msgr2=0x7fd624199520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd6237fe640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd610003530 0x7fd624199520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd6237fe640 1 -- 172.21.15.107:0/2306036299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624199a60 msgr2=0x7fd62419ddf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd6237fe640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624199a60 0x7fd62419ddf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd6237fe640 1 -- 172.21.15.107:0/2306036299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6241a60a0 con 0x7fd62419e330 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd6237fe640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd62419e330 0x7fd62419e7e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00bd50 tx=0x7fd61c00be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd628955640 1 -- 172.21.15.107:0/2306036299 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c019070 con 0x7fd62419e330 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.556+0000 7fd628955640 1 -- 172.21.15.107:0/2306036299 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd61c014920 con 0x7fd62419e330 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.557+0000 7fd629957640 1 -- 172.21.15.107:0/2306036299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6241a62d0 con 0x7fd62419e330 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.557+0000 7fd628955640 1 -- 172.21.15.107:0/2306036299 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c012990 con 0x7fd62419e330 2024-09-12T01:50:12.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.557+0000 7fd629957640 1 -- 172.21.15.107:0/2306036299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6241a67e0 con 0x7fd62419e330 2024-09-12T01:50:12.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.558+0000 7fd628955640 1 -- 172.21.15.107:0/2306036299 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd61c01c070 con 0x7fd62419e330 2024-09-12T01:50:12.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.558+0000 7fd628955640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd6040394f0 0x7fd60403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.558+0000 7fd629957640 1 -- 172.21.15.107:0/2306036299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd624109770 con 0x7fd62419e330 2024-09-12T01:50:12.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.558+0000 7fd628955640 1 -- 172.21.15.107:0/2306036299 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd61c04bd20 con 0x7fd62419e330 2024-09-12T01:50:12.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.558+0000 7fd622ffd640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd6040394f0 0x7fd60403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.559+0000 7fd622ffd640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd6040394f0 0x7fd60403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd614005fd0 tx=0x7fd614005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:12.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.563+0000 7fd628955640 1 -- 172.21.15.107:0/2306036299 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd61c00e0a0 con 0x7fd62419e330 2024-09-12T01:50:12.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.809+0000 7fd629957640 1 -- 172.21.15.107:0/2306036299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd6241a6b90 con 0x7fd62419e330 2024-09-12T01:50:12.810 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:12.810 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: mon.c calling monitor election 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: mon.a calling monitor election 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.811 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: monmap epoch 3 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: last_changed 2024-09-12T01:50:07.507611+0000 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: created 2024-09-12T01:48:22.017888+0000 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: min_mon_release 19 (squid) 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: election_strategy: 1 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: fsmap 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: mgrmap e13: x(active, since 51s) 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: overall HEALTH_OK 2024-09-12T01:50:12.812 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:12.813 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:12.813 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:12.813 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:12.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.810+0000 7fd628955640 1 -- 172.21.15.107:0/2306036299 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7fd61c013ba0 con 0x7fd62419e330 2024-09-12T01:50:12.813 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:50:12.813 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":3,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:50:07.507611Z","created":"2024-09-12T01:48:22.017888Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:50:12.814 INFO:teuthology.orchestra.run.smithi107.stderr:dumped monmap epoch 3 2024-09-12T01:50:12.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 -- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd6040394f0 msgr2=0x7fd60403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd6040394f0 0x7fd60403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd614005fd0 tx=0x7fd614005d50 comp rx=0 tx=0).stop 2024-09-12T01:50:12.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 -- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd62419e330 msgr2=0x7fd62419e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd62419e330 0x7fd62419e7e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00bd50 tx=0x7fd61c00be40 comp rx=0 tx=0).stop 2024-09-12T01:50:12.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 -- 172.21.15.107:0/2306036299 shutdown_connections 2024-09-12T01:50:12.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd6040394f0 0x7fd60403b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd62419e330 0x7fd62419e7e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624199a60 0x7fd62419ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 --2- 172.21.15.107:0/2306036299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd610003530 0x7fd624199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 -- 172.21.15.107:0/2306036299 >> 172.21.15.107:0/2306036299 conn(0x7fd6240fc280 msgr2=0x7fd62406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:12.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 -- 172.21.15.107:0/2306036299 shutdown_connections 2024-09-12T01:50:12.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:12.813+0000 7fd629957640 1 -- 172.21.15.107:0/2306036299 wait complete. 2024-09-12T01:50:12.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:12.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: mon.c calling monitor election 2024-09-12T01:50:12.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:12.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: mon.a calling monitor election 2024-09-12T01:50:12.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:12.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:12.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:12.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:12.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:50:12.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: monmap epoch 3 2024-09-12T01:50:12.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: last_changed 2024-09-12T01:50:07.507611+0000 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: created 2024-09-12T01:48:22.017888+0000 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: min_mon_release 19 (squid) 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: election_strategy: 1 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: fsmap 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: mgrmap e13: x(active, since 51s) 2024-09-12T01:50:12.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: overall HEALTH_OK 2024-09-12T01:50:12.845 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:12.845 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:12.845 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:12.845 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:13.409 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T01:50:13.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T01:50:13.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:13 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:13.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:13 smithi107 ceph-mon[35463]: from='client.? 172.21.15.107:0/2306036299' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:50:13.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:13 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:13.795 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:13.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:13 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:13.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:13 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/2306036299' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:50:13.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:13 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.303+0000 7efd5b000640 1 -- 172.21.15.62:0/2020213266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd54074590 msgr2=0x7efd54074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.303+0000 7efd5b000640 1 --2- 172.21.15.62:0/2020213266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd54074590 0x7efd54074970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efd48009880 tx=0x7efd4802a670 comp rx=0 tx=0).stop 2024-09-12T01:50:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.303+0000 7efd5b000640 1 -- 172.21.15.62:0/2020213266 shutdown_connections 2024-09-12T01:50:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.303+0000 7efd5b000640 1 --2- 172.21.15.62:0/2020213266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd54074590 0x7efd54074970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.303+0000 7efd5b000640 1 -- 172.21.15.62:0/2020213266 >> 172.21.15.62:0/2020213266 conn(0x7efd540fd0a0 msgr2=0x7efd540ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.303+0000 7efd5b000640 1 -- 172.21.15.62:0/2020213266 shutdown_connections 2024-09-12T01:50:14.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.303+0000 7efd5b000640 1 -- 172.21.15.62:0/2020213266 wait complete. 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.304+0000 7efd5b000640 1 Processor -- start 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.304+0000 7efd5b000640 1 -- start start 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.304+0000 7efd5b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd54074590 0x7efd541a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd5b000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd541a3ab0 0x7efd5419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd5b000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5419db80 0x7efd5419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd5b000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efd541120c0 con 0x7efd541a3ab0 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd5b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd54111f40 con 0x7efd54074590 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd5b000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efd54112240 con 0x7efd5419db80 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd59200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd541a3ab0 0x7efd5419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd59200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd541a3ab0 0x7efd5419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53548/0 (socket says 172.21.15.62:53548) 2024-09-12T01:50:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd59200640 1 -- 172.21.15.62:0/2687563867 learned_addr learned my addr 172.21.15.62:0/2687563867 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd5a600640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5419db80 0x7efd5419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd59c00640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd54074590 0x7efd541a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd59c00640 1 -- 172.21.15.62:0/2687563867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd54074590 msgr2=0x7efd541a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd59c00640 1 -- 172.21.15.62:0/2687563867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd54074590 msgr2=0x7efd541a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd59c00640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd54074590 0x7efd541a3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd59c00640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd54074590 0x7efd541a3570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd59200640 1 -- 172.21.15.62:0/2687563867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5419db80 msgr2=0x7efd5419e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.305+0000 7efd59200640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5419db80 0x7efd5419e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.306+0000 7efd59200640 1 -- 172.21.15.62:0/2687563867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd54074590 msgr2=0x7efd541a3570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.306+0000 7efd59200640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd54074590 0x7efd541a3570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.306+0000 7efd59200640 1 -- 172.21.15.62:0/2687563867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd541aa320 con 0x7efd541a3ab0 2024-09-12T01:50:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.306+0000 7efd59200640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd541a3ab0 0x7efd5419d640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd4000b520 tx=0x7efd4000b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.306+0000 7efd52000640 1 -- 172.21.15.62:0/2687563867 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40004230 con 0x7efd541a3ab0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.306+0000 7efd52000640 1 -- 172.21.15.62:0/2687563867 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd400043d0 con 0x7efd541a3ab0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.306+0000 7efd5b000640 1 -- 172.21.15.62:0/2687563867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd541aa5b0 con 0x7efd541a3ab0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.306+0000 7efd5b000640 1 -- 172.21.15.62:0/2687563867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd541aab10 con 0x7efd541a3ab0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.307+0000 7efd52000640 1 -- 172.21.15.62:0/2687563867 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40003d60 con 0x7efd541a3ab0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.308+0000 7efd52000640 1 -- 172.21.15.62:0/2687563867 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efd4000e070 con 0x7efd541a3ab0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.308+0000 7efd5b000640 1 -- 172.21.15.62:0/2687563867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd54075cd0 con 0x7efd541a3ab0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.308+0000 7efd52000640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efd3c0394f0 0x7efd3c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.308+0000 7efd52000640 1 -- 172.21.15.62:0/2687563867 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efd40010b50 con 0x7efd541a3ab0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.309+0000 7efd59c00640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efd3c0394f0 0x7efd3c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.309+0000 7efd59c00640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efd3c0394f0 0x7efd3c03b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd48005ab0 tx=0x7efd48005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.317+0000 7efd52000640 1 -- 172.21.15.62:0/2687563867 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd40014020 con 0x7efd541a3ab0 2024-09-12T01:50:14.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.544+0000 7efd5b000640 1 -- 172.21.15.62:0/2687563867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7efd541aae20 con 0x7efd541a3ab0 2024-09-12T01:50:14.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.544+0000 7efd52000640 1 -- 172.21.15.62:0/2687563867 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7efd4000ed70 con 0x7efd541a3ab0 2024-09-12T01:50:14.545 INFO:teuthology.orchestra.run.smithi062.stdout:# minimal ceph.conf for f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:50:14.545 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-09-12T01:50:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:50:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: mon_host = [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T01:50:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.546+0000 7efd5b000640 1 -- 172.21.15.62:0/2687563867 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efd3c0394f0 msgr2=0x7efd3c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.546+0000 7efd5b000640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efd3c0394f0 0x7efd3c03b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd48005ab0 tx=0x7efd48005a20 comp rx=0 tx=0).stop 2024-09-12T01:50:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.546+0000 7efd5b000640 1 -- 172.21.15.62:0/2687563867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd541a3ab0 msgr2=0x7efd5419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.546+0000 7efd5b000640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd541a3ab0 0x7efd5419d640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd4000b520 tx=0x7efd4000b9e0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.546+0000 7efd5b000640 1 -- 172.21.15.62:0/2687563867 shutdown_connections 2024-09-12T01:50:14.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.546+0000 7efd5b000640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efd3c0394f0 0x7efd3c03b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.546+0000 7efd5b000640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5419db80 0x7efd5419e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.546+0000 7efd5b000640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efd541a3ab0 0x7efd5419d640 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.546+0000 7efd5b000640 1 --2- 172.21.15.62:0/2687563867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd54074590 0x7efd541a3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.546+0000 7efd5b000640 1 -- 172.21.15.62:0/2687563867 >> 172.21.15.62:0/2687563867 conn(0x7efd540fd0a0 msgr2=0x7efd540fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.547+0000 7efd5b000640 1 -- 172.21.15.62:0/2687563867 shutdown_connections 2024-09-12T01:50:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:14.547+0000 7efd5b000640 1 -- 172.21.15.62:0/2687563867 wait complete. 2024-09-12T01:50:14.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: mon.c calling monitor election 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: mon.a calling monitor election 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:14.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: monmap epoch 3 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: last_changed 2024-09-12T01:50:07.507611+0000 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: created 2024-09-12T01:48:22.017888+0000 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: min_mon_release 19 (squid) 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: election_strategy: 1 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: fsmap 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: mgrmap e13: x(active, since 51s) 2024-09-12T01:50:14.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: overall HEALTH_OK 2024-09-12T01:50:14.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:14.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:14.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:14.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:14.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:14.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='client.? 172.21.15.107:0/2306036299' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:50:14.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:15.290 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T01:50:15.290 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:50:15.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:50:15.353 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:50:15.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:50:15.453 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:50:15.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:50:15.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: mon.b calling monitor election 2024-09-12T01:50:15.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: mon.b calling monitor election 2024-09-12T01:50:15.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: mon.a calling monitor election 2024-09-12T01:50:15.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: mon.c calling monitor election 2024-09-12T01:50:15.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:50:15.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: monmap epoch 3 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: last_changed 2024-09-12T01:50:07.507611+0000 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: created 2024-09-12T01:48:22.017888+0000 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: min_mon_release 19 (squid) 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: election_strategy: 1 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: fsmap 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: mgrmap e13: x(active, since 53s) 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: overall HEALTH_OK 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2687563867' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:15.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:15 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.480 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:50:15.481 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:50:15.547 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:50:15.547 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:50:15.571 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: mon.b calling monitor election 2024-09-12T01:50:15.571 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: mon.b calling monitor election 2024-09-12T01:50:15.571 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: mon.a calling monitor election 2024-09-12T01:50:15.571 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: mon.c calling monitor election 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: monmap epoch 3 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: last_changed 2024-09-12T01:50:07.507611+0000 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: created 2024-09-12T01:48:22.017888+0000 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: min_mon_release 19 (squid) 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: election_strategy: 1 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: fsmap 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:50:15.572 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: mgrmap e13: x(active, since 53s) 2024-09-12T01:50:15.573 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: overall HEALTH_OK 2024-09-12T01:50:15.573 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2687563867' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:15.573 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.573 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.573 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.573 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:15 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.575 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:50:15.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:50:15.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: mon.b calling monitor election 2024-09-12T01:50:15.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: mon.b calling monitor election 2024-09-12T01:50:15.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: mon.a calling monitor election 2024-09-12T01:50:15.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: mon.c calling monitor election 2024-09-12T01:50:15.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:50:15.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: monmap epoch 3 2024-09-12T01:50:15.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:50:15.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: last_changed 2024-09-12T01:50:07.507611+0000 2024-09-12T01:50:15.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: created 2024-09-12T01:48:22.017888+0000 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: min_mon_release 19 (squid) 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: election_strategy: 1 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: 1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.c 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: fsmap 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: mgrmap e13: x(active, since 53s) 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: overall HEALTH_OK 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2687563867' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.594 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:15 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:15.641 INFO:tasks.cephadm:Adding mgr.x on smithi062 2024-09-12T01:50:15.641 INFO:tasks.cephadm:Adding mgr.y on smithi077 2024-09-12T01:50:15.641 INFO:tasks.cephadm:Adding mgr.z on smithi107 2024-09-12T01:50:15.641 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi062=x;smithi077=y;smithi107=z' 2024-09-12T01:50:15.915 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:50:16.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.293+0000 7fa750906640 1 -- 172.21.15.107:0/9226346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa74c1005e0 msgr2=0x7fa74c1009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:16.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.293+0000 7fa750906640 1 --2- 172.21.15.107:0/9226346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa74c1005e0 0x7fa74c1009e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009880 tx=0x7fa73c02a5d0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.293+0000 7fa750906640 1 -- 172.21.15.107:0/9226346 shutdown_connections 2024-09-12T01:50:16.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.293+0000 7fa750906640 1 --2- 172.21.15.107:0/9226346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa74c1005e0 0x7fa74c1009e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.293+0000 7fa750906640 1 -- 172.21.15.107:0/9226346 >> 172.21.15.107:0/9226346 conn(0x7fa74c0fbdb0 msgr2=0x7fa74c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:16.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.293+0000 7fa750906640 1 -- 172.21.15.107:0/9226346 shutdown_connections 2024-09-12T01:50:16.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.293+0000 7fa750906640 1 -- 172.21.15.107:0/9226346 wait complete. 2024-09-12T01:50:16.295 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:50:16.295 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:50:16.295 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:50:16.295 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.296 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.296 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.296 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.296 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.296 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.296 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.296 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:50:16.296 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:16.296 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:50:16.297 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:16.297 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: Reconfiguring daemon mon.a on smithi062 2024-09-12T01:50:16.297 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:16.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.294+0000 7fa750906640 1 Processor -- start 2024-09-12T01:50:16.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.294+0000 7fa750906640 1 -- start start 2024-09-12T01:50:16.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.294+0000 7fa750906640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa74c1005e0 0x7fa74c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:16.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.294+0000 7fa750906640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa74c199d20 0x7fa74c19c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:16.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.294+0000 7fa750906640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa74c19c650 0x7fa74c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:16.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.294+0000 7fa750906640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c1066d0 con 0x7fa74c1005e0 2024-09-12T01:50:16.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.294+0000 7fa750906640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c106550 con 0x7fa74c199d20 2024-09-12T01:50:16.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.294+0000 7fa750906640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c106850 con 0x7fa74c19c650 2024-09-12T01:50:16.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa74c19c650 0x7fa74c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa74c19c650 0x7fa74c19eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60922/0 (socket says 172.21.15.107:60922) 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74ad9d640 1 -- 172.21.15.107:0/1354637445 learned_addr learned my addr 172.21.15.107:0/1354637445 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa749d9b640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa74c199d20 0x7fa74c19c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74a59c640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa74c1005e0 0x7fa74c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74ad9d640 1 -- 172.21.15.107:0/1354637445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa74c199d20 msgr2=0x7fa74c19c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74ad9d640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa74c199d20 0x7fa74c19c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74ad9d640 1 -- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa74c1005e0 msgr2=0x7fa74c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74ad9d640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa74c1005e0 0x7fa74c06a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74ad9d640 1 -- 172.21.15.107:0/1354637445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c19f420 con 0x7fa74c19c650 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74a59c640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa74c1005e0 0x7fa74c06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa74ad9d640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa74c19c650 0x7fa74c19eb10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa74400ba50 tx=0x7fa74400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa73b7fe640 1 -- 172.21.15.107:0/1354637445 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744019070 con 0x7fa74c19c650 2024-09-12T01:50:16.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.295+0000 7fa73b7fe640 1 -- 172.21.15.107:0/1354637445 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa74400cbe0 con 0x7fa74c19c650 2024-09-12T01:50:16.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.296+0000 7fa73b7fe640 1 -- 172.21.15.107:0/1354637445 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7440076a0 con 0x7fa74c19c650 2024-09-12T01:50:16.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.296+0000 7fa750906640 1 -- 172.21.15.107:0/1354637445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c19f6b0 con 0x7fa74c19c650 2024-09-12T01:50:16.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.296+0000 7fa750906640 1 -- 172.21.15.107:0/1354637445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c195b80 con 0x7fa74c19c650 2024-09-12T01:50:16.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.297+0000 7fa73b7fe640 1 -- 172.21.15.107:0/1354637445 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa74401c070 con 0x7fa74c19c650 2024-09-12T01:50:16.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.297+0000 7fa750906640 1 -- 172.21.15.107:0/1354637445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74c18f490 con 0x7fa74c19c650 2024-09-12T01:50:16.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.297+0000 7fa73b7fe640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa73403d900 0x7fa73403fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:16.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.297+0000 7fa73b7fe640 1 -- 172.21.15.107:0/1354637445 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa74404ba40 con 0x7fa74c19c650 2024-09-12T01:50:16.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.297+0000 7fa74a59c640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa73403d900 0x7fa73403fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:16.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.298+0000 7fa74a59c640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa73403d900 0x7fa73403fdc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa73c000c00 tx=0x7fa73c0315b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:16.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.302+0000 7fa73b7fe640 1 -- 172.21.15.107:0/1354637445 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa74404de20 con 0x7fa74c19c650 2024-09-12T01:50:16.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.479+0000 7fa750906640 1 -- 172.21.15.107:0/1354637445 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi062=x;smithi077=y;smithi107=z", "target": ["mon-mgr", ""]}) -- 0x7fa74c0626c0 con 0x7fa73403d900 2024-09-12T01:50:16.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.485+0000 7fa73b7fe640 1 -- 172.21.15.107:0/1354637445 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa74c0626c0 con 0x7fa73403d900 2024-09-12T01:50:16.486 INFO:teuthology.orchestra.run.smithi107.stdout:Scheduled mgr update... 2024-09-12T01:50:16.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.487+0000 7fa750906640 1 -- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa73403d900 msgr2=0x7fa73403fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:16.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.487+0000 7fa750906640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa73403d900 0x7fa73403fdc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa73c000c00 tx=0x7fa73c0315b0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.487+0000 7fa750906640 1 -- 172.21.15.107:0/1354637445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa74c19c650 msgr2=0x7fa74c19eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:16.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.487+0000 7fa750906640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa74c19c650 0x7fa74c19eb10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa74400ba50 tx=0x7fa74400bf10 comp rx=0 tx=0).stop 2024-09-12T01:50:16.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.487+0000 7fa750906640 1 -- 172.21.15.107:0/1354637445 shutdown_connections 2024-09-12T01:50:16.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.487+0000 7fa750906640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa73403d900 0x7fa73403fdc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.487+0000 7fa750906640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa74c19c650 0x7fa74c19eb10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.487+0000 7fa750906640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa74c199d20 0x7fa74c19c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.487+0000 7fa750906640 1 --2- 172.21.15.107:0/1354637445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa74c1005e0 0x7fa74c06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.487+0000 7fa750906640 1 -- 172.21.15.107:0/1354637445 >> 172.21.15.107:0/1354637445 conn(0x7fa74c0fbdb0 msgr2=0x7fa74c0fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:16.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.488+0000 7fa750906640 1 -- 172.21.15.107:0/1354637445 shutdown_connections 2024-09-12T01:50:16.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:50:16.488+0000 7fa750906640 1 -- 172.21.15.107:0/1354637445 wait complete. 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:50:16.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:16.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:50:16.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:16.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: Reconfiguring daemon mon.a on smithi062 2024-09-12T01:50:16.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:16.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:50:16.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:50:16.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: Reconfiguring daemon mon.a on smithi062 2024-09-12T01:50:16.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:17.101 DEBUG:teuthology.orchestra.run.smithi077:mgr.y> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T01:50:17.104 DEBUG:teuthology.orchestra.run.smithi107:mgr.z> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T01:50:17.107 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T01:50:17.107 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:50:17.107 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:50:17.142 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:50:17.143 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-09-12T01:50:17.217 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:50:17.218 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:17.218 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 638 Links: 1 2024-09-12T01:50:17.218 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:17.218 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:17.218 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 01:49:35.257281075 +0000 2024-09-12T01:50:17.218 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 01:45:00.905248951 +0000 2024-09-12T01:50:17.218 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 01:45:00.905248951 +0000 2024-09-12T01:50:17.218 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 01:45:00.905248951 +0000 2024-09-12T01:50:17.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:50:17.313 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T01:50:17.313 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T01:50:17.313 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.00029934 s, 1.7 MB/s 2024-09-12T01:50:17.317 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:50:17.356 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-09-12T01:50:17.433 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:50:17.433 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:17.433 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-12T01:50:17.434 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:17.434 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:17.434 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 01:49:35.309280239 +0000 2024-09-12T01:50:17.434 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 01:45:01.384241229 +0000 2024-09-12T01:50:17.434 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 01:45:01.384241229 +0000 2024-09-12T01:50:17.434 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 01:45:01.384241229 +0000 2024-09-12T01:50:17.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:50:17.527 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T01:50:17.527 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T01:50:17.527 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000269986 s, 1.9 MB/s 2024-09-12T01:50:17.529 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:50:17.566 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-09-12T01:50:17.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:17 smithi062 ceph-mon[30666]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:17.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:50:17.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:50:17.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:17.626 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:50:17.626 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:17.626 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-09-12T01:50:17.627 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:17.627 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:17.627 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 01:49:35.368279292 +0000 2024-09-12T01:50:17.627 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 01:45:01.978231654 +0000 2024-09-12T01:50:17.627 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 01:45:01.978231654 +0000 2024-09-12T01:50:17.627 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 01:45:01.978231654 +0000 2024-09-12T01:50:17.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:50:17.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:17 smithi107 ceph-mon[35463]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:17.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:50:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:50:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:17.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:17 smithi077 ceph-mon[35095]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:17.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:50:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:50:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:17.723 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T01:50:17.723 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T01:50:17.724 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000268999 s, 1.9 MB/s 2024-09-12T01:50:17.726 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:50:17.762 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-09-12T01:50:17.837 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:50:17.837 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:17.837 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 697 Links: 1 2024-09-12T01:50:17.837 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:17.838 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:17.838 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 01:49:35.423278408 +0000 2024-09-12T01:50:17.838 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 01:45:02.512223045 +0000 2024-09-12T01:50:17.838 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 01:45:02.512223045 +0000 2024-09-12T01:50:17.838 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 01:45:02.512223045 +0000 2024-09-12T01:50:17.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:50:17.935 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T01:50:17.935 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T01:50:17.935 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000258512 s, 2.0 MB/s 2024-09-12T01:50:17.937 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:50:17.974 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T01:50:17.974 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:50:17.994 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:50:17.994 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-09-12T01:50:18.052 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:50:18.052 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T01:50:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:18.053 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:18.053 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-12 01:50:06.963794535 +0000 2024-09-12T01:50:18.053 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-12 01:44:23.327173744 +0000 2024-09-12T01:50:18.053 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-12 01:44:23.327173744 +0000 2024-09-12T01:50:18.053 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-12 01:44:23.327173744 +0000 2024-09-12T01:50:18.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:50:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-12T01:50:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-12T01:50:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000280198 s, 1.8 MB/s 2024-09-12T01:50:18.122 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:50:18.180 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-09-12T01:50:18.237 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:50:18.238 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T01:50:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-12 01:50:06.964794514 +0000 2024-09-12T01:50:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-12 01:44:23.668166326 +0000 2024-09-12T01:50:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-12 01:44:23.668166326 +0000 2024-09-12T01:50:18.238 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-12 01:44:23.668166326 +0000 2024-09-12T01:50:18.238 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:50:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-12T01:50:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-12T01:50:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000203473 s, 2.5 MB/s 2024-09-12T01:50:18.304 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:50:18.361 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-09-12T01:50:18.418 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:50:18.418 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:18.418 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T01:50:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-12 01:50:06.964794514 +0000 2024-09-12T01:50:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-12 01:44:23.994159235 +0000 2024-09-12T01:50:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-12 01:44:23.994159235 +0000 2024-09-12T01:50:18.419 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-12 01:44:23.994159235 +0000 2024-09-12T01:50:18.419 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:50:18.482 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-12T01:50:18.482 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-12T01:50:18.482 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000222997 s, 2.3 MB/s 2024-09-12T01:50:18.483 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:50:18.540 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-09-12T01:50:18.589 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:18 smithi062 ceph-mon[30666]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi062=x;smithi077=y;smithi107=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:18.590 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:18 smithi062 ceph-mon[30666]: Saving service mgr spec with placement smithi062=x;smithi077=y;smithi107=z;count:3 2024-09-12T01:50:18.590 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:18 smithi062 ceph-mon[30666]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:50:18.590 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:18 smithi062 ceph-mon[30666]: Reconfiguring daemon mgr.x on smithi062 2024-09-12T01:50:18.596 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:50:18.596 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:18.596 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T01:50:18.596 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:18.597 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:18.597 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-12 01:50:06.964794514 +0000 2024-09-12T01:50:18.597 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-12 01:44:24.314152274 +0000 2024-09-12T01:50:18.597 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-12 01:44:24.314152274 +0000 2024-09-12T01:50:18.597 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-12 01:44:24.314152274 +0000 2024-09-12T01:50:18.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:50:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-12T01:50:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-12T01:50:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000277259 s, 1.8 MB/s 2024-09-12T01:50:18.662 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:50:18.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:18 smithi107 ceph-mon[35463]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi062=x;smithi077=y;smithi107=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:18.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:18 smithi107 ceph-mon[35463]: Saving service mgr spec with placement smithi062=x;smithi077=y;smithi107=z;count:3 2024-09-12T01:50:18.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:18 smithi107 ceph-mon[35463]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:50:18.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:18 smithi107 ceph-mon[35463]: Reconfiguring daemon mgr.x on smithi062 2024-09-12T01:50:18.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:18 smithi077 ceph-mon[35095]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi062=x;smithi077=y;smithi107=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:18.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:18 smithi077 ceph-mon[35095]: Saving service mgr spec with placement smithi062=x;smithi077=y;smithi107=z;count:3 2024-09-12T01:50:18.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:18 smithi077 ceph-mon[35095]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:50:18.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:18 smithi077 ceph-mon[35095]: Reconfiguring daemon mgr.x on smithi062 2024-09-12T01:50:18.719 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T01:50:18.719 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:50:18.739 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:50:18.739 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-09-12T01:50:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:50:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:18.797 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T01:50:18.797 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:18.798 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:18.798 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 01:49:57.718847449 +0000 2024-09-12T01:50:18.798 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 01:44:19.287784140 +0000 2024-09-12T01:50:18.798 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 01:44:19.287784140 +0000 2024-09-12T01:50:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 01:44:19.287784140 +0000 2024-09-12T01:50:18.798 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:50:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T01:50:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T01:50:18.865 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000228353 s, 2.2 MB/s 2024-09-12T01:50:18.866 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:50:18.924 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-09-12T01:50:18.981 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:50:18.982 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:18.982 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T01:50:18.982 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:18.982 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:18.982 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 01:49:57.719847431 +0000 2024-09-12T01:50:18.982 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 01:44:19.628778140 +0000 2024-09-12T01:50:18.982 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 01:44:19.628778140 +0000 2024-09-12T01:50:18.983 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 01:44:19.628778140 +0000 2024-09-12T01:50:18.983 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:50:19.047 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T01:50:19.047 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T01:50:19.047 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000273696 s, 1.9 MB/s 2024-09-12T01:50:19.048 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:50:19.106 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-09-12T01:50:19.162 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:50:19.163 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:19.163 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T01:50:19.163 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:19.163 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:19.163 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 01:49:57.719847431 +0000 2024-09-12T01:50:19.163 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 01:44:19.955772385 +0000 2024-09-12T01:50:19.163 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 01:44:19.955772385 +0000 2024-09-12T01:50:19.164 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 01:44:19.955772385 +0000 2024-09-12T01:50:19.164 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:50:19.226 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T01:50:19.226 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T01:50:19.227 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000199519 s, 2.6 MB/s 2024-09-12T01:50:19.228 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:50:19.284 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-09-12T01:50:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:50:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:50:19.340 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-12T01:50:19.340 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:50:19.340 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:50:19.341 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 01:49:57.719847431 +0000 2024-09-12T01:50:19.341 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 01:44:20.313766085 +0000 2024-09-12T01:50:19.341 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 01:44:20.313766085 +0000 2024-09-12T01:50:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 01:44:20.313766085 +0000 2024-09-12T01:50:19.341 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:50:19.413 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T01:50:19.413 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T01:50:19.413 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000216749 s, 2.4 MB/s 2024-09-12T01:50:19.415 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:50:19.471 INFO:tasks.cephadm:Deploying osd.0 on smithi062 with /dev/vg_nvme/lv_4... 2024-09-12T01:50:19.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:50:19.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:19 smithi107 ceph-mon[35463]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:19.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:19.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:19.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:19 smithi107 ceph-mon[35463]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:50:19.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:19.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:50:19.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:19.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:19 smithi107 ceph-mon[35463]: Reconfiguring daemon mon.b on smithi077 2024-09-12T01:50:19.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:19 smithi077 ceph-mon[35095]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:19.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:19.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:19.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:19 smithi077 ceph-mon[35095]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:50:19.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:19.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:50:19.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:19.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:19 smithi077 ceph-mon[35095]: Reconfiguring daemon mon.b on smithi077 2024-09-12T01:50:19.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:19 smithi062 ceph-mon[30666]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:19.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:19.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:19.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:19 smithi062 ceph-mon[30666]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:50:19.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:19.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:50:19.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:19.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:19 smithi062 ceph-mon[30666]: Reconfiguring daemon mon.b on smithi077 2024-09-12T01:50:19.842 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:21.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:20 smithi062 ceph-mon[30666]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:21.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:21.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:21.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:20 smithi062 ceph-mon[30666]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:50:21.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:21.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:50:21.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:21.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:20 smithi062 ceph-mon[30666]: Reconfiguring daemon mon.c on smithi107 2024-09-12T01:50:21.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:20 smithi107 ceph-mon[35463]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:21.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:21.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:21.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:20 smithi107 ceph-mon[35463]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:50:21.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:21.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:50:21.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:21.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:20 smithi107 ceph-mon[35463]: Reconfiguring daemon mon.c on smithi107 2024-09-12T01:50:21.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:20 smithi077 ceph-mon[35095]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:21.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:21.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:21.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:20 smithi077 ceph-mon[35095]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:50:21.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:50:21.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:50:21.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:21.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:20 smithi077 ceph-mon[35095]: Reconfiguring daemon mon.c on smithi107 2024-09-12T01:50:22.526 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:22.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:22.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:22.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:22.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:22.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:22.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:50:22.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:50:22.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:50:22.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:22.527 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:22 smithi107 ceph-mon[35463]: Deploying daemon mgr.z on smithi107 2024-09-12T01:50:22.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:22.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:22.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:22.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:22.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:22.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:22.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:50:22.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:50:22.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:50:22.528 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:22.529 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:22 smithi062 ceph-mon[30666]: Deploying daemon mgr.z on smithi107 2024-09-12T01:50:22.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:22.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:22.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:22.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:22.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:22.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:22.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:50:22.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:50:22.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:50:22.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:22.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:22 smithi077 ceph-mon[35095]: Deploying daemon mgr.z on smithi107 2024-09-12T01:50:22.799 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:50:22.832 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_4 2024-09-12T01:50:23.160 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:22 smithi107 systemd[1]: Starting Ceph mgr.z for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:50:23.198 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:23.447 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:23 smithi107 ceph-mon[35463]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:23.448 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 podman[37257]: 2024-09-12 01:50:23.062896796 +0000 UTC m=+0.015854197 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:50:23.448 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 podman[37257]: 2024-09-12 01:50:23.162063662 +0000 UTC m=+0.115021048 container create f38e15141b9569c18f6731d2bb2e23f99650fdcce647e627cafc1fedf51e19e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T01:50:23.448 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 podman[37257]: 2024-09-12 01:50:23.364742983 +0000 UTC m=+0.317700369 container init f38e15141b9569c18f6731d2bb2e23f99650fdcce647e627cafc1fedf51e19e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T01:50:23.448 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 podman[37257]: 2024-09-12 01:50:23.368200017 +0000 UTC m=+0.321157406 container start f38e15141b9569c18f6731d2bb2e23f99650fdcce647e627cafc1fedf51e19e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-12T01:50:23.448 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 ceph-mgr[37276]: -- 172.21.15.107:0/2010789095 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fd3fc3b0e0 con 0x55fd3fc19400 2024-09-12T01:50:23.448 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 bash[37257]: f38e15141b9569c18f6731d2bb2e23f99650fdcce647e627cafc1fedf51e19e8 2024-09-12T01:50:23.493 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:23 smithi062 ceph-mon[30666]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:23.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 systemd[1]: Started Ceph mgr.z for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:50:23.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:23.488+0000 7f68c9839040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:50:23.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:23.548+0000 7f68c9839040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:50:23.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:23.694+0000 7f68c9839040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:50:23.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:23 smithi077 ceph-mon[35095]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.732+0000 7fe3c7200640 1 -- 172.21.15.62:0/1293285030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0103e00 msgr2=0x7fe3c0104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.732+0000 7fe3c7200640 1 --2- 172.21.15.62:0/1293285030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0103e00 0x7fe3c0104200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009900 tx=0x7fe3b002a410 comp rx=0 tx=0).stop 2024-09-12T01:50:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.732+0000 7fe3c7200640 1 -- 172.21.15.62:0/1293285030 shutdown_connections 2024-09-12T01:50:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.732+0000 7fe3c7200640 1 --2- 172.21.15.62:0/1293285030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3c0105920 0x7fe3c010c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.732+0000 7fe3c7200640 1 --2- 172.21.15.62:0/1293285030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c0104f60 0x7fe3c01053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:23.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.732+0000 7fe3c7200640 1 --2- 172.21.15.62:0/1293285030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0103e00 0x7fe3c0104200 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.732+0000 7fe3c7200640 1 -- 172.21.15.62:0/1293285030 >> 172.21.15.62:0/1293285030 conn(0x7fe3c00ff5b0 msgr2=0x7fe3c01019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.732+0000 7fe3c7200640 1 -- 172.21.15.62:0/1293285030 shutdown_connections 2024-09-12T01:50:23.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.732+0000 7fe3c7200640 1 -- 172.21.15.62:0/1293285030 wait complete. 2024-09-12T01:50:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.733+0000 7fe3c7200640 1 Processor -- start 2024-09-12T01:50:23.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.733+0000 7fe3c7200640 1 -- start start 2024-09-12T01:50:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.733+0000 7fe3c7200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0103e00 0x7fe3c019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.733+0000 7fe3c7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3c0104f60 0x7fe3c019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3c7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c0105920 0x7fe3c01a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3c7200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c010fa90 con 0x7fe3c0103e00 2024-09-12T01:50:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3c7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c010f910 con 0x7fe3c0104f60 2024-09-12T01:50:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3c7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c010fc10 con 0x7fe3c0105920 2024-09-12T01:50:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3bfe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0103e00 0x7fe3c019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:23.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3c5200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c0105920 0x7fe3c01a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3bfe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0103e00 0x7fe3c019a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55166/0 (socket says 172.21.15.62:55166) 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3bf400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3c0104f60 0x7fe3c019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3bfe00640 1 -- 172.21.15.62:0/535864353 learned_addr learned my addr 172.21.15.62:0/535864353 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3c5200640 1 -- 172.21.15.62:0/535864353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3c0104f60 msgr2=0x7fe3c019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3c5200640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3c0104f60 0x7fe3c019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3c5200640 1 -- 172.21.15.62:0/535864353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0103e00 msgr2=0x7fe3c019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3c5200640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0103e00 0x7fe3c019a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3c5200640 1 -- 172.21.15.62:0/535864353 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c01a1ce0 con 0x7fe3c0105920 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.734+0000 7fe3bf400640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3c0104f60 0x7fe3c019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.735+0000 7fe3c5200640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c0105920 0x7fe3c01a1670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009fd0 tx=0x7fe3b800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.735+0000 7fe3bcc00640 1 -- 172.21.15.62:0/535864353 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800ce20 con 0x7fe3c0105920 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.735+0000 7fe3bcc00640 1 -- 172.21.15.62:0/535864353 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b8005020 con 0x7fe3c0105920 2024-09-12T01:50:23.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.735+0000 7fe3c7200640 1 -- 172.21.15.62:0/535864353 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c01a1fd0 con 0x7fe3c0105920 2024-09-12T01:50:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.735+0000 7fe3bcc00640 1 -- 172.21.15.62:0/535864353 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8010720 con 0x7fe3c0105920 2024-09-12T01:50:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.735+0000 7fe3c7200640 1 -- 172.21.15.62:0/535864353 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c01a2480 con 0x7fe3c0105920 2024-09-12T01:50:23.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.736+0000 7fe3bcc00640 1 -- 172.21.15.62:0/535864353 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe3b8004b20 con 0x7fe3c0105920 2024-09-12T01:50:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.736+0000 7fe3c7200640 1 -- 172.21.15.62:0/535864353 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c010b1c0 con 0x7fe3c0105920 2024-09-12T01:50:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.736+0000 7fe3bcc00640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe3a40392c0 0x7fe3a403b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.736+0000 7fe3bcc00640 1 -- 172.21.15.62:0/535864353 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe3b804ca80 con 0x7fe3c0105920 2024-09-12T01:50:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.737+0000 7fe3bfe00640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe3a40392c0 0x7fe3a403b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:23.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.737+0000 7fe3bfe00640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe3a40392c0 0x7fe3a403b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0031440 tx=0x7fe3b00315b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:23.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.742+0000 7fe3bcc00640 1 -- 172.21.15.62:0/535864353 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3b80071c0 con 0x7fe3c0105920 2024-09-12T01:50:23.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:23.935+0000 7fe3c7200640 1 -- 172.21.15.62:0/535864353 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe3c0062630 con 0x7fe3a40392c0 2024-09-12T01:50:24.045 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:23.761+0000 7f68c9839040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:50:24.045 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:23.906+0000 7f68c9839040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:50:24.046 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:24.045+0000 7f68c9839040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:50:24.613 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:24.613 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:24.613 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:24.613 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:24.613 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:50:24.613 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:50:24.613 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:50:24.614 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:24.614 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: Deploying daemon mgr.y on smithi077 2024-09-12T01:50:24.614 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:24.614 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:24.614 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:24.614 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:24.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:24.354+0000 7f68c9839040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:50:24.704 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:24.414+0000 7f68c9839040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:50:24.704 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:24.603+0000 7f68c9839040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:50:24.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:24.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:24.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:24.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:24.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:50:24.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:50:24.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:50:24.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:24.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: Deploying daemon mgr.y on smithi077 2024-09-12T01:50:24.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:24.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:24.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:24.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:50:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:50:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:50:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: Deploying daemon mgr.y on smithi077 2024-09-12T01:50:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:25.459 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:25 smithi077 systemd[1]: Starting Ceph mgr.y for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:50:25.714 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:25 smithi077 podman[36448]: 2024-09-12 01:50:25.458924321 +0000 UTC m=+0.111917085 container create e399527f2314668c9698e1f2717f1a8f5d0d0fc9688b16ad9779a0f4520efd81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T01:50:25.714 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:25 smithi077 podman[36448]: 2024-09-12 01:50:25.362271147 +0000 UTC m=+0.015263911 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:50:25.715 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:25 smithi077 podman[36448]: 2024-09-12 01:50:25.652923051 +0000 UTC m=+0.305915815 container init e399527f2314668c9698e1f2717f1a8f5d0d0fc9688b16ad9779a0f4520efd81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T01:50:25.715 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:25 smithi077 podman[36448]: 2024-09-12 01:50:25.655733315 +0000 UTC m=+0.308726079 container start e399527f2314668c9698e1f2717f1a8f5d0d0fc9688b16ad9779a0f4520efd81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:50:25.715 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:25 smithi077 ceph-mgr[36467]: -- 172.21.15.77:0/2233852469 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b7a6d0d0e0 con 0x55b7a6ceb000 2024-09-12T01:50:25.953 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:25 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:25.508+0000 7f68c9839040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:50:25.953 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:25 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:25.577+0000 7f68c9839040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:50:26.004 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:25 smithi077 bash[36448]: e399527f2314668c9698e1f2717f1a8f5d0d0fc9688b16ad9779a0f4520efd81 2024-09-12T01:50:26.004 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:25 smithi077 systemd[1]: Started Ceph mgr.y for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:50:26.005 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:25 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:25.785+0000 7fbf61d68040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:50:26.005 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:25 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:25.851+0000 7fbf61d68040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:50:26.005 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:26.004+0000 7fbf61d68040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:50:26.412 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:26.073+0000 7fbf61d68040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:50:26.413 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:26.241+0000 7fbf61d68040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:50:26.413 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:26.412+0000 7fbf61d68040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:50:26.585 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:26.321+0000 7f68c9839040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:50:26.585 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:26.440+0000 7f68c9839040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:50:26.585 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:26.585+0000 7f68c9839040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:50:26.872 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:26.650+0000 7f68c9839040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:50:26.872 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:26.802+0000 7f68c9839040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:50:26.872 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:26.871+0000 7f68c9839040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:50:26.872 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-mon[35463]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:26.873 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:26.873 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:26.873 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:26.873 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:26.873 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:26.873 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:26.988 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:26.739+0000 7fbf61d68040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:50:26.988 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:26.800+0000 7fbf61d68040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:50:26.988 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:26.987+0000 7fbf61d68040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:50:26.988 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-mon[35095]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:26.988 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:26.989 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:26.989 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:26.989 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:26.989 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:26.989 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:26 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:27.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:26 smithi062 ceph-mon[30666]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:27.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:26 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:27.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:26 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:27.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:26 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:27.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:26 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:27.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:26 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:27.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:26 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:27.171 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:26.931+0000 7f68c9839040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:50:27.171 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:27.107+0000 7f68c9839040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:50:27.171 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:27.170+0000 7f68c9839040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:50:27.443 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:27.239+0000 7f68c9839040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:50:27.443 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:27.322+0000 7f68c9839040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:50:27.444 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:27.383+0000 7f68c9839040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:50:27.444 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:27.443+0000 7f68c9839040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:50:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2813479347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20d96bd8-b481-4413-8fa6-bf7ce632c28a"}]: dispatch 2024-09-12T01:50:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20d96bd8-b481-4413-8fa6-bf7ce632c28a"}]: dispatch 2024-09-12T01:50:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20d96bd8-b481-4413-8fa6-bf7ce632c28a"}]': finished 2024-09-12T01:50:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:50:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:28.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:28.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:28.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:28.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:28.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:27 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/142929696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2813479347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20d96bd8-b481-4413-8fa6-bf7ce632c28a"}]: dispatch 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20d96bd8-b481-4413-8fa6-bf7ce632c28a"}]: dispatch 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20d96bd8-b481-4413-8fa6-bf7ce632c28a"}]': finished 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:28.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:28.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:28.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:28.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:27 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/142929696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:28.214 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:27.892+0000 7fbf61d68040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:50:28.214 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:27.960+0000 7fbf61d68040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:50:28.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2813479347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20d96bd8-b481-4413-8fa6-bf7ce632c28a"}]: dispatch 2024-09-12T01:50:28.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20d96bd8-b481-4413-8fa6-bf7ce632c28a"}]: dispatch 2024-09-12T01:50:28.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20d96bd8-b481-4413-8fa6-bf7ce632c28a"}]': finished 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:28.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:27 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/142929696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:28.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:50:28 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:50:28.222+0000 7f68c9839040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:50:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:28.828+0000 7fe3bcc00640 1 -- 172.21.15.62:0/535864353 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7fe3b8008d10 con 0x7fe3c0105920 2024-09-12T01:50:28.938 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:28.680+0000 7fbf61d68040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:50:28.938 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:28.795+0000 7fbf61d68040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:50:28.938 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:28 smithi077 ceph-mon[35095]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:28.938 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:28 smithi077 ceph-mon[35095]: Standby manager daemon z started 2024-09-12T01:50:28.938 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:28 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:50:28.939 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:28 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:50:28.939 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:28 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:50:28.939 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:28 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:50:29.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:28 smithi062 ceph-mon[30666]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:29.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:28 smithi062 ceph-mon[30666]: Standby manager daemon z started 2024-09-12T01:50:29.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:28 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:50:29.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:28 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:50:29.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:28 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:50:29.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:28 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:50:29.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:28 smithi107 ceph-mon[35463]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:29.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:28 smithi107 ceph-mon[35463]: Standby manager daemon z started 2024-09-12T01:50:29.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:28 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:50:29.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:28 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:50:29.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:28 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:50:29.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:28 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.107:0/1561045189' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:50:29.213 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:28.937+0000 7fbf61d68040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:50:29.213 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:28.998+0000 7fbf61d68040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:50:29.213 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:29.145+0000 7fbf61d68040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:50:29.213 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:29.213+0000 7fbf61d68040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:50:29.464 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:29.272+0000 7fbf61d68040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:50:29.464 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:29.428+0000 7fbf61d68040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:50:29.762 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:29.494+0000 7fbf61d68040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:50:29.762 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:29.561+0000 7fbf61d68040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:50:29.763 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:29.643+0000 7fbf61d68040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:50:29.763 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:29.703+0000 7fbf61d68040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:50:29.763 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:29.762+0000 7fbf61d68040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:50:30.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:29 smithi062 ceph-mon[30666]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-12T01:50:30.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:29 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:50:30.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:29 smithi107 ceph-mon[35463]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-12T01:50:30.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:29 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:50:30.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-mon[35095]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-12T01:50:30.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:29 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:50:30.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:30.838+0000 7fe3bcc00640 1 -- 172.21.15.62:0/535864353 <== mon.1 v2:172.21.15.107:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fe3b8017cd0 con 0x7fe3c0105920 2024-09-12T01:50:30.844 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:50:30 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:50:30.555+0000 7fbf61d68040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:50:31.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:30 smithi062 ceph-mon[30666]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:31.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:30 smithi062 ceph-mon[30666]: Standby manager daemon y started 2024-09-12T01:50:31.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:30 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:50:31.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:30 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:50:31.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:30 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:50:31.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:30 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:50:31.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:30 smithi107 ceph-mon[35463]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:31.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:30 smithi107 ceph-mon[35463]: Standby manager daemon y started 2024-09-12T01:50:31.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:30 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:50:31.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:30 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:50:31.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:30 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:50:31.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:30 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:50:31.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:30 smithi077 ceph-mon[35095]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:31.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:30 smithi077 ceph-mon[35095]: Standby manager daemon y started 2024-09-12T01:50:31.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:30 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:50:31.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:30 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:50:31.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:30 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:50:31.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:30 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.77:0/613489309' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:50:32.019 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:31 smithi062 ceph-mon[30666]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-12T01:50:32.019 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:31 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:50:32.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:31 smithi107 ceph-mon[35463]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-12T01:50:32.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:31 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:50:32.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:31 smithi077 ceph-mon[35095]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-12T01:50:32.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:31 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:50:33.163 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:32 smithi062 ceph-mon[30666]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:33.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:32 smithi107 ceph-mon[35463]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:33.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:32 smithi077 ceph-mon[35095]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:35.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:34 smithi062 ceph-mon[30666]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:35.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:34 smithi107 ceph-mon[35463]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:35.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:34 smithi077 ceph-mon[35095]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:36.164 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:35 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:50:36.164 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:35 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:36.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:35 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:50:36.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:35 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:36.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:35 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:50:36.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:35 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:37.011 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:36 smithi062 ceph-mon[30666]: Deploying daemon osd.0 on smithi062 2024-09-12T01:50:37.011 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:36 smithi062 ceph-mon[30666]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:37.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:36 smithi107 ceph-mon[35463]: Deploying daemon osd.0 on smithi062 2024-09-12T01:50:37.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:36 smithi107 ceph-mon[35463]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:37.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:36 smithi077 ceph-mon[35095]: Deploying daemon osd.0 on smithi062 2024-09-12T01:50:37.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:36 smithi077 ceph-mon[35095]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:39.073 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:38 smithi062 ceph-mon[30666]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:39.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:38 smithi107 ceph-mon[35463]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:39.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:38 smithi077 ceph-mon[35095]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:41.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:40 smithi107 ceph-mon[35463]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:41.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:40 smithi077 ceph-mon[35095]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:41.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:40 smithi062 ceph-mon[30666]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:43.133 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:42 smithi062 ceph-mon[30666]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:43.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:42 smithi107 ceph-mon[35463]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:43.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:42 smithi077 ceph-mon[35095]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:44.142 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:43 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:44.142 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:43 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:44.142 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:43 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:44.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:43 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:44.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:43 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:44.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:43 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:44.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:43 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:44.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:43 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:44.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:43 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:45.534 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:45 smithi107 ceph-mon[35463]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:45.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:45 smithi062 ceph-mon[30666]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:45.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:45 smithi077 ceph-mon[35095]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:47.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:46 smithi062 ceph-mon[30666]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:47.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:47.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:47.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:47.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:47.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:47.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:46 smithi107 ceph-mon[35463]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:47.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:47.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:47.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:47.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:47.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:47.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:46 smithi077 ceph-mon[35095]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:47.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:47.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:47.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:47.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:47.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:48.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.291+0000 7fe3bcc00640 1 -- 172.21.15.62:0/535864353 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe3c0062630 con 0x7fe3a40392c0 2024-09-12T01:50:48.291 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 0 on host 'smithi062' 2024-09-12T01:50:48.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 -- 172.21.15.62:0/535864353 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe3a40392c0 msgr2=0x7fe3a403b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:48.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe3a40392c0 0x7fe3a403b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0031440 tx=0x7fe3b00315b0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 -- 172.21.15.62:0/535864353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c0105920 msgr2=0x7fe3c01a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:48.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c0105920 0x7fe3c01a1670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009fd0 tx=0x7fe3b800ef10 comp rx=0 tx=0).stop 2024-09-12T01:50:48.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 -- 172.21.15.62:0/535864353 shutdown_connections 2024-09-12T01:50:48.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe3a40392c0 0x7fe3a403b780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3c0105920 0x7fe3c01a1670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3c0104f60 0x7fe3c019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 --2- 172.21.15.62:0/535864353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c0103e00 0x7fe3c019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 -- 172.21.15.62:0/535864353 >> 172.21.15.62:0/535864353 conn(0x7fe3c00ff5b0 msgr2=0x7fe3c0108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:48.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 -- 172.21.15.62:0/535864353 shutdown_connections 2024-09-12T01:50:48.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:50:48.293+0000 7fe3c7200640 1 -- 172.21.15.62:0/535864353 wait complete. 2024-09-12T01:50:49.015 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:48 smithi062 ceph-mon[30666]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:49.015 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:48 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:49.015 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:48 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:49.015 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:48 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:49.051 DEBUG:teuthology.orchestra.run.smithi062:osd.0> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T01:50:49.056 INFO:tasks.cephadm:Deploying osd.1 on smithi077 with /dev/vg_nvme/lv_4... 2024-09-12T01:50:49.056 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:50:49.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:48 smithi077 ceph-mon[35095]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:49.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:48 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:49.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:48 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:49.085 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:48 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:49.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:48 smithi107 ceph-mon[35463]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:49.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:48 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:49.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:48 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:49.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:48 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:49.307 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:50:49.327 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:50:49 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0[44542]: 2024-09-12T01:50:49.214+0000 7f78b3134640 -1 osd.0 0 log_to_monitors true 2024-09-12T01:50:49.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:49 smithi077 ceph-mon[35095]: from='osd.0 [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:50:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:49 smithi077 ceph-mon[35095]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:50:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:49 smithi062 ceph-mon[30666]: from='osd.0 [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:50:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:49 smithi062 ceph-mon[30666]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:50:50.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:49 smithi107 ceph-mon[35463]: from='osd.0 [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:50:50.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:49 smithi107 ceph-mon[35463]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:50:50.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:50 smithi077 ceph-mon[35095]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:50.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:50 smithi077 ceph-mon[35095]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:50:50.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:50 smithi077 ceph-mon[35095]: from='osd.0 [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:50:50.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:50 smithi077 ceph-mon[35095]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:50:50.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:50 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:50.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:50 smithi077 ceph-mon[35095]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:50:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:50 smithi062 ceph-mon[30666]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:50 smithi062 ceph-mon[30666]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:50:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:50 smithi062 ceph-mon[30666]: from='osd.0 [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:50:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:50 smithi062 ceph-mon[30666]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:50:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:50 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:50 smithi062 ceph-mon[30666]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:50:51.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:50 smithi107 ceph-mon[35463]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:51.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:50 smithi107 ceph-mon[35463]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:50:51.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:50 smithi107 ceph-mon[35463]: from='osd.0 [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:50:51.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:50 smithi107 ceph-mon[35463]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:50:51.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:50 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:51.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:50 smithi107 ceph-mon[35463]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:50:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:50:51.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_4 2024-09-12T01:50:52.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:51 smithi062 ceph-mon[30666]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:50:52.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:51 smithi062 ceph-mon[30666]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:50:52.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:51 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:52.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:51 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:52.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:51 smithi062 ceph-mon[30666]: from='osd.0 ' entity='osd.0' 2024-09-12T01:50:52.093 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:50:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0[44542]: 2024-09-12T01:50:51.621+0000 7f78ae000640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T01:50:52.093 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:50:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0[44542]: 2024-09-12T01:50:51.646+0000 7f78a4000640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:50:52.106 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:50:52.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:51 smithi107 ceph-mon[35463]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:50:52.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:51 smithi107 ceph-mon[35463]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:50:52.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:51 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:52.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:51 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:52.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:51 smithi107 ceph-mon[35463]: from='osd.0 ' entity='osd.0' 2024-09-12T01:50:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:51 smithi077 ceph-mon[35095]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:50:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:51 smithi077 ceph-mon[35095]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:50:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:51 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:51 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:51 smithi077 ceph-mon[35095]: from='osd.0 ' entity='osd.0' 2024-09-12T01:50:52.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.537+0000 7fe775356640 1 -- 172.21.15.77:0/1092967979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7701037c0 msgr2=0x7fe77010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.537+0000 7fe775356640 1 --2- 172.21.15.77:0/1092967979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7701037c0 0x7fe77010a050 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe768009ca0 tx=0x7fe76802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.537+0000 7fe775356640 1 -- 172.21.15.77:0/1092967979 shutdown_connections 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.537+0000 7fe775356640 1 --2- 172.21.15.77:0/1092967979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7701037c0 0x7fe77010a050 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.537+0000 7fe775356640 1 --2- 172.21.15.77:0/1092967979 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe770102e00 0x7fe770103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.537+0000 7fe775356640 1 --2- 172.21.15.77:0/1092967979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe770101c00 0x7fe770102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.537+0000 7fe775356640 1 -- 172.21.15.77:0/1092967979 >> 172.21.15.77:0/1092967979 conn(0x7fe7700fd390 msgr2=0x7fe7700ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.537+0000 7fe775356640 1 -- 172.21.15.77:0/1092967979 shutdown_connections 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.537+0000 7fe775356640 1 -- 172.21.15.77:0/1092967979 wait complete. 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe775356640 1 Processor -- start 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe775356640 1 -- start start 2024-09-12T01:50:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe775356640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe770101c00 0x7fe770075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe775356640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe770102e00 0x7fe7700745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe775356640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7701037c0 0x7fe770074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe775356640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe77010d8b0 con 0x7fe7701037c0 2024-09-12T01:50:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe775356640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe77010d730 con 0x7fe770101c00 2024-09-12T01:50:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe775356640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe77010da30 con 0x7fe770102e00 2024-09-12T01:50:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe76effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe770101c00 0x7fe770075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe76effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe770101c00 0x7fe770075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34970/0 (socket says 172.21.15.77:34970) 2024-09-12T01:50:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.538+0000 7fe76effd640 1 -- 172.21.15.77:0/2406687955 learned_addr learned my addr 172.21.15.77:0/2406687955 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-12T01:50:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe767fff640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe770102e00 0x7fe7700745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76f7fe640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7701037c0 0x7fe770074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76effd640 1 -- 172.21.15.77:0/2406687955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe770102e00 msgr2=0x7fe7700745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76effd640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe770102e00 0x7fe7700745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76effd640 1 -- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7701037c0 msgr2=0x7fe770074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76effd640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7701037c0 0x7fe770074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76effd640 1 -- 172.21.15.77:0/2406687955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7700753e0 con 0x7fe770101c00 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe767fff640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe770102e00 0x7fe7700745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76f7fe640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7701037c0 0x7fe770074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76effd640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe770101c00 0x7fe770075f90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe76000d770 tx=0x7fe76000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76cff9640 1 -- 172.21.15.77:0/2406687955 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760017070 con 0x7fe770101c00 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76cff9640 1 -- 172.21.15.77:0/2406687955 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe760009c30 con 0x7fe770101c00 2024-09-12T01:50:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe775356640 1 -- 172.21.15.77:0/2406687955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7701a1fa0 con 0x7fe770101c00 2024-09-12T01:50:52.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe76cff9640 1 -- 172.21.15.77:0/2406687955 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760003dd0 con 0x7fe770101c00 2024-09-12T01:50:52.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.539+0000 7fe775356640 1 -- 172.21.15.77:0/2406687955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7701a23f0 con 0x7fe770101c00 2024-09-12T01:50:52.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.540+0000 7fe775356640 1 -- 172.21.15.77:0/2406687955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe770108ed0 con 0x7fe770101c00 2024-09-12T01:50:52.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.541+0000 7fe76cff9640 1 -- 172.21.15.77:0/2406687955 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fe760003f90 con 0x7fe770101c00 2024-09-12T01:50:52.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.542+0000 7fe76cff9640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe75c0a2b70 0x7fe75c0a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:52.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.542+0000 7fe76cff9640 1 -- 172.21.15.77:0/2406687955 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fe7600ccea0 con 0x7fe770101c00 2024-09-12T01:50:52.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.542+0000 7fe767fff640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe75c0a2b70 0x7fe75c0a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:52.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.543+0000 7fe767fff640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe75c0a2b70 0x7fe75c0a5030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe770075d10 tx=0x7fe758005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:52.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.546+0000 7fe76cff9640 1 -- 172.21.15.77:0/2406687955 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe760009de0 con 0x7fe770101c00 2024-09-12T01:50:52.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:50:52.724+0000 7fe775356640 1 -- 172.21.15.77:0/2406687955 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe770062630 con 0x7fe75c0a2b70 2024-09-12T01:50:52.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:52 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:50:52.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:52 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:50:52.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:52 smithi077 ceph-mon[35095]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:52.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:52 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:52.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:52 smithi077 ceph-mon[35095]: osd.0 [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] boot 2024-09-12T01:50:52.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:52 smithi077 ceph-mon[35095]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:50:52.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:52 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:52.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:52 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:52.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:52 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:52.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:52 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:53.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:52 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:50:53.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:52 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:50:53.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:52 smithi062 ceph-mon[30666]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:53.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:52 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:53.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:52 smithi062 ceph-mon[30666]: osd.0 [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] boot 2024-09-12T01:50:53.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:52 smithi062 ceph-mon[30666]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:50:53.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:52 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:53.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:52 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:53.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:52 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:53.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:52 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:53.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:52 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:50:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:52 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:50:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:52 smithi107 ceph-mon[35463]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:50:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:52 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:52 smithi107 ceph-mon[35463]: osd.0 [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] boot 2024-09-12T01:50:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:52 smithi107 ceph-mon[35463]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:50:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:52 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:50:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:52 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:52 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:52 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:54.691 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:54.691 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi062 2024-09-12T01:50:54.691 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.691 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.692 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:54.692 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi062 to 17089M 2024-09-12T01:50:54.692 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.692 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:54.692 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:54.692 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.692 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:54 smithi077 ceph-mon[35095]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:50:54.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:54.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi062 2024-09-12T01:50:54.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:54.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi062 to 17089M 2024-09-12T01:50:54.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:54.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:54.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:54 smithi107 ceph-mon[35463]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi062 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi062 to 17089M 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:50:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:54 smithi062 ceph-mon[30666]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:50:55.574 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:55 smithi077 ceph-mon[35095]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:50:55.574 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:55 smithi077 ceph-mon[35095]: from='client.? 172.21.15.77:0/530974466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00fd72ef-fa59-4e8b-a2a2-18771c177672"}]: dispatch 2024-09-12T01:50:55.575 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:55 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00fd72ef-fa59-4e8b-a2a2-18771c177672"}]: dispatch 2024-09-12T01:50:55.575 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:55 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00fd72ef-fa59-4e8b-a2a2-18771c177672"}]': finished 2024-09-12T01:50:55.575 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:55 smithi077 ceph-mon[35095]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:50:55.575 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:50:55.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:55 smithi107 ceph-mon[35463]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:50:55.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:55 smithi107 ceph-mon[35463]: from='client.? 172.21.15.77:0/530974466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00fd72ef-fa59-4e8b-a2a2-18771c177672"}]: dispatch 2024-09-12T01:50:55.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:55 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00fd72ef-fa59-4e8b-a2a2-18771c177672"}]: dispatch 2024-09-12T01:50:55.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:55 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00fd72ef-fa59-4e8b-a2a2-18771c177672"}]': finished 2024-09-12T01:50:55.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:55 smithi107 ceph-mon[35463]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:50:55.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:50:55.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:55 smithi062 ceph-mon[30666]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:50:55.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:55 smithi062 ceph-mon[30666]: from='client.? 172.21.15.77:0/530974466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00fd72ef-fa59-4e8b-a2a2-18771c177672"}]: dispatch 2024-09-12T01:50:55.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:55 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00fd72ef-fa59-4e8b-a2a2-18771c177672"}]: dispatch 2024-09-12T01:50:55.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:55 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00fd72ef-fa59-4e8b-a2a2-18771c177672"}]': finished 2024-09-12T01:50:55.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:55 smithi062 ceph-mon[30666]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:50:55.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:50:56.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:56 smithi107 ceph-mon[35463]: from='client.? 172.21.15.77:0/3756755828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:56.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:56 smithi077 ceph-mon[35095]: from='client.? 172.21.15.77:0/3756755828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:56.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:56 smithi062 ceph-mon[30666]: from='client.? 172.21.15.77:0/3756755828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:57.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:57 smithi107 ceph-mon[35463]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:50:57.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:57 smithi077 ceph-mon[35095]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:50:57.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:57 smithi062 ceph-mon[30666]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:50:59.657 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:50:59 smithi077 ceph-mon[35095]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:50:59.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:50:59 smithi107 ceph-mon[35463]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:50:59.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:50:59 smithi062 ceph-mon[30666]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:01.641 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:01 smithi077 ceph-mon[35095]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:01.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:01 smithi107 ceph-mon[35463]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:01.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:01 smithi062 ceph-mon[30666]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:03.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:03 smithi107 ceph-mon[35463]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:51:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:03.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:03 smithi077 ceph-mon[35095]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:03.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:51:03.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:03 smithi062 ceph-mon[30666]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:51:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:04.555 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:04 smithi077 ceph-mon[35095]: Deploying daemon osd.1 on smithi077 2024-09-12T01:51:04.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:04 smithi107 ceph-mon[35463]: Deploying daemon osd.1 on smithi077 2024-09-12T01:51:04.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:04 smithi062 ceph-mon[30666]: Deploying daemon osd.1 on smithi077 2024-09-12T01:51:05.689 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:05 smithi077 ceph-mon[35095]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:05.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:05 smithi107 ceph-mon[35463]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:05.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:05 smithi062 ceph-mon[30666]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:07.547 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:07 smithi077 ceph-mon[35095]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:07.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:07 smithi107 ceph-mon[35463]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:07.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:07 smithi062 ceph-mon[30666]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:09.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:09 smithi107 ceph-mon[35463]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:09.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:09 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:09.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:09 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:09.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:09 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:09.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:09 smithi077 ceph-mon[35095]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:09.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:09 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:09.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:09 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:09.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:09 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:09.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:09 smithi062 ceph-mon[30666]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:09.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:09 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:09.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:09 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:09.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:09 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:11.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:11 smithi107 ceph-mon[35463]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:11.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:11 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:11.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:11 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:11.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:11 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:11.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:11 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:11.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:11 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:11.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:11 smithi077 ceph-mon[35095]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:11.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:11 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:11.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:11 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:11.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:11 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:11.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:11 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:11.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:11 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:11.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:11 smithi062 ceph-mon[30666]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:11.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:11 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:11.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:11 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:11.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:11 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:11.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:11 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:11.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:11 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:13.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.055+0000 7fe76cff9640 1 -- 172.21.15.77:0/2406687955 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe770062630 con 0x7fe75c0a2b70 2024-09-12T01:51:13.056 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 1 on host 'smithi077' 2024-09-12T01:51:13.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 -- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe75c0a2b70 msgr2=0x7fe75c0a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:13.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe75c0a2b70 0x7fe75c0a5030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe770075d10 tx=0x7fe758005d90 comp rx=0 tx=0).stop 2024-09-12T01:51:13.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 -- 172.21.15.77:0/2406687955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe770101c00 msgr2=0x7fe770075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:13.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe770101c00 0x7fe770075f90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe76000d770 tx=0x7fe76000dc30 comp rx=0 tx=0).stop 2024-09-12T01:51:13.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 -- 172.21.15.77:0/2406687955 shutdown_connections 2024-09-12T01:51:13.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe75c0a2b70 0x7fe75c0a5030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7701037c0 0x7fe770074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe770102e00 0x7fe7700745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 --2- 172.21.15.77:0/2406687955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe770101c00 0x7fe770075f90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 -- 172.21.15.77:0/2406687955 >> 172.21.15.77:0/2406687955 conn(0x7fe7700fd390 msgr2=0x7fe7701060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 -- 172.21.15.77:0/2406687955 shutdown_connections 2024-09-12T01:51:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:51:13.058+0000 7fe775356640 1 -- 172.21.15.77:0/2406687955 wait complete. 2024-09-12T01:51:13.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:13 smithi107 ceph-mon[35463]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:13.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:13 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:13.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:13 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:13.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:13 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:13.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:13 smithi077 ceph-mon[35095]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:13.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:13 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:13.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:13 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:13.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:13 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:13.747 DEBUG:teuthology.orchestra.run.smithi077:osd.1> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T01:51:13.750 INFO:tasks.cephadm:Deploying osd.2 on smithi107 with /dev/vg_nvme/lv_4... 2024-09-12T01:51:13.750 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:51:13.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:13 smithi062 ceph-mon[30666]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:13.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:13 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:13.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:13 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:13.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:13 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:14.001 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:51:15.430 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:15 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1[39548]: 2024-09-12T01:51:15.323+0000 7febd64a3640 -1 osd.1 0 log_to_monitors true 2024-09-12T01:51:15.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:15 smithi107 ceph-mon[35463]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:15.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:15 smithi107 ceph-mon[35463]: from='osd.1 [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:51:15.602 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:15 smithi107 ceph-mon[35463]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:51:15.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:15 smithi077 ceph-mon[35095]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:15.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:15 smithi077 ceph-mon[35095]: from='osd.1 [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:51:15.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:15 smithi077 ceph-mon[35095]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:51:15.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:15 smithi062 ceph-mon[30666]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:15.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:15 smithi062 ceph-mon[30666]: from='osd.1 [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:51:15.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:15 smithi062 ceph-mon[30666]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:51:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:51:16.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_4 2024-09-12T01:51:16.450 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:16 smithi077 ceph-mon[35095]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:51:16.451 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:16 smithi077 ceph-mon[35095]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:51:16.451 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:16.451 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:16 smithi077 ceph-mon[35095]: from='osd.1 [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:51:16.451 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:16 smithi077 ceph-mon[35095]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:51:16.451 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:16 smithi077 ceph-mon[35095]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:16.564 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:51:16.698 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:16 smithi107 ceph-mon[35463]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:51:16.698 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:16 smithi107 ceph-mon[35463]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:51:16.698 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:16.698 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:16 smithi107 ceph-mon[35463]: from='osd.1 [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:51:16.698 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:16 smithi107 ceph-mon[35463]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:51:16.698 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:16 smithi107 ceph-mon[35463]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:16.714 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:16 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1[39548]: 2024-09-12T01:51:16.450+0000 7febd2426640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T01:51:16.714 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:16 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1[39548]: 2024-09-12T01:51:16.452+0000 7febce24e640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:51:16.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:16 smithi062 ceph-mon[30666]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:51:16.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:16 smithi062 ceph-mon[30666]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:51:16.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:16.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:16 smithi062 ceph-mon[30666]: from='osd.1 [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:51:16.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:16 smithi062 ceph-mon[30666]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:51:16.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:16 smithi062 ceph-mon[30666]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:51:17.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.018+0000 7f380e136640 1 -- 172.21.15.107:0/2486072520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3808102690 msgr2=0x7f3808108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.018+0000 7f380e136640 1 --2- 172.21.15.107:0/2486072520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3808102690 0x7f3808108f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3800009ca0 tx=0x7f380002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.018+0000 7f380e136640 1 -- 172.21.15.107:0/2486072520 shutdown_connections 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.018+0000 7f380e136640 1 --2- 172.21.15.107:0/2486072520 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3808102690 0x7f3808108f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.018+0000 7f380e136640 1 --2- 172.21.15.107:0/2486072520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3808101cd0 0x7f3808102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.018+0000 7f380e136640 1 --2- 172.21.15.107:0/2486072520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3808100ad0 0x7f3808100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.018+0000 7f380e136640 1 -- 172.21.15.107:0/2486072520 >> 172.21.15.107:0/2486072520 conn(0x7f38080fc280 msgr2=0x7f38080fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.018+0000 7f380e136640 1 -- 172.21.15.107:0/2486072520 shutdown_connections 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.018+0000 7f380e136640 1 -- 172.21.15.107:0/2486072520 wait complete. 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f380e136640 1 Processor -- start 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f380e136640 1 -- start start 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f380e136640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3808100ad0 0x7f380806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f380e136640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3808101cd0 0x7f380819f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:17.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f380e136640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3808102690 0x7f38081a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:17.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f380e136640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f380810c800 con 0x7f3808101cd0 2024-09-12T01:51:17.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f380e136640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f380810c680 con 0x7f3808102690 2024-09-12T01:51:17.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f380e136640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f380810c980 con 0x7f3808100ad0 2024-09-12T01:51:17.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f38077fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3808100ad0 0x7f380806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:17.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f38077fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3808100ad0 0x7f380806aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44264/0 (socket says 172.21.15.107:44264) 2024-09-12T01:51:17.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.019+0000 7f38077fe640 1 -- 172.21.15.107:0/4072367044 learned_addr learned my addr 172.21.15.107:0/4072367044 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:51:17.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f3807fff640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3808102690 0x7f38081a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:17.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f3806ffd640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3808101cd0 0x7f380819f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:17.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f38077fe640 1 -- 172.21.15.107:0/4072367044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3808102690 msgr2=0x7f38081a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f38077fe640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3808102690 0x7f38081a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f38077fe640 1 -- 172.21.15.107:0/4072367044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3808101cd0 msgr2=0x7f380819f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f38077fe640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3808101cd0 0x7f380819f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f38077fe640 1 -- 172.21.15.107:0/4072367044 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38081a1dc0 con 0x7f3808100ad0 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f3807fff640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3808102690 0x7f38081a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f38077fe640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3808100ad0 0x7f380806aad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00b450 tx=0x7f37fc00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f3804ff9640 1 -- 172.21.15.107:0/4072367044 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc015020 con 0x7f3808100ad0 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f3804ff9640 1 -- 172.21.15.107:0/4072367044 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37fc011d70 con 0x7f3808100ad0 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f380e136640 1 -- 172.21.15.107:0/4072367044 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38081a1ff0 con 0x7f3808100ad0 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f3804ff9640 1 -- 172.21.15.107:0/4072367044 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc00f340 con 0x7f3808100ad0 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.020+0000 7f380e136640 1 -- 172.21.15.107:0/4072367044 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38081a25d0 con 0x7f3808100ad0 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.021+0000 7f380e136640 1 -- 172.21.15.107:0/4072367044 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3808107e80 con 0x7f3808100ad0 2024-09-12T01:51:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.022+0000 7f3804ff9640 1 -- 172.21.15.107:0/4072367044 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f37fc018020 con 0x7f3808100ad0 2024-09-12T01:51:17.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.023+0000 7f3804ff9640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37f00a2ba0 0x7f37f00a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:17.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.023+0000 7f3804ff9640 1 -- 172.21.15.107:0/4072367044 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f37fc0cd0f0 con 0x7f3808100ad0 2024-09-12T01:51:17.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.023+0000 7f3806ffd640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37f00a2ba0 0x7f37f00a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:17.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.024+0000 7f3806ffd640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37f00a2ba0 0x7f37f00a5060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37f8005fd0 tx=0x7f37f8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:17.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.027+0000 7f3804ff9640 1 -- 172.21.15.107:0/4072367044 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37fc01f020 con 0x7f3808100ad0 2024-09-12T01:51:17.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:17.208+0000 7f380e136640 1 -- 172.21.15.107:0/4072367044 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3808062630 con 0x7f37f00a2ba0 2024-09-12T01:51:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:51:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:51:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi077 2024-09-12T01:51:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi077 to 17088M 2024-09-12T01:51:17.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:17.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:17.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:17.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:17.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:17.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:17.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:51:17.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:51:17.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:17.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:17.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi077 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi077 to 17088M 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:17.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:17.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:51:17.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:51:17.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:17.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:17.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi077 2024-09-12T01:51:17.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:17.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi077 to 17088M 2024-09-12T01:51:17.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:17.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:17.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:17.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:17.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:17.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:17.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:18.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:18 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:51:18.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:18 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:51:18.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:18 smithi077 ceph-mon[35095]: osd.1 [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] boot 2024-09-12T01:51:18.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:18 smithi077 ceph-mon[35095]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:51:18.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:18.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:18 smithi077 ceph-mon[35095]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:18.716 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:18 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:51:18.716 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:18 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:51:18.716 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:18 smithi107 ceph-mon[35463]: osd.1 [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] boot 2024-09-12T01:51:18.716 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:18 smithi107 ceph-mon[35463]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:51:18.716 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:18.716 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:18 smithi107 ceph-mon[35463]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:18.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:18 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:51:18.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:18 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:51:18.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:18 smithi062 ceph-mon[30666]: osd.1 [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] boot 2024-09-12T01:51:18.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:18 smithi062 ceph-mon[30666]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:51:18.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:51:18.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:18 smithi062 ceph-mon[30666]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:19.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:19 smithi077 ceph-mon[35095]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T01:51:19.735 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:19 smithi107 ceph-mon[35463]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T01:51:19.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:19 smithi062 ceph-mon[30666]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T01:51:20.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:20 smithi077 ceph-mon[35095]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:20.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:20 smithi077 ceph-mon[35095]: from='client.? 172.21.15.107:0/2463870178' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8177e19a-60ca-40e1-a2b1-e7aef2bfdef9"}]: dispatch 2024-09-12T01:51:20.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:20 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8177e19a-60ca-40e1-a2b1-e7aef2bfdef9"}]: dispatch 2024-09-12T01:51:20.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:20 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8177e19a-60ca-40e1-a2b1-e7aef2bfdef9"}]': finished 2024-09-12T01:51:20.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:20 smithi077 ceph-mon[35095]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:51:20.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:20.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:20 smithi077 ceph-mon[35095]: from='client.? 172.21.15.107:0/740839531' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:20.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:20 smithi062 ceph-mon[30666]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:20.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:20 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/2463870178' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8177e19a-60ca-40e1-a2b1-e7aef2bfdef9"}]: dispatch 2024-09-12T01:51:20.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:20 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8177e19a-60ca-40e1-a2b1-e7aef2bfdef9"}]: dispatch 2024-09-12T01:51:20.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:20 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8177e19a-60ca-40e1-a2b1-e7aef2bfdef9"}]': finished 2024-09-12T01:51:20.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:20 smithi062 ceph-mon[30666]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:51:20.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:20.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:20 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/740839531' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:20.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:20 smithi107 ceph-mon[35463]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:20.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:20 smithi107 ceph-mon[35463]: from='client.? 172.21.15.107:0/2463870178' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8177e19a-60ca-40e1-a2b1-e7aef2bfdef9"}]: dispatch 2024-09-12T01:51:20.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:20 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8177e19a-60ca-40e1-a2b1-e7aef2bfdef9"}]: dispatch 2024-09-12T01:51:20.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:20 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8177e19a-60ca-40e1-a2b1-e7aef2bfdef9"}]': finished 2024-09-12T01:51:20.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:20 smithi107 ceph-mon[35463]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:51:20.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:20.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:20 smithi107 ceph-mon[35463]: from='client.? 172.21.15.107:0/740839531' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:22.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:22 smithi062 ceph-mon[30666]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:22.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:22 smithi107 ceph-mon[35463]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:22.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:22 smithi077 ceph-mon[35095]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:24.625 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:24 smithi107 ceph-mon[35463]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:24.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:24 smithi062 ceph-mon[30666]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:24.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:24 smithi077 ceph-mon[35095]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:26.837 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:26 smithi107 ceph-mon[35463]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:26 smithi062 ceph-mon[30666]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:26 smithi077 ceph-mon[35095]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:28.603 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:28 smithi107 ceph-mon[35463]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:28.603 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:28 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:51:28.603 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:28 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:28.603 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:28 smithi107 ceph-mon[35463]: Deploying daemon osd.2 on smithi107 2024-09-12T01:51:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:28 smithi062 ceph-mon[30666]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:28 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:51:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:28 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:28 smithi062 ceph-mon[30666]: Deploying daemon osd.2 on smithi107 2024-09-12T01:51:28.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:28 smithi077 ceph-mon[35095]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:28.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:28 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:51:28.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:28 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:28.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:28 smithi077 ceph-mon[35095]: Deploying daemon osd.2 on smithi107 2024-09-12T01:51:30.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:30 smithi107 ceph-mon[35463]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:30.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:30 smithi062 ceph-mon[30666]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:30.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:30 smithi077 ceph-mon[35095]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:32.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:32 smithi062 ceph-mon[30666]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:32.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:32 smithi107 ceph-mon[35463]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:32.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:32 smithi077 ceph-mon[35095]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:34.839 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:34 smithi107 ceph-mon[35463]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:34.840 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:34.840 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:34.840 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:34.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:34 smithi062 ceph-mon[30666]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:34.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:34.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:34.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:34.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:34 smithi077 ceph-mon[35095]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:34.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:34.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:34.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:36.725 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:36 smithi107 ceph-mon[35463]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:36.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:36 smithi077 ceph-mon[35095]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:36.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:36 smithi062 ceph-mon[30666]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:38.019 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:37 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:38.020 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:37 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:38.020 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:37 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:38.020 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:37 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:38.020 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:37 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:38.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:37 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:38.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:37 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:38.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:37 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:38.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:37 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:38.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:37 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:38.198 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:37 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:38.198 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:37 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:38.198 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:37 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:38.198 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:37 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:38.199 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:37 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:38.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.479+0000 7f3804ff9640 1 -- 172.21.15.107:0/4072367044 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3808062630 con 0x7f37f00a2ba0 2024-09-12T01:51:38.480 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 2 on host 'smithi107' 2024-09-12T01:51:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.481+0000 7f380e136640 1 -- 172.21.15.107:0/4072367044 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37f00a2ba0 msgr2=0x7f37f00a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.481+0000 7f380e136640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37f00a2ba0 0x7f37f00a5060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37f8005fd0 tx=0x7f37f8005850 comp rx=0 tx=0).stop 2024-09-12T01:51:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.481+0000 7f380e136640 1 -- 172.21.15.107:0/4072367044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3808100ad0 msgr2=0x7f380806aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.481+0000 7f380e136640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3808100ad0 0x7f380806aad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00b450 tx=0x7f37fc00b910 comp rx=0 tx=0).stop 2024-09-12T01:51:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.482+0000 7f380e136640 1 -- 172.21.15.107:0/4072367044 shutdown_connections 2024-09-12T01:51:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.482+0000 7f380e136640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37f00a2ba0 0x7f37f00a5060 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.482+0000 7f380e136640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3808102690 0x7f38081a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.482+0000 7f380e136640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3808101cd0 0x7f380819f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.482+0000 7f380e136640 1 --2- 172.21.15.107:0/4072367044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3808100ad0 0x7f380806aad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.482+0000 7f380e136640 1 -- 172.21.15.107:0/4072367044 >> 172.21.15.107:0/4072367044 conn(0x7f38080fc280 msgr2=0x7f3808105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.482+0000 7f380e136640 1 -- 172.21.15.107:0/4072367044 shutdown_connections 2024-09-12T01:51:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:51:38.482+0000 7f380e136640 1 -- 172.21.15.107:0/4072367044 wait complete. 2024-09-12T01:51:39.068 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:38 smithi107 ceph-mon[35463]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:39.068 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:39.068 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:39.068 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:39.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:38 smithi062 ceph-mon[30666]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:39.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:39.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:39.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:39.095 DEBUG:teuthology.orchestra.run.smithi107:osd.2> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T01:51:39.097 INFO:tasks.cephadm:Deploying osd.3 on smithi062 with /dev/vg_nvme/lv_3... 2024-09-12T01:51:39.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:51:39.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:38 smithi077 ceph-mon[35095]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:39.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:39.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:39.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:40.425 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:40 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2[40436]: 2024-09-12T01:51:40.026+0000 7ff1cb190640 -1 osd.2 0 log_to_monitors true 2024-09-12T01:51:40.967 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:40 smithi062 ceph-mon[30666]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:40.967 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:40 smithi062 ceph-mon[30666]: from='osd.2 [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:51:40.967 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:40 smithi062 ceph-mon[30666]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:51:41.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:40 smithi107 ceph-mon[35463]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:41.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:40 smithi107 ceph-mon[35463]: from='osd.2 [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:51:41.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:40 smithi107 ceph-mon[35463]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:51:41.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:40 smithi077 ceph-mon[35095]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:41.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:40 smithi077 ceph-mon[35095]: from='osd.2 [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:51:41.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:40 smithi077 ceph-mon[35095]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:51:41.898 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:41 smithi062 ceph-mon[30666]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:51:41.898 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:41 smithi062 ceph-mon[30666]: from='osd.2 [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:51:41.899 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:41 smithi062 ceph-mon[30666]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:51:41.899 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:41 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:41.899 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:41 smithi062 ceph-mon[30666]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:51:41.923 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:41 smithi107 ceph-mon[35463]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:51:41.924 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:41 smithi107 ceph-mon[35463]: from='osd.2 [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:51:41.924 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:41 smithi107 ceph-mon[35463]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:51:41.924 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:41 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:41.924 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:41 smithi107 ceph-mon[35463]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:51:41.924 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:41 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2[40436]: 2024-09-12T01:51:41.799+0000 7ff1c7113640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T01:51:41.924 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:41 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2[40436]: 2024-09-12T01:51:41.803+0000 7ff1c2f3b640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:51:42.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:41 smithi077 ceph-mon[35095]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:51:42.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:41 smithi077 ceph-mon[35095]: from='osd.2 [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:51:42.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:41 smithi077 ceph-mon[35095]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:51:42.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:41 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:42.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:41 smithi077 ceph-mon[35095]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:51:42.574 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:51:42.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_3 2024-09-12T01:51:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:51:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:51:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi107 2024-09-12T01:51:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi107 to 17087M 2024-09-12T01:51:42.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:42.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:42.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:42.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:42.982 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:43.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi107 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi107 to 17087M 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:43.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:43.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:43.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi107 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi107 to 17087M 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:43.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:43.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:43.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.545+0000 7f632b200640 1 -- 172.21.15.62:0/208636698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632c1098e0 msgr2=0x7f632c10bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.545+0000 7f632b200640 1 --2- 172.21.15.62:0/208636698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632c1098e0 0x7f632c10bd80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6324009ca0 tx=0x7f632402a940 comp rx=0 tx=0).stop 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.545+0000 7f632b200640 1 -- 172.21.15.62:0/208636698 shutdown_connections 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.545+0000 7f632b200640 1 --2- 172.21.15.62:0/208636698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632c1098e0 0x7f632c10bd80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.545+0000 7f632b200640 1 --2- 172.21.15.62:0/208636698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c074bf0 0x7f632c075050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.545+0000 7f632b200640 1 --2- 172.21.15.62:0/208636698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c0761c0 0x7f632c074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.545+0000 7f632b200640 1 -- 172.21.15.62:0/208636698 >> 172.21.15.62:0/208636698 conn(0x7f632c0fd1f0 msgr2=0x7f632c0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.545+0000 7f632b200640 1 -- 172.21.15.62:0/208636698 shutdown_connections 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.545+0000 7f632b200640 1 -- 172.21.15.62:0/208636698 wait complete. 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f632b200640 1 Processor -- start 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f632b200640 1 -- start start 2024-09-12T01:51:43.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f632b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c074bf0 0x7f632c199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f632b200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c0761c0 0x7f632c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f632b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632c1098e0 0x7f632c1a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f632b200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f632c10f8f0 con 0x7f632c0761c0 2024-09-12T01:51:43.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f632b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f632c10f770 con 0x7f632c074bf0 2024-09-12T01:51:43.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f632b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f632c10fa70 con 0x7f632c1098e0 2024-09-12T01:51:43.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f6329e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c074bf0 0x7f632c199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f6329e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c074bf0 0x7f632c199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:36772/0 (socket says 172.21.15.62:36772) 2024-09-12T01:51:43.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f632a800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632c1098e0 0x7f632c1a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.546+0000 7f6329e00640 1 -- 172.21.15.62:0/1317588483 learned_addr learned my addr 172.21.15.62:0/1317588483 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:51:43.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.547+0000 7f6329400640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c0761c0 0x7f632c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.547+0000 7f6329e00640 1 -- 172.21.15.62:0/1317588483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632c1098e0 msgr2=0x7f632c1a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:43.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.547+0000 7f6329e00640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632c1098e0 0x7f632c1a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.547+0000 7f6329e00640 1 -- 172.21.15.62:0/1317588483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c0761c0 msgr2=0x7f632c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:43.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.547+0000 7f6329e00640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c0761c0 0x7f632c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.547+0000 7f6329e00640 1 -- 172.21.15.62:0/1317588483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c1a1ad0 con 0x7f632c074bf0 2024-09-12T01:51:43.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.547+0000 7f6329e00640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c074bf0 0x7f632c199ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f631c00e9f0 tx=0x7f631c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:43.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.547+0000 7f6322a00640 1 -- 172.21.15.62:0/1317588483 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c00cd80 con 0x7f632c074bf0 2024-09-12T01:51:43.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.548+0000 7f6322a00640 1 -- 172.21.15.62:0/1317588483 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f631c010910 con 0x7f632c074bf0 2024-09-12T01:51:43.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.548+0000 7f632b200640 1 -- 172.21.15.62:0/1317588483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c1a1dc0 con 0x7f632c074bf0 2024-09-12T01:51:43.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.548+0000 7f6322a00640 1 -- 172.21.15.62:0/1317588483 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c018990 con 0x7f632c074bf0 2024-09-12T01:51:43.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.548+0000 7f632b200640 1 -- 172.21.15.62:0/1317588483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c1a2270 con 0x7f632c074bf0 2024-09-12T01:51:43.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.549+0000 7f632b200640 1 -- 172.21.15.62:0/1317588483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c1086a0 con 0x7f632c074bf0 2024-09-12T01:51:43.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.551+0000 7f6322a00640 1 -- 172.21.15.62:0/1317588483 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f631c010ac0 con 0x7f632c074bf0 2024-09-12T01:51:43.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.552+0000 7f6322a00640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63100a2ba0 0x7f63100a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.552+0000 7f6322a00640 1 -- 172.21.15.62:0/1317588483 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f631c0cdd40 con 0x7f632c074bf0 2024-09-12T01:51:43.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.552+0000 7f6329400640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63100a2ba0 0x7f63100a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.553+0000 7f6329400640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63100a2ba0 0x7f63100a5060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6318005fd0 tx=0x7f6318005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:43.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.556+0000 7f6322a00640 1 -- 172.21.15.62:0/1317588483 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f631c09c230 con 0x7f632c074bf0 2024-09-12T01:51:43.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:43.769+0000 7f632b200640 1 -- 172.21.15.62:0/1317588483 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f632c062630 con 0x7f63100a2ba0 2024-09-12T01:51:44.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:44 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:51:44.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:44 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:51:44.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:44 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:44.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:44 smithi062 ceph-mon[30666]: osd.2 [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] boot 2024-09-12T01:51:44.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:44 smithi062 ceph-mon[30666]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:51:44.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:44 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:44 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:51:44.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:44 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:51:44.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:44 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:44.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:44 smithi107 ceph-mon[35463]: osd.2 [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] boot 2024-09-12T01:51:44.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:44 smithi107 ceph-mon[35463]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:51:44.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:44 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:44 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:51:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:44 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:51:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:44 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:44 smithi077 ceph-mon[35095]: osd.2 [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] boot 2024-09-12T01:51:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:44 smithi077 ceph-mon[35095]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:51:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:44 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:51:45.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:45 smithi062 ceph-mon[30666]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:45.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:51:45.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:45 smithi062 ceph-mon[30666]: from='client.24182 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:45.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:45.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:51:45.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:45 smithi062 ceph-mon[30666]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T01:51:45.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:45.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:51:45.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:45.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:45 smithi107 ceph-mon[35463]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:45.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:45 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:51:45.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:45 smithi107 ceph-mon[35463]: from='client.24182 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:45.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:45 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:45.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:45 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:51:45.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:45 smithi107 ceph-mon[35463]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T01:51:45.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:45 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:45.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:45 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:51:45.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:45 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:45.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:45 smithi077 ceph-mon[35095]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:51:45.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:45 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:51:45.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:45 smithi077 ceph-mon[35095]: from='client.24182 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:45.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:45 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:45.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:45 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:51:45.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:45 smithi077 ceph-mon[35095]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T01:51:45.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:45 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:45.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:45 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:51:45.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:45 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:46.083 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:51:45 smithi062 sudo[49319]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:51:46.084 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:51:45 smithi062 sudo[49319]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:46.084 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:51:45 smithi062 sudo[49319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:46.084 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:51:45 smithi062 sudo[49319]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:46.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:51:46.104+0000 7f6322a00640 1 -- 172.21.15.62:0/1317588483 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f631c0981a0 con 0x7f632c074bf0 2024-09-12T01:51:46.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:51:46.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:46 smithi062 ceph-mon[30666]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T01:51:46.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:51:46.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:46 smithi107 ceph-mon[35463]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T01:51:46.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:51:46.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:46 smithi077 ceph-mon[35095]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T01:51:46.808 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:51:46 smithi062 sudo[49348]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:51:46.808 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:51:46 smithi062 sudo[49348]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:46.808 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:51:46 smithi062 sudo[49348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:46.808 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 01:51:46 smithi062 sudo[49348]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:46.917 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:46 smithi077 sudo[43695]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:51:46.917 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:46 smithi077 sudo[43695]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:46.917 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:46 smithi077 sudo[43695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:46.917 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:46 smithi077 sudo[43695]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:47.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:47 smithi077 ceph-mon[35095]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:47.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:47 smithi077 ceph-mon[35095]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:51:47.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:47 smithi077 ceph-mon[35095]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T01:51:47.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:47 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:47.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:47 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:47.215 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:46 smithi077 sudo[43698]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:51:47.215 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:46 smithi077 sudo[43698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:47.215 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:46 smithi077 sudo[43698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:47.215 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 01:51:46 smithi077 sudo[43698]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:47.450 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:47 smithi107 sudo[44372]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:51:47.450 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:47 smithi107 sudo[44372]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:47.450 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:47 smithi107 sudo[44372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:47.451 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:47 smithi107 sudo[44372]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:47.451 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:47 smithi107 ceph-mon[35463]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:47.451 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:47 smithi107 ceph-mon[35463]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:51:47.451 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:47 smithi107 ceph-mon[35463]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T01:51:47.451 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:47 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:47.451 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:47 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:47.478 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:47 smithi062 ceph-mon[30666]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:47.479 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:47 smithi062 ceph-mon[30666]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:51:47.479 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:47 smithi062 ceph-mon[30666]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T01:51:47.479 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:47 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:47.479 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:47 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:47.703 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:47 smithi107 sudo[44375]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:51:47.704 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:47 smithi107 sudo[44375]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:47.704 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:47 smithi107 sudo[44375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:47.704 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 01:51:47 smithi107 sudo[44375]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:48.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 sudo[49448]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:51:48.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 sudo[49448]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:48.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 sudo[49448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:48.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 sudo[49448]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:48.880 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2154761012' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c620376-fea1-40d0-b6e6-ba93bb6485ad"}]: dispatch 2024-09-12T01:51:48.880 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c620376-fea1-40d0-b6e6-ba93bb6485ad"}]: dispatch 2024-09-12T01:51:48.880 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c620376-fea1-40d0-b6e6-ba93bb6485ad"}]': finished 2024-09-12T01:51:48.880 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 ceph-mon[35463]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:51:48.880 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:51:48.880 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:48.880 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 ceph-mon[35463]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:51:48.880 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 sudo[44378]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:51:48.880 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 sudo[44378]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:48.881 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 sudo[44378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:48.881 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:48 smithi107 sudo[44378]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:48.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:48 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2154761012' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c620376-fea1-40d0-b6e6-ba93bb6485ad"}]: dispatch 2024-09-12T01:51:48.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:48 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c620376-fea1-40d0-b6e6-ba93bb6485ad"}]: dispatch 2024-09-12T01:51:48.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:48 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c620376-fea1-40d0-b6e6-ba93bb6485ad"}]': finished 2024-09-12T01:51:48.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:48 smithi077 ceph-mon[35095]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:51:48.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:48 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:51:48.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:48 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:48.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:48 smithi077 ceph-mon[35095]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:51:49.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 sudo[49479]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:51:49.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 sudo[49479]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:49.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 sudo[49479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:49.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 sudo[49479]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:49.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2154761012' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c620376-fea1-40d0-b6e6-ba93bb6485ad"}]: dispatch 2024-09-12T01:51:49.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5c620376-fea1-40d0-b6e6-ba93bb6485ad"}]: dispatch 2024-09-12T01:51:49.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c620376-fea1-40d0-b6e6-ba93bb6485ad"}]': finished 2024-09-12T01:51:49.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 ceph-mon[30666]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:51:49.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:51:49.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:51:49.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:48 smithi062 ceph-mon[30666]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:51:49.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 sudo[44381]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:51:49.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 sudo[44381]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:49.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 sudo[44381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:49.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 sudo[44381]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:49.612 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 sudo[43701]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:51:49.613 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 sudo[43701]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:49.613 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 sudo[43701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:49.613 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 sudo[43701]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:49.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/63682368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:51:49.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:51:49.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:51:49.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:51:49.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:51:49.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:49 smithi107 ceph-mon[35463]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:51:49.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 sudo[43704]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 sudo[43704]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 sudo[43704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 sudo[43704]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/63682368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:51:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:51:49.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:51:49.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:51:49.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:51:49.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:51:49.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:51:49.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:51:49.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:49 smithi077 ceph-mon[35095]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:51:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/63682368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:51:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:51:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:51:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:51:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:51:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:51:50.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:51:50.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:51:50.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:51:50.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:51:50.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:51:50.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:51:50.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:51:50.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:49 smithi062 ceph-mon[30666]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:51:50.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:50 smithi107 ceph-mon[35463]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:50.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:50 smithi077 ceph-mon[35095]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:50 smithi062 ceph-mon[30666]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:52.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:52 smithi062 ceph-mon[30666]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:52.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:52 smithi107 ceph-mon[35463]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:52.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:52 smithi077 ceph-mon[35095]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:51:54.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:54 smithi107 ceph-mon[35463]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-12T01:51:54.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:54 smithi077 ceph-mon[35095]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-12T01:51:54.969 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:54 smithi062 ceph-mon[30666]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-12T01:51:56.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:56 smithi107 ceph-mon[35463]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-09-12T01:51:56.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:51:56.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:56.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:56 smithi107 ceph-mon[35463]: Deploying daemon osd.3 on smithi062 2024-09-12T01:51:56.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:56 smithi077 ceph-mon[35095]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-09-12T01:51:56.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:51:56.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:56.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:56 smithi077 ceph-mon[35095]: Deploying daemon osd.3 on smithi062 2024-09-12T01:51:56.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:56 smithi062 ceph-mon[30666]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-09-12T01:51:56.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:51:56.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:56.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:56 smithi062 ceph-mon[30666]: Deploying daemon osd.3 on smithi062 2024-09-12T01:51:58.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:51:58 smithi107 ceph-mon[35463]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-12T01:51:58.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:51:58 smithi077 ceph-mon[35095]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-12T01:51:59.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:51:58 smithi062 ceph-mon[30666]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-12T01:52:00.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:00 smithi062 ceph-mon[30666]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T01:52:00.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:00 smithi107 ceph-mon[35463]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T01:52:00.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:00 smithi077 ceph-mon[35095]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T01:52:02.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:02 smithi062 ceph-mon[30666]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T01:52:02.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:02 smithi107 ceph-mon[35463]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T01:52:02.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:02 smithi077 ceph-mon[35095]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T01:52:04.925 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:04 smithi062 ceph-mon[30666]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T01:52:04.925 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:04 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:04.925 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:04 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:04.925 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:04 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:04.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:04 smithi107 ceph-mon[35463]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T01:52:04.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:04 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:04.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:04 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:04.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:04 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:04.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:04 smithi077 ceph-mon[35095]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-12T01:52:04.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:04 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:04.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:04 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:04.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:04 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:06.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:06 smithi062 ceph-mon[30666]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:06.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:06 smithi107 ceph-mon[35463]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:06.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:06 smithi077 ceph-mon[35095]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:08.268 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:08 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:08.268 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:08 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:08.268 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:08 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:08.268 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:08 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:08.268 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:08 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:08.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:08 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:08.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:08 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:08.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:08 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:08.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:08 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:08.377 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:08 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:08.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:08 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:08.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:08 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:08.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:08 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:08.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:08 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:08.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:08 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:08.749 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 3 on host 'smithi062' 2024-09-12T01:52:08.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.748+0000 7f6322a00640 1 -- 172.21.15.62:0/1317588483 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f632c062630 con 0x7f63100a2ba0 2024-09-12T01:52:08.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 -- 172.21.15.62:0/1317588483 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63100a2ba0 msgr2=0x7f63100a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63100a2ba0 0x7f63100a5060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6318005fd0 tx=0x7f6318005850 comp rx=0 tx=0).stop 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 -- 172.21.15.62:0/1317588483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c074bf0 msgr2=0x7f632c199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c074bf0 0x7f632c199ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f631c00e9f0 tx=0x7f631c00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 -- 172.21.15.62:0/1317588483 shutdown_connections 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63100a2ba0 0x7f63100a5060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f632c1098e0 0x7f632c1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f632c0761c0 0x7f632c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 --2- 172.21.15.62:0/1317588483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c074bf0 0x7f632c199ea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 -- 172.21.15.62:0/1317588483 >> 172.21.15.62:0/1317588483 conn(0x7f632c0fd1f0 msgr2=0x7f632c105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 -- 172.21.15.62:0/1317588483 shutdown_connections 2024-09-12T01:52:08.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:52:08.751+0000 7f632b200640 1 -- 172.21.15.62:0/1317588483 wait complete. 2024-09-12T01:52:09.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:09 smithi062 ceph-mon[30666]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:09.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:09 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:09.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:09 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:09.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:09 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:09 smithi107 ceph-mon[35463]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:09 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:09 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:09 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:09.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:09 smithi077 ceph-mon[35095]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:09.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:09 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:09.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:09 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:09.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:09 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:09.496 DEBUG:teuthology.orchestra.run.smithi062:osd.3> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T01:52:09.501 INFO:tasks.cephadm:Deploying osd.4 on smithi077 with /dev/vg_nvme/lv_3... 2024-09-12T01:52:09.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:52:09.753 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:52:10.141 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:10 smithi077 ceph-mon[35095]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:52:10.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:10 smithi062 ceph-mon[30666]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:52:10.341 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 01:52:10 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3[51461]: 2024-09-12T01:52:10.017+0000 7f762e436640 -1 osd.3 0 log_to_monitors true 2024-09-12T01:52:10.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:10 smithi107 ceph-mon[35463]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:52:11.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:11 smithi077 ceph-mon[35095]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:11.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:11 smithi077 ceph-mon[35095]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:52:11.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:11 smithi077 ceph-mon[35095]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:52:11.117 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:11 smithi077 ceph-mon[35095]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:52:11.117 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:11 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:11.244 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:11 smithi062 ceph-mon[30666]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:11.245 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:11 smithi062 ceph-mon[30666]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:52:11.245 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:11 smithi062 ceph-mon[30666]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:52:11.245 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:11 smithi062 ceph-mon[30666]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:52:11.245 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:11 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:11.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:11 smithi107 ceph-mon[35463]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:11.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:11 smithi107 ceph-mon[35463]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:52:11.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:11 smithi107 ceph-mon[35463]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:52:11.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:11 smithi107 ceph-mon[35463]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:52:11.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:11 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:12.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:12 smithi062 ceph-mon[30666]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:52:12.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:12 smithi062 ceph-mon[30666]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T01:52:12.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:12.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:12.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:12 smithi062 ceph-mon[30666]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T01:52:12.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:12.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:12 smithi062 ceph-mon[30666]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' 2024-09-12T01:52:12.093 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 01:52:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3[51461]: 2024-09-12T01:52:11.836+0000 7f7628c00640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T01:52:12.093 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 01:52:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3[51461]: 2024-09-12T01:52:11.861+0000 7f761ec00640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:52:12.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:12 smithi077 ceph-mon[35095]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:52:12.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:12 smithi077 ceph-mon[35095]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T01:52:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:12 smithi077 ceph-mon[35095]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T01:52:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:12 smithi077 ceph-mon[35095]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' 2024-09-12T01:52:12.223 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:52:12.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_3 2024-09-12T01:52:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:12 smithi107 ceph-mon[35463]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:52:12.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:12 smithi107 ceph-mon[35463]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T01:52:12.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:12.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:12.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:12 smithi107 ceph-mon[35463]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T01:52:12.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:12.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:12 smithi107 ceph-mon[35463]: from='osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723]' entity='osd.3' 2024-09-12T01:52:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:52:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.939+0000 7f75f5b46640 1 -- 172.21.15.77:0/1080674170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75f01026c0 msgr2=0x7f75f0108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.939+0000 7f75f5b46640 1 --2- 172.21.15.77:0/1080674170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75f01026c0 0x7f75f0108f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009ca0 tx=0x7f75e802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.939+0000 7f75f5b46640 1 -- 172.21.15.77:0/1080674170 shutdown_connections 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.939+0000 7f75f5b46640 1 --2- 172.21.15.77:0/1080674170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75f01026c0 0x7f75f0108f50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.939+0000 7f75f5b46640 1 --2- 172.21.15.77:0/1080674170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f0101d00 0x7f75f0102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.939+0000 7f75f5b46640 1 --2- 172.21.15.77:0/1080674170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f0100b00 0x7f75f0100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.939+0000 7f75f5b46640 1 -- 172.21.15.77:0/1080674170 >> 172.21.15.77:0/1080674170 conn(0x7f75f00fc270 msgr2=0x7f75f00fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.939+0000 7f75f5b46640 1 -- 172.21.15.77:0/1080674170 shutdown_connections 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.939+0000 7f75f5b46640 1 -- 172.21.15.77:0/1080674170 wait complete. 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.939+0000 7f75f5b46640 1 Processor -- start 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75f5b46640 1 -- start start 2024-09-12T01:52:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75f5b46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f0100b00 0x7f75f006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75f5b46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75f0101d00 0x7f75f019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75f5b46640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01026c0 0x7f75f019f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75f5b46640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f75f010c800 con 0x7f75f01026c0 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75f5b46640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75f010c680 con 0x7f75f0101d00 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75f5b46640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f75f010c980 con 0x7f75f0100b00 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75e7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75f0101d00 0x7f75f019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75e7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75f0101d00 0x7f75f019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39452/0 (socket says 172.21.15.77:39452) 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75e7fff640 1 -- 172.21.15.77:0/4079122579 learned_addr learned my addr 172.21.15.77:0/4079122579 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75ef7fe640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f0100b00 0x7f75f006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75effff640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01026c0 0x7f75f019f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75e7fff640 1 -- 172.21.15.77:0/4079122579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f0100b00 msgr2=0x7f75f006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75e7fff640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f0100b00 0x7f75f006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75e7fff640 1 -- 172.21.15.77:0/4079122579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01026c0 msgr2=0x7f75f019f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75e7fff640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01026c0 0x7f75f019f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75e7fff640 1 -- 172.21.15.77:0/4079122579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f019fbc0 con 0x7f75f0101d00 2024-09-12T01:52:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75e7fff640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75f0101d00 0x7f75f019cc90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c920 tx=0x7f75d800cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75ed7fa640 1 -- 172.21.15.77:0/4079122579 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8007c70 con 0x7f75f0101d00 2024-09-12T01:52:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75ed7fa640 1 -- 172.21.15.77:0/4079122579 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d8007e10 con 0x7f75f0101d00 2024-09-12T01:52:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75ed7fa640 1 -- 172.21.15.77:0/4079122579 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8018890 con 0x7f75f0101d00 2024-09-12T01:52:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75f5b46640 1 -- 172.21.15.77:0/4079122579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f019fe50 con 0x7f75f0101d00 2024-09-12T01:52:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.940+0000 7f75f5b46640 1 -- 172.21.15.77:0/4079122579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f01a03d0 con 0x7f75f0101d00 2024-09-12T01:52:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.942+0000 7f75f5b46640 1 -- 172.21.15.77:0/4079122579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f01a0660 con 0x7f75f0101d00 2024-09-12T01:52:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.942+0000 7f75ed7fa640 1 -- 172.21.15.77:0/4079122579 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f75d8018a70 con 0x7f75f0101d00 2024-09-12T01:52:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.943+0000 7f75ed7fa640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75dc0a2c00 0x7f75dc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.943+0000 7f75ed7fa640 1 -- 172.21.15.77:0/4079122579 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3702+0+0 (secure 0 0 0) 0x7f75d80cdff0 con 0x7f75f0101d00 2024-09-12T01:52:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.943+0000 7f75ef7fe640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75dc0a2c00 0x7f75dc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.944+0000 7f75ef7fe640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75dc0a2c00 0x7f75dc0a50c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75f0101b60 tx=0x7f75e0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:12.947+0000 7f75ed7fa640 1 -- 172.21.15.77:0/4079122579 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75d8014030 con 0x7f75f0101d00 2024-09-12T01:52:13.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:13.125+0000 7f75f5b46640 1 -- 172.21.15.77:0/4079122579 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f75f0062630 con 0x7f75dc0a2c00 2024-09-12T01:52:13.169 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:13 smithi077 ceph-mon[35095]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:13.169 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:13 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:52:13.170 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:13 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:52:13.170 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:13 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:13.170 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:13 smithi077 ceph-mon[35095]: osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] boot 2024-09-12T01:52:13.170 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:13 smithi077 ceph-mon[35095]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T01:52:13.170 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:13 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:13.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:13 smithi062 ceph-mon[30666]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:13.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:13 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:52:13.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:13 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:52:13.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:13 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:13.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:13 smithi062 ceph-mon[30666]: osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] boot 2024-09-12T01:52:13.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:13 smithi062 ceph-mon[30666]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T01:52:13.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:13 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:13.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:13 smithi107 ceph-mon[35463]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:52:13.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:13 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:52:13.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:13 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:52:13.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:13 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:13.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:13 smithi107 ceph-mon[35463]: osd.3 [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] boot 2024-09-12T01:52:13.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:13 smithi107 ceph-mon[35463]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T01:52:13.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:13 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:52:14.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:14.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:14.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:14.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:14.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi062 2024-09-12T01:52:14.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:14.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:14.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi062 to 8544M 2024-09-12T01:52:14.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:14.345 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:14.345 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.345 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:14 smithi062 ceph-mon[30666]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi062 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi062 to 8544M 2024-09-12T01:52:14.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:14.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:14.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:14 smithi107 ceph-mon[35463]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T01:52:14.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:14.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi062 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi062 to 8544M 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:14.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:14 smithi077 ceph-mon[35095]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T01:52:15.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:15 smithi107 ceph-mon[35463]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:15.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:15 smithi107 ceph-mon[35463]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T01:52:15.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:15 smithi077 ceph-mon[35095]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:15.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:15 smithi077 ceph-mon[35095]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T01:52:15.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:15 smithi062 ceph-mon[30666]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:15.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:15 smithi062 ceph-mon[30666]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T01:52:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:16 smithi107 ceph-mon[35463]: from='client.? 172.21.15.77:0/345429983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bf123c0-af2f-48cb-a299-10aca3199c26"}]: dispatch 2024-09-12T01:52:16.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:16 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bf123c0-af2f-48cb-a299-10aca3199c26"}]: dispatch 2024-09-12T01:52:16.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:16 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bf123c0-af2f-48cb-a299-10aca3199c26"}]': finished 2024-09-12T01:52:16.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:16 smithi107 ceph-mon[35463]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:52:16.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:16.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:16 smithi107 ceph-mon[35463]: from='client.? 172.21.15.77:0/2496242013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:16 smithi077 ceph-mon[35095]: from='client.? 172.21.15.77:0/345429983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bf123c0-af2f-48cb-a299-10aca3199c26"}]: dispatch 2024-09-12T01:52:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:16 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bf123c0-af2f-48cb-a299-10aca3199c26"}]: dispatch 2024-09-12T01:52:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:16 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bf123c0-af2f-48cb-a299-10aca3199c26"}]': finished 2024-09-12T01:52:16.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:16 smithi077 ceph-mon[35095]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:52:16.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:16.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:16 smithi077 ceph-mon[35095]: from='client.? 172.21.15.77:0/2496242013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:16 smithi062 ceph-mon[30666]: from='client.? 172.21.15.77:0/345429983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bf123c0-af2f-48cb-a299-10aca3199c26"}]: dispatch 2024-09-12T01:52:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:16 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bf123c0-af2f-48cb-a299-10aca3199c26"}]: dispatch 2024-09-12T01:52:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:16 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bf123c0-af2f-48cb-a299-10aca3199c26"}]': finished 2024-09-12T01:52:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:16 smithi062 ceph-mon[30666]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:52:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:16 smithi062 ceph-mon[30666]: from='client.? 172.21.15.77:0/2496242013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:17.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:17 smithi107 ceph-mon[35463]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:17.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:17 smithi107 ceph-mon[35463]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:52:17.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:17.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:17 smithi077 ceph-mon[35095]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:17.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:17 smithi077 ceph-mon[35095]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:52:17.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:17.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:17 smithi062 ceph-mon[30666]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:17.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:17 smithi062 ceph-mon[30666]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:52:17.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:19.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:19 smithi107 ceph-mon[35463]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:52:19.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:19 smithi077 ceph-mon[35095]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:52:19.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:19 smithi062 ceph-mon[30666]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:52:21.239 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:21 smithi077 ceph-mon[35095]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T01:52:21.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:21 smithi107 ceph-mon[35463]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T01:52:21.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:21 smithi062 ceph-mon[30666]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T01:52:23.394 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:23 smithi062 ceph-mon[30666]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:52:23.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:23 smithi107 ceph-mon[35463]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:52:23.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:23 smithi077 ceph-mon[35095]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:52:24.452 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:52:24.452 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:24.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:52:24.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:52:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:25.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:25 smithi077 ceph-mon[35095]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:52:25.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:25 smithi077 ceph-mon[35095]: Deploying daemon osd.4 on smithi077 2024-09-12T01:52:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:25 smithi107 ceph-mon[35463]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:52:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:25 smithi107 ceph-mon[35463]: Deploying daemon osd.4 on smithi077 2024-09-12T01:52:25.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:25 smithi062 ceph-mon[30666]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:52:25.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:25 smithi062 ceph-mon[30666]: Deploying daemon osd.4 on smithi077 2024-09-12T01:52:27.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:27 smithi107 ceph-mon[35463]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:52:27.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:27 smithi077 ceph-mon[35095]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:52:27.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:27 smithi062 ceph-mon[30666]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:52:29.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:29 smithi107 ceph-mon[35463]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T01:52:29.458 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:29 smithi077 ceph-mon[35095]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T01:52:29.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:29 smithi062 ceph-mon[30666]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T01:52:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:30 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:30 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:30 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:30.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:30 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:30.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:30 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:30.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:30 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:30.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:30 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:30.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:30 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:30.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:30 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:31.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:31 smithi107 ceph-mon[35463]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:31.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:31 smithi077 ceph-mon[35095]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:31.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:31 smithi062 ceph-mon[30666]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:33.456 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:33 smithi107 ceph-mon[35463]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:33.456 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:33 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:33.457 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:33 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:33.457 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:33 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:33.457 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:33 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:33.457 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:33 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:33 smithi077 ceph-mon[35095]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:33 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:33 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:33 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:33 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:33 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:33.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:33 smithi062 ceph-mon[30666]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:33.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:33 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:33.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:33 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:33.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:33 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:33.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:33 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:33.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:33 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:34.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.154+0000 7f75ed7fa640 1 -- 172.21.15.77:0/4079122579 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f75f0062630 con 0x7f75dc0a2c00 2024-09-12T01:52:34.155 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 4 on host 'smithi077' 2024-09-12T01:52:34.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 -- 172.21.15.77:0/4079122579 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75dc0a2c00 msgr2=0x7f75dc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:34.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75dc0a2c00 0x7f75dc0a50c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75f0101b60 tx=0x7f75e0008040 comp rx=0 tx=0).stop 2024-09-12T01:52:34.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 -- 172.21.15.77:0/4079122579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75f0101d00 msgr2=0x7f75f019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:34.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75f0101d00 0x7f75f019cc90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c920 tx=0x7f75d800cde0 comp rx=0 tx=0).stop 2024-09-12T01:52:34.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 -- 172.21.15.77:0/4079122579 shutdown_connections 2024-09-12T01:52:34.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75dc0a2c00 0x7f75dc0a50c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:34.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01026c0 0x7f75f019f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:34.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75f0101d00 0x7f75f019cc90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:34.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 --2- 172.21.15.77:0/4079122579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75f0100b00 0x7f75f006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:34.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 -- 172.21.15.77:0/4079122579 >> 172.21.15.77:0/4079122579 conn(0x7f75f00fc270 msgr2=0x7f75f00fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:34.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 -- 172.21.15.77:0/4079122579 shutdown_connections 2024-09-12T01:52:34.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:52:34.156+0000 7f75f5b46640 1 -- 172.21.15.77:0/4079122579 wait complete. 2024-09-12T01:52:34.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:34.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:34.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:34.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:34.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:34.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:34.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:34.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:34.859 DEBUG:teuthology.orchestra.run.smithi077:osd.4> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T01:52:34.862 INFO:tasks.cephadm:Deploying osd.5 on smithi107 with /dev/vg_nvme/lv_3... 2024-09-12T01:52:34.862 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:52:35.113 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:52:35.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:35 smithi077 ceph-mon[35095]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:35.469 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:35 smithi107 ceph-mon[35463]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:35.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:35 smithi062 ceph-mon[30666]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:36.124 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 01:52:35 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4[46448]: 2024-09-12T01:52:35.869+0000 7fc91d8fc640 -1 osd.4 0 log_to_monitors true 2024-09-12T01:52:36.451 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:36 smithi077 ceph-mon[35095]: from='osd.4 [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:52:36.451 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:36 smithi077 ceph-mon[35095]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:52:36.543 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:36 smithi107 ceph-mon[35463]: from='osd.4 [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:52:36.544 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:36 smithi107 ceph-mon[35463]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:52:36.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:36 smithi062 ceph-mon[30666]: from='osd.4 [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:52:36.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:36 smithi062 ceph-mon[30666]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:52:37.511 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:37 smithi107 ceph-mon[35463]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:37.511 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:37 smithi107 ceph-mon[35463]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:52:37.511 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:37 smithi107 ceph-mon[35463]: from='osd.4 [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:52:37.511 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:37 smithi107 ceph-mon[35463]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T01:52:37.511 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:37 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:37.511 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:37 smithi107 ceph-mon[35463]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:52:37.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:37 smithi062 ceph-mon[30666]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:37.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:37 smithi062 ceph-mon[30666]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:52:37.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:37 smithi062 ceph-mon[30666]: from='osd.4 [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:52:37.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:37 smithi062 ceph-mon[30666]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T01:52:37.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:37 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:37.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:37 smithi062 ceph-mon[30666]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:52:37.623 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:37 smithi077 ceph-mon[35095]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:37.623 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:37 smithi077 ceph-mon[35095]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:52:37.623 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:37 smithi077 ceph-mon[35095]: from='osd.4 [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:52:37.623 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:37 smithi077 ceph-mon[35095]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T01:52:37.623 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:37 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:37.623 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:37 smithi077 ceph-mon[35095]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:52:37.624 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 01:52:37 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4[46448]: 2024-09-12T01:52:37.220+0000 7fc91987f640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T01:52:37.624 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 01:52:37 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4[46448]: 2024-09-12T01:52:37.227+0000 7fc9156a7640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:52:37.726 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:52:37.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_3 2024-09-12T01:52:38.006 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:52:38.384 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:38.385 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.467+0000 7f12f4492640 1 -- 172.21.15.107:0/1914171636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ec100b10 msgr2=0x7f12ec100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.467+0000 7f12f4492640 1 --2- 172.21.15.107:0/1914171636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ec100b10 0x7f12ec100f10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009900 tx=0x7f12dc02a410 comp rx=0 tx=0).stop 2024-09-12T01:52:38.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.467+0000 7f12f4492640 1 -- 172.21.15.107:0/1914171636 shutdown_connections 2024-09-12T01:52:38.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.467+0000 7f12f4492640 1 --2- 172.21.15.107:0/1914171636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ec1026d0 0x7f12ec108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.467+0000 7f12f4492640 1 --2- 172.21.15.107:0/1914171636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12ec101d10 0x7f12ec102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.467+0000 7f12f4492640 1 --2- 172.21.15.107:0/1914171636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ec100b10 0x7f12ec100f10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.467+0000 7f12f4492640 1 -- 172.21.15.107:0/1914171636 >> 172.21.15.107:0/1914171636 conn(0x7f12ec0fc2a0 msgr2=0x7f12ec0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.467+0000 7f12f4492640 1 -- 172.21.15.107:0/1914171636 shutdown_connections 2024-09-12T01:52:38.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.467+0000 7f12f4492640 1 -- 172.21.15.107:0/1914171636 wait complete. 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f4492640 1 Processor -- start 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f4492640 1 -- start start 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f4492640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12ec100b10 0x7f12ec197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f4492640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ec101d10 0x7f12ec198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f4492640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ec1026d0 0x7f12ec19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f4492640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec10c810 con 0x7f12ec1026d0 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f4492640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec10c690 con 0x7f12ec100b10 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f4492640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec10c990 con 0x7f12ec101d10 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f1a2d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ec101d10 0x7f12ec198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f1a2d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ec101d10 0x7f12ec198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57382/0 (socket says 172.21.15.107:57382) 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f1a2d640 1 -- 172.21.15.107:0/2673967665 learned_addr learned my addr 172.21.15.107:0/2673967665 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f222e640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12ec100b10 0x7f12ec197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f1a2d640 1 -- 172.21.15.107:0/2673967665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12ec100b10 msgr2=0x7f12ec197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f1a2d640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12ec100b10 0x7f12ec197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f1a2d640 1 -- 172.21.15.107:0/2673967665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ec1026d0 msgr2=0x7f12ec19f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f1a2d640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ec1026d0 0x7f12ec19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f1a2d640 1 -- 172.21.15.107:0/2673967665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ec19fc10 con 0x7f12ec101d10 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.468+0000 7f12f1a2d640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ec101d10 0x7f12ec198520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12e800e9f0 tx=0x7f12e800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.469+0000 7f12e37fe640 1 -- 172.21.15.107:0/2673967665 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e800cd80 con 0x7f12ec101d10 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.469+0000 7f12f4492640 1 -- 172.21.15.107:0/2673967665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ec19ff00 con 0x7f12ec101d10 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.469+0000 7f12e37fe640 1 -- 172.21.15.107:0/2673967665 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e8005500 con 0x7f12ec101d10 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.469+0000 7f12e37fe640 1 -- 172.21.15.107:0/2673967665 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8010690 con 0x7f12ec101d10 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.469+0000 7f12f4492640 1 -- 172.21.15.107:0/2673967665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ec1a0430 con 0x7f12ec101d10 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.470+0000 7f12f4492640 1 -- 172.21.15.107:0/2673967665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ec1a06f0 con 0x7f12ec101d10 2024-09-12T01:52:38.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.471+0000 7f12e37fe640 1 -- 172.21.15.107:0/2673967665 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f12e80046c0 con 0x7f12ec101d10 2024-09-12T01:52:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.472+0000 7f12e37fe640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f12d80a2bb0 0x7f12d80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.472+0000 7f12e37fe640 1 -- 172.21.15.107:0/2673967665 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7f12e80ce630 con 0x7f12ec101d10 2024-09-12T01:52:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.472+0000 7f12f222e640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f12d80a2bb0 0x7f12d80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.473+0000 7f12f222e640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f12d80a2bb0 0x7f12d80a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12dc005ab0 tx=0x7f12dc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.475+0000 7f12e37fe640 1 -- 172.21.15.107:0/2673967665 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12e80541b0 con 0x7f12ec101d10 2024-09-12T01:52:38.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:52:38.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T01:52:38.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:38.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:38.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:38.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:38.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:38.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:38.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:38.648+0000 7f12f4492640 1 -- 172.21.15.107:0/2673967665 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f12ec1a08c0 con 0x7f12d80a2bb0 2024-09-12T01:52:38.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:52:38.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T01:52:38.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:38.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:38.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:38.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:38.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:38.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:38.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:38.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:39.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:52:39.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:52:39.320 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:39.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi077 2024-09-12T01:52:39.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi077 to 8544M 2024-09-12T01:52:39.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: osd.4 [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] boot 2024-09-12T01:52:39.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T01:52:39.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:39.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:39.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:39.321 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:39 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:39.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:52:39.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:52:39.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:39.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi077 2024-09-12T01:52:39.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi077 to 8544M 2024-09-12T01:52:39.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: osd.4 [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] boot 2024-09-12T01:52:39.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T01:52:39.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:39.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:39.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:39.593 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:39 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:39.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:52:39.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:52:39.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:52:39.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi077 2024-09-12T01:52:39.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi077 to 8544M 2024-09-12T01:52:39.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: osd.4 [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] boot 2024-09-12T01:52:39.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T01:52:39.716 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:52:39.716 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:39.716 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:39.716 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:39 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:40 smithi107 ceph-mon[35463]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:40.342 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:40 smithi107 ceph-mon[35463]: osdmap e34: 5 total, 5 up, 5 in 2024-09-12T01:52:40.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:40 smithi062 ceph-mon[30666]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:40.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:40 smithi062 ceph-mon[30666]: osdmap e34: 5 total, 5 up, 5 in 2024-09-12T01:52:40.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:40 smithi077 ceph-mon[35095]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:40.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:40 smithi077 ceph-mon[35095]: osdmap e34: 5 total, 5 up, 5 in 2024-09-12T01:52:41.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:41 smithi062 ceph-mon[30666]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:41.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:41 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/1001231382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a80c7a20-45c7-4e5c-8291-77a5e55959aa"}]: dispatch 2024-09-12T01:52:41.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:41 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a80c7a20-45c7-4e5c-8291-77a5e55959aa"}]: dispatch 2024-09-12T01:52:41.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:41 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a80c7a20-45c7-4e5c-8291-77a5e55959aa"}]': finished 2024-09-12T01:52:41.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:41 smithi062 ceph-mon[30666]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T01:52:41.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:41 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:52:41.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:41 smithi107 ceph-mon[35463]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:41.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:41 smithi107 ceph-mon[35463]: from='client.? 172.21.15.107:0/1001231382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a80c7a20-45c7-4e5c-8291-77a5e55959aa"}]: dispatch 2024-09-12T01:52:41.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:41 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a80c7a20-45c7-4e5c-8291-77a5e55959aa"}]: dispatch 2024-09-12T01:52:41.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:41 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a80c7a20-45c7-4e5c-8291-77a5e55959aa"}]': finished 2024-09-12T01:52:41.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:41 smithi107 ceph-mon[35463]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T01:52:41.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:41 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:52:41.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:41 smithi077 ceph-mon[35095]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:41.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:41 smithi077 ceph-mon[35095]: from='client.? 172.21.15.107:0/1001231382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a80c7a20-45c7-4e5c-8291-77a5e55959aa"}]: dispatch 2024-09-12T01:52:41.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:41 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a80c7a20-45c7-4e5c-8291-77a5e55959aa"}]: dispatch 2024-09-12T01:52:41.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:41 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a80c7a20-45c7-4e5c-8291-77a5e55959aa"}]': finished 2024-09-12T01:52:41.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:41 smithi077 ceph-mon[35095]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T01:52:41.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:41 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:52:42.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:42 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/2124175847' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:42.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:42 smithi107 ceph-mon[35463]: from='client.? 172.21.15.107:0/2124175847' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:42.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:42 smithi077 ceph-mon[35095]: from='client.? 172.21.15.107:0/2124175847' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:43.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:43 smithi062 ceph-mon[30666]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:43.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:43 smithi107 ceph-mon[35463]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:43.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:43 smithi077 ceph-mon[35095]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:45.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:45 smithi062 ceph-mon[30666]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:45.622 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:45 smithi107 ceph-mon[35463]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:45.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:45 smithi077 ceph-mon[35095]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:47.418 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:47 smithi107 ceph-mon[35463]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:47.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:47 smithi062 ceph-mon[30666]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:47 smithi077 ceph-mon[35095]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:49.379 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:49 smithi107 ceph-mon[35463]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:49.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:49 smithi062 ceph-mon[30666]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:49.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:49 smithi077 ceph-mon[35095]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:50.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:50 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:52:50.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:50 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:50.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:50 smithi107 ceph-mon[35463]: Deploying daemon osd.5 on smithi107 2024-09-12T01:52:50.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:50 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:52:50.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:50 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:50.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:50 smithi062 ceph-mon[30666]: Deploying daemon osd.5 on smithi107 2024-09-12T01:52:50.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:50 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:52:50.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:50 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:50.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:50 smithi077 ceph-mon[35095]: Deploying daemon osd.5 on smithi107 2024-09-12T01:52:51.337 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:51 smithi107 ceph-mon[35463]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:51.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:51 smithi062 ceph-mon[30666]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:51.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:51 smithi077 ceph-mon[35095]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:53.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:53 smithi107 ceph-mon[35463]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:53.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:53 smithi062 ceph-mon[30666]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:53.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:53 smithi077 ceph-mon[35095]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:55.420 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:55 smithi107 ceph-mon[35463]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:55.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:55 smithi062 ceph-mon[30666]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:55.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:55 smithi077 ceph-mon[35095]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:56.397 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:56.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:56.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:56.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:56.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:56.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:56.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:56.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:56.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:57.398 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:57 smithi107 ceph-mon[35463]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:57.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:57 smithi062 ceph-mon[30666]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:57.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:57 smithi077 ceph-mon[35095]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:59.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.144+0000 7f12e37fe640 1 -- 172.21.15.107:0/2673967665 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f12ec1a08c0 con 0x7f12d80a2bb0 2024-09-12T01:52:59.145 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 5 on host 'smithi107' 2024-09-12T01:52:59.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 -- 172.21.15.107:0/2673967665 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f12d80a2bb0 msgr2=0x7f12d80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f12d80a2bb0 0x7f12d80a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12dc005ab0 tx=0x7f12dc000bc0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 -- 172.21.15.107:0/2673967665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ec101d10 msgr2=0x7f12ec198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ec101d10 0x7f12ec198520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12e800e9f0 tx=0x7f12e800edf0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 -- 172.21.15.107:0/2673967665 shutdown_connections 2024-09-12T01:52:59.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f12d80a2bb0 0x7f12d80a5070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12ec1026d0 0x7f12ec19f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ec101d10 0x7f12ec198520 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 --2- 172.21.15.107:0/2673967665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12ec100b10 0x7f12ec197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 -- 172.21.15.107:0/2673967665 >> 172.21.15.107:0/2673967665 conn(0x7f12ec0fc2a0 msgr2=0x7f12ec06a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:59.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 -- 172.21.15.107:0/2673967665 shutdown_connections 2024-09-12T01:52:59.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:52:59.146+0000 7f12f4492640 1 -- 172.21.15.107:0/2673967665 wait complete. 2024-09-12T01:52:59.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:59 smithi107 ceph-mon[35463]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:59.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:59.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:59.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:59.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:52:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:59 smithi077 ceph-mon[35095]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:59.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:59.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:59.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:59.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:52:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:59 smithi062 ceph-mon[30666]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:52:59.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:59.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:59.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:59.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:52:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:52:59.851 DEBUG:teuthology.orchestra.run.smithi107:osd.5> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T01:52:59.853 INFO:tasks.cephadm:Deploying osd.6 on smithi062 with /dev/vg_nvme/lv_2... 2024-09-12T01:52:59.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:53:00.231 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:01.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:01 smithi107 ceph-mon[35463]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:53:01.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:01 smithi077 ceph-mon[35095]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:53:01.808 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:01 smithi062 ceph-mon[30666]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:53:02.203 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 01:53:01 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T01:53:01.779+0000 7f3011d70640 -1 osd.5 0 log_to_monitors true 2024-09-12T01:53:02.564 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:02 smithi107 ceph-mon[35463]: from='osd.5 [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:53:02.564 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:02 smithi107 ceph-mon[35463]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:53:02.683 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:02 smithi062 ceph-mon[30666]: from='osd.5 [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:53:02.684 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:02 smithi062 ceph-mon[30666]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:53:02.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:02 smithi077 ceph-mon[35095]: from='osd.5 [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:53:02.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:02 smithi077 ceph-mon[35095]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:53:03.467 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:53:03.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_2 2024-09-12T01:53:03.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:53:03.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='osd.5 [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:03.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:53:03.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:53:03.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='osd.5 [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:03.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:53:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:53:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='osd.5 [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:53:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T01:53:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:53:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:03.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:03.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:03.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:03.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:03.870 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.421+0000 7f0a2e200640 1 -- 172.21.15.62:0/3920264145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a28103e00 msgr2=0x7f0a28104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.421+0000 7f0a2e200640 1 --2- 172.21.15.62:0/3920264145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a28103e00 0x7f0a28104200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009900 tx=0x7f0a1802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.421+0000 7f0a2e200640 1 -- 172.21.15.62:0/3920264145 shutdown_connections 2024-09-12T01:53:04.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.421+0000 7f0a2e200640 1 --2- 172.21.15.62:0/3920264145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a28105920 0x7f0a2810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.421+0000 7f0a2e200640 1 --2- 172.21.15.62:0/3920264145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a28104f60 0x7f0a281053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.421+0000 7f0a2e200640 1 --2- 172.21.15.62:0/3920264145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a28103e00 0x7f0a28104200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.421+0000 7f0a2e200640 1 -- 172.21.15.62:0/3920264145 >> 172.21.15.62:0/3920264145 conn(0x7f0a280ff5b0 msgr2=0x7f0a281019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.421+0000 7f0a2e200640 1 -- 172.21.15.62:0/3920264145 shutdown_connections 2024-09-12T01:53:04.423 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 01:53:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T01:53:04.061+0000 7f300dcf3640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T01:53:04.424 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 01:53:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T01:53:04.067+0000 7f3005b13640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:53:04.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.422+0000 7f0a2e200640 1 -- 172.21.15.62:0/3920264145 wait complete. 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.423+0000 7f0a2e200640 1 Processor -- start 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.423+0000 7f0a2e200640 1 -- start start 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a2e200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a28103e00 0x7f0a2819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a2e200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a28104f60 0x7f0a2819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a2e200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a28105920 0x7f0a281a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a2e200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2810fae0 con 0x7f0a28105920 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a2e200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2810f960 con 0x7f0a28103e00 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a2e200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2810fc60 con 0x7f0a28104f60 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a27400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a28103e00 0x7f0a2819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a26a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a28104f60 0x7f0a2819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a27400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a28103e00 0x7f0a2819a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:35786/0 (socket says 172.21.15.62:35786) 2024-09-12T01:53:04.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a27400640 1 -- 172.21.15.62:0/2374140865 learned_addr learned my addr 172.21.15.62:0/2374140865 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:53:04.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a27e00640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a28105920 0x7f0a281a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a26a00640 1 -- 172.21.15.62:0/2374140865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a28103e00 msgr2=0x7f0a2819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a26a00640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a28103e00 0x7f0a2819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a26a00640 1 -- 172.21.15.62:0/2374140865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a28105920 msgr2=0x7f0a281a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a26a00640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a28105920 0x7f0a281a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.424+0000 7f0a26a00640 1 -- 172.21.15.62:0/2374140865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a281a1cd0 con 0x7f0a28104f60 2024-09-12T01:53:04.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.425+0000 7f0a26a00640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a28104f60 0x7f0a2819a5e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400e9c0 tx=0x7f0a1400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.425+0000 7f0a1fe00640 1 -- 172.21.15.62:0/2374140865 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400ccc0 con 0x7f0a28104f60 2024-09-12T01:53:04.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.425+0000 7f0a1fe00640 1 -- 172.21.15.62:0/2374140865 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a140035f0 con 0x7f0a28104f60 2024-09-12T01:53:04.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.425+0000 7f0a2e200640 1 -- 172.21.15.62:0/2374140865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a281a1fc0 con 0x7f0a28104f60 2024-09-12T01:53:04.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.426+0000 7f0a1fe00640 1 -- 172.21.15.62:0/2374140865 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400ce60 con 0x7f0a28104f60 2024-09-12T01:53:04.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.426+0000 7f0a2e200640 1 -- 172.21.15.62:0/2374140865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a281a24c0 con 0x7f0a28104f60 2024-09-12T01:53:04.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.427+0000 7f0a2e200640 1 -- 172.21.15.62:0/2374140865 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a080052c0 con 0x7f0a28104f60 2024-09-12T01:53:04.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.430+0000 7f0a1fe00640 1 -- 172.21.15.62:0/2374140865 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0a14043ae0 con 0x7f0a28104f60 2024-09-12T01:53:04.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.431+0000 7f0a1fe00640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0a0c0a2c30 0x7f0a0c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.432+0000 7f0a1fe00640 1 -- 172.21.15.62:0/2374140865 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4566+0+0 (secure 0 0 0) 0x7f0a140ce400 con 0x7f0a28104f60 2024-09-12T01:53:04.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.432+0000 7f0a27400640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0a0c0a2c30 0x7f0a0c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.432+0000 7f0a1fe00640 1 -- 172.21.15.62:0/2374140865 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a1409c160 con 0x7f0a28104f60 2024-09-12T01:53:04.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.433+0000 7f0a27400640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0a0c0a2c30 0x7f0a0c0a50f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a180096c0 tx=0x7f0a180315b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:04 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi107 2024-09-12T01:53:04.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:04 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi107 to 8543M 2024-09-12T01:53:04.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:04 smithi062 ceph-mon[30666]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:53:04.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:04 smithi062 ceph-mon[30666]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T01:53:04.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:04 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:04.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:04 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:04.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:04 smithi062 ceph-mon[30666]: from='osd.5 ' entity='osd.5' 2024-09-12T01:53:04.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:04.626+0000 7f0a2e200640 1 -- 172.21.15.62:0/2374140865 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0a08000bf0 con 0x7f0a0c0a2c30 2024-09-12T01:53:04.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:04 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi107 2024-09-12T01:53:04.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:04 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi107 to 8543M 2024-09-12T01:53:04.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:04 smithi107 ceph-mon[35463]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:53:04.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:04 smithi107 ceph-mon[35463]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T01:53:04.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:04 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:04.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:04 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:04.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:04 smithi107 ceph-mon[35463]: from='osd.5 ' entity='osd.5' 2024-09-12T01:53:04.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:04 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi107 2024-09-12T01:53:04.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:04 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi107 to 8543M 2024-09-12T01:53:04.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:04 smithi077 ceph-mon[35095]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:53:04.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:04 smithi077 ceph-mon[35095]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T01:53:04.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:04 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:04.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:04 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:04.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:04 smithi077 ceph-mon[35095]: from='osd.5 ' entity='osd.5' 2024-09-12T01:53:05.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:05 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:53:05.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:05 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:53:05.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:05 smithi062 ceph-mon[30666]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:53:05.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:05 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:05.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:05 smithi062 ceph-mon[30666]: osd.5 [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] boot 2024-09-12T01:53:05.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:05 smithi062 ceph-mon[30666]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T01:53:05.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:05 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:05.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:05 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:05.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:05 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:05.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:05 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:05.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:05 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:53:05.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:05 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:53:05.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:05 smithi107 ceph-mon[35463]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:53:05.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:05 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:05.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:05 smithi107 ceph-mon[35463]: osd.5 [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] boot 2024-09-12T01:53:05.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:05 smithi107 ceph-mon[35463]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T01:53:05.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:05 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:05.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:05 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:05.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:05 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:05.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:05 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:05.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:05 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:53:05.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:05 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:53:05.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:05 smithi077 ceph-mon[35095]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:53:05.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:05 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:05.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:05 smithi077 ceph-mon[35095]: osd.5 [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] boot 2024-09-12T01:53:05.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:05 smithi077 ceph-mon[35095]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T01:53:05.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:05 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:53:05.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:05 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:05.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:05 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:05.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:05 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:06.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:06 smithi107 ceph-mon[35463]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:06.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:06 smithi107 ceph-mon[35463]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T01:53:06.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:06 smithi107 ceph-mon[35463]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T01:53:06.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:06 smithi077 ceph-mon[35095]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:06.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:06 smithi077 ceph-mon[35095]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T01:53:06.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:06 smithi077 ceph-mon[35095]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T01:53:06.725 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:06 smithi062 ceph-mon[30666]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:06.725 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:06 smithi062 ceph-mon[30666]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T01:53:06.725 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:06 smithi062 ceph-mon[30666]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T01:53:07.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:07 smithi062 ceph-mon[30666]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:07.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:07 smithi107 ceph-mon[35463]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:07.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:07 smithi077 ceph-mon[35095]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:08.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:08 smithi077 ceph-mon[35095]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T01:53:08.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:08 smithi077 ceph-mon[35095]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:53:08.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:08 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2155365774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b148e87-4039-458c-a49c-2b632348cdf4"}]: dispatch 2024-09-12T01:53:08.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:08 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2155365774' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b148e87-4039-458c-a49c-2b632348cdf4"}]': finished 2024-09-12T01:53:08.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:08 smithi077 ceph-mon[35095]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T01:53:08.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:08 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:08.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:08 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3638891279' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:08.822 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:08 smithi107 ceph-mon[35463]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T01:53:08.822 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:08 smithi107 ceph-mon[35463]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:53:08.822 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:08 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2155365774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b148e87-4039-458c-a49c-2b632348cdf4"}]: dispatch 2024-09-12T01:53:08.822 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:08 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2155365774' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b148e87-4039-458c-a49c-2b632348cdf4"}]': finished 2024-09-12T01:53:08.823 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:08 smithi107 ceph-mon[35463]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T01:53:08.823 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:08 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:08.823 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:08 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3638891279' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:08.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:08 smithi062 ceph-mon[30666]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T01:53:08.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:08 smithi062 ceph-mon[30666]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:53:08.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:08 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2155365774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b148e87-4039-458c-a49c-2b632348cdf4"}]: dispatch 2024-09-12T01:53:08.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:08 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2155365774' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b148e87-4039-458c-a49c-2b632348cdf4"}]': finished 2024-09-12T01:53:08.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:08 smithi062 ceph-mon[30666]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T01:53:08.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:08 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:08.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:08 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3638891279' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:10.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:10 smithi062 ceph-mon[30666]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-12T01:53:10.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:10 smithi107 ceph-mon[35463]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-12T01:53:10.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:10 smithi077 ceph-mon[35095]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-12T01:53:12.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:12 smithi062 ceph-mon[30666]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:53:12.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:12 smithi107 ceph-mon[35463]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:53:12.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:12 smithi077 ceph-mon[35095]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:53:14.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:14 smithi062 ceph-mon[30666]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-12T01:53:14.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:14 smithi107 ceph-mon[35463]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-12T01:53:14.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:14 smithi077 ceph-mon[35095]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-12T01:53:16.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:16 smithi062 ceph-mon[30666]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:53:16.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:16 smithi107 ceph-mon[35463]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:53:16.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:16 smithi077 ceph-mon[35095]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:53:17.638 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:53:17.638 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:17 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:17.638 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:17 smithi062 ceph-mon[30666]: Deploying daemon osd.6 on smithi062 2024-09-12T01:53:17.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:53:17.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:17 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:17.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:17 smithi107 ceph-mon[35463]: Deploying daemon osd.6 on smithi062 2024-09-12T01:53:17.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:53:17.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:17 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:17.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:17 smithi077 ceph-mon[35095]: Deploying daemon osd.6 on smithi062 2024-09-12T01:53:18.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:18 smithi107 ceph-mon[35463]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:18.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:18 smithi077 ceph-mon[35095]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:18.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:18 smithi062 ceph-mon[30666]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:20.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:20 smithi062 ceph-mon[30666]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:20.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:20 smithi107 ceph-mon[35463]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:20.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:20 smithi077 ceph-mon[35095]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:22.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:22 smithi062 ceph-mon[30666]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:22.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:22 smithi107 ceph-mon[35463]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:22.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:22 smithi077 ceph-mon[35095]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:24.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:24 smithi062 ceph-mon[30666]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:24.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:24 smithi107 ceph-mon[35463]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:24.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:24 smithi077 ceph-mon[35095]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:25.662 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:25 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:25.662 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:25 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:25.662 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:25 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:25.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:25 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:25.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:25 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:25.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:25 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:25.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:25 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:25.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:25 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:25.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:25 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:26 smithi062 ceph-mon[30666]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:27.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:26 smithi107 ceph-mon[35463]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:27.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:26 smithi077 ceph-mon[35095]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:29.336 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:28 smithi062 ceph-mon[30666]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:29.336 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:28 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:29.336 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:28 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:29.337 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:28 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:29.337 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:28 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:29.337 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:28 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:29.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.383+0000 7f0a1fe00640 1 -- 172.21.15.62:0/2374140865 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0a08000bf0 con 0x7f0a0c0a2c30 2024-09-12T01:53:29.384 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 6 on host 'smithi062' 2024-09-12T01:53:29.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.385+0000 7f0a2e200640 1 -- 172.21.15.62:0/2374140865 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0a0c0a2c30 msgr2=0x7f0a0c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:29.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.385+0000 7f0a2e200640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0a0c0a2c30 0x7f0a0c0a50f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a180096c0 tx=0x7f0a180315b0 comp rx=0 tx=0).stop 2024-09-12T01:53:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.386+0000 7f0a2e200640 1 -- 172.21.15.62:0/2374140865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a28104f60 msgr2=0x7f0a2819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.386+0000 7f0a2e200640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a28104f60 0x7f0a2819a5e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400e9c0 tx=0x7f0a1400ee80 comp rx=0 tx=0).stop 2024-09-12T01:53:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.386+0000 7f0a2e200640 1 -- 172.21.15.62:0/2374140865 shutdown_connections 2024-09-12T01:53:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.386+0000 7f0a2e200640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0a0c0a2c30 0x7f0a0c0a50f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.386+0000 7f0a2e200640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a28105920 0x7f0a281a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.386+0000 7f0a2e200640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a28104f60 0x7f0a2819a5e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.386+0000 7f0a2e200640 1 --2- 172.21.15.62:0/2374140865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a28103e00 0x7f0a2819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.386+0000 7f0a2e200640 1 -- 172.21.15.62:0/2374140865 >> 172.21.15.62:0/2374140865 conn(0x7f0a280ff5b0 msgr2=0x7f0a28108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.386+0000 7f0a2e200640 1 -- 172.21.15.62:0/2374140865 shutdown_connections 2024-09-12T01:53:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:53:29.386+0000 7f0a2e200640 1 -- 172.21.15.62:0/2374140865 wait complete. 2024-09-12T01:53:29.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:28 smithi107 ceph-mon[35463]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:29.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:28 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:29.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:28 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:29.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:28 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:29.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:28 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:29.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:28 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:29.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:28 smithi077 ceph-mon[35095]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:29.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:28 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:29.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:28 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:29.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:28 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:29.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:28 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:29.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:28 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:30.033 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:29 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:30.033 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:29 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:30.033 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:29 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:30.080 DEBUG:teuthology.orchestra.run.smithi062:osd.6> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T01:53:30.084 INFO:tasks.cephadm:Deploying osd.7 on smithi077 with /dev/vg_nvme/lv_2... 2024-09-12T01:53:30.084 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:53:30.337 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:53:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:29 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:29 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:29 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:30.458 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:29 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:30.458 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:29 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:30.458 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:29 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:31.092 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 01:53:30 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T01:53:30.737+0000 7fa08d645640 -1 osd.6 0 log_to_monitors true 2024-09-12T01:53:31.667 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:31 smithi062 ceph-mon[30666]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:31.667 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:31 smithi062 ceph-mon[30666]: from='osd.6 [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:53:31.667 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:31 smithi062 ceph-mon[30666]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:53:31.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:31 smithi107 ceph-mon[35463]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:31.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:31 smithi107 ceph-mon[35463]: from='osd.6 [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:53:31.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:31 smithi107 ceph-mon[35463]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:53:31.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:31 smithi077 ceph-mon[35095]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:31.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:31 smithi077 ceph-mon[35095]: from='osd.6 [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:53:31.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:31 smithi077 ceph-mon[35095]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:53:32.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:32 smithi107 ceph-mon[35463]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:53:32.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:32 smithi107 ceph-mon[35463]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T01:53:32.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:32 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:32.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:32 smithi107 ceph-mon[35463]: from='osd.6 [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:53:32.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:32 smithi107 ceph-mon[35463]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:53:32.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:32 smithi077 ceph-mon[35095]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:53:32.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:32 smithi077 ceph-mon[35095]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T01:53:32.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:32 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:32.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:32 smithi077 ceph-mon[35095]: from='osd.6 [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:53:32.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:32 smithi077 ceph-mon[35095]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:53:32.825 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 01:53:32 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T01:53:32.407+0000 7fa087e00640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T01:53:32.825 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 01:53:32 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T01:53:32.418+0000 7fa082e00640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:53:32.825 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:32 smithi062 ceph-mon[30666]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:53:32.825 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:32 smithi062 ceph-mon[30666]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T01:53:32.825 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:32 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:32.825 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:32 smithi062 ceph-mon[30666]: from='osd.6 [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:53:32.825 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:32 smithi062 ceph-mon[30666]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:53:33.057 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:53:33.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_2 2024-09-12T01:53:33.329 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:53:33.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:33 smithi062 ceph-mon[30666]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:33.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:33 smithi062 ceph-mon[30666]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:53:33.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:33 smithi062 ceph-mon[30666]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T01:53:33.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:33 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:33.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:33 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:33.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:33 smithi107 ceph-mon[35463]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:33.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:33 smithi107 ceph-mon[35463]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:53:33.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:33 smithi107 ceph-mon[35463]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T01:53:33.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:33 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:33.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:33 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:33.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:33 smithi077 ceph-mon[35095]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:33.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:33 smithi077 ceph-mon[35095]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:53:33.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:33 smithi077 ceph-mon[35095]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T01:53:33.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:33 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:33.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:33 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:33.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.800+0000 7f2a0495d640 1 -- 172.21.15.77:0/4159523452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a00105030 msgr2=0x7f2a00107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:33.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.800+0000 7f2a0495d640 1 --2- 172.21.15.77:0/4159523452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a00105030 0x7f2a00107420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009900 tx=0x7f29f402a410 comp rx=0 tx=0).stop 2024-09-12T01:53:33.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.800+0000 7f2a0495d640 1 -- 172.21.15.77:0/4159523452 shutdown_connections 2024-09-12T01:53:33.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.800+0000 7f2a0495d640 1 --2- 172.21.15.77:0/4159523452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00107960 0x7f2a00109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:33.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.800+0000 7f2a0495d640 1 --2- 172.21.15.77:0/4159523452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a00105030 0x7f2a00107420 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:33.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.800+0000 7f2a0495d640 1 --2- 172.21.15.77:0/4159523452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a00102700 0x7f2a00104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.800+0000 7f2a0495d640 1 -- 172.21.15.77:0/4159523452 >> 172.21.15.77:0/4159523452 conn(0x7f2a000fc2a0 msgr2=0x7f2a000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.800+0000 7f2a0495d640 1 -- 172.21.15.77:0/4159523452 shutdown_connections 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.800+0000 7f2a0495d640 1 -- 172.21.15.77:0/4159523452 wait complete. 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f2a0495d640 1 Processor -- start 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f2a0495d640 1 -- start start 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f2a0495d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a00102700 0x7f2a00197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f2a0495d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00105030 0x7f2a00198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f2a0495d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a00107960 0x7f2a0019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f2a0495d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0010d870 con 0x7f2a00107960 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f2a0495d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0010d6f0 con 0x7f2a00102700 2024-09-12T01:53:33.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f2a0495d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0010d9f0 con 0x7f2a00105030 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f29fe59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a00102700 0x7f2a00197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f29fe59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a00102700 0x7f2a00197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39862/0 (socket says 172.21.15.77:39862) 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f29fe59c640 1 -- 172.21.15.77:0/1845635199 learned_addr learned my addr 172.21.15.77:0/1845635199 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.801+0000 7f29fed9d640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a00107960 0x7f2a0019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29fdd9b640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00105030 0x7f2a00198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29fe59c640 1 -- 172.21.15.77:0/1845635199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00105030 msgr2=0x7f2a00198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29fe59c640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00105030 0x7f2a00198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29fe59c640 1 -- 172.21.15.77:0/1845635199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a00107960 msgr2=0x7f2a0019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29fe59c640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a00107960 0x7f2a0019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29fe59c640 1 -- 172.21.15.77:0/1845635199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0019fb10 con 0x7f2a00102700 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29fdd9b640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00105030 0x7f2a00198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:33.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29fe59c640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a00102700 0x7f2a00197ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c920 tx=0x7f29f000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29ef7fe640 1 -- 172.21.15.77:0/1845635199 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0007c70 con 0x7f2a00102700 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29ef7fe640 1 -- 172.21.15.77:0/1845635199 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29f0007e10 con 0x7f2a00102700 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f29ef7fe640 1 -- 172.21.15.77:0/1845635199 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0018890 con 0x7f2a00102700 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f2a0495d640 1 -- 172.21.15.77:0/1845635199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0019fe00 con 0x7f2a00102700 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.802+0000 7f2a0495d640 1 -- 172.21.15.77:0/1845635199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a001a02b0 con 0x7f2a00102700 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.803+0000 7f2a0495d640 1 -- 172.21.15.77:0/1845635199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a000fdd90 con 0x7f2a00102700 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.804+0000 7f29ef7fe640 1 -- 172.21.15.77:0/1845635199 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f29f0018a30 con 0x7f2a00102700 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.805+0000 7f29ef7fe640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f29e80a2c30 0x7f29e80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.805+0000 7f29ef7fe640 1 -- 172.21.15.77:0/1845635199 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4965+0+0 (secure 0 0 0) 0x7f29f00ce480 con 0x7f2a00102700 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.805+0000 7f29fdd9b640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f29e80a2c30 0x7f29e80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:33.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.805+0000 7f29fdd9b640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f29e80a2c30 0x7f29e80a50f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29f4000c00 tx=0x7f29f4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:33.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.809+0000 7f29ef7fe640 1 -- 172.21.15.77:0/1845635199 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29f0014030 con 0x7f2a00102700 2024-09-12T01:53:33.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:33.986+0000 7f2a0495d640 1 -- 172.21.15.77:0/1845635199 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2a00062630 con 0x7f29e80a2c30 2024-09-12T01:53:34.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: osd.6 [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] boot 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:34.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:34.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:34.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:34.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:34 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:34.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:53:34.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: osd.6 [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] boot 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:34.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:34.716 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.716 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:34.716 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:34.716 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:34 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:53:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:53:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: osd.6 [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] boot 2024-09-12T01:53:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T01:53:34.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:53:34.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:34.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:34.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:34.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:34.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:34.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:34.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:34.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:34.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:34 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:35.651 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:35 smithi077 ceph-mon[35095]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:35.651 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:35 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi062 2024-09-12T01:53:35.651 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:35 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi062 to 5696M 2024-09-12T01:53:35.652 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:35 smithi077 ceph-mon[35095]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:35.652 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:35 smithi077 ceph-mon[35095]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T01:53:35.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:35 smithi107 ceph-mon[35463]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:35.741 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:35 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi062 2024-09-12T01:53:35.741 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:35 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi062 to 5696M 2024-09-12T01:53:35.741 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:35 smithi107 ceph-mon[35463]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:35.742 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:35 smithi107 ceph-mon[35463]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T01:53:35.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:35 smithi062 ceph-mon[30666]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:35.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:35 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi062 2024-09-12T01:53:35.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:35 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi062 to 5696M 2024-09-12T01:53:35.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:35 smithi062 ceph-mon[30666]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:35.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:35 smithi062 ceph-mon[30666]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T01:53:36.685 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:36 smithi077 ceph-mon[35095]: from='client.? 172.21.15.77:0/832098307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dde7bf9d-fe60-486c-9cf5-bcba5af89a45"}]: dispatch 2024-09-12T01:53:36.685 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:36 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dde7bf9d-fe60-486c-9cf5-bcba5af89a45"}]: dispatch 2024-09-12T01:53:36.685 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:36 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dde7bf9d-fe60-486c-9cf5-bcba5af89a45"}]': finished 2024-09-12T01:53:36.685 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:36 smithi077 ceph-mon[35095]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T01:53:36.685 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:36 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:36.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:36 smithi107 ceph-mon[35463]: from='client.? 172.21.15.77:0/832098307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dde7bf9d-fe60-486c-9cf5-bcba5af89a45"}]: dispatch 2024-09-12T01:53:36.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:36 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dde7bf9d-fe60-486c-9cf5-bcba5af89a45"}]: dispatch 2024-09-12T01:53:36.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:36 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dde7bf9d-fe60-486c-9cf5-bcba5af89a45"}]': finished 2024-09-12T01:53:36.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:36 smithi107 ceph-mon[35463]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T01:53:36.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:36 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:36.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:36 smithi062 ceph-mon[30666]: from='client.? 172.21.15.77:0/832098307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dde7bf9d-fe60-486c-9cf5-bcba5af89a45"}]: dispatch 2024-09-12T01:53:36.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:36 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dde7bf9d-fe60-486c-9cf5-bcba5af89a45"}]: dispatch 2024-09-12T01:53:36.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:36 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dde7bf9d-fe60-486c-9cf5-bcba5af89a45"}]': finished 2024-09-12T01:53:36.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:36 smithi062 ceph-mon[30666]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T01:53:36.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:36 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:37.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:37 smithi107 ceph-mon[35463]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:37.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:37 smithi107 ceph-mon[35463]: from='client.? 172.21.15.77:0/2515940482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:37.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:37 smithi077 ceph-mon[35095]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:37.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:37 smithi077 ceph-mon[35095]: from='client.? 172.21.15.77:0/2515940482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:37.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:37 smithi062 ceph-mon[30666]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:37.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:37 smithi062 ceph-mon[30666]: from='client.? 172.21.15.77:0/2515940482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:39.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:39 smithi107 ceph-mon[35463]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:39.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:39 smithi077 ceph-mon[35095]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:39.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:39 smithi062 ceph-mon[30666]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:41.600 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:41 smithi077 ceph-mon[35095]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:41.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:41 smithi107 ceph-mon[35463]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:41.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:41 smithi062 ceph-mon[30666]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:43.545 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:43 smithi077 ceph-mon[35095]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:43.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:43 smithi107 ceph-mon[35463]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:43.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:43 smithi062 ceph-mon[30666]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:45.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:45 smithi107 ceph-mon[35463]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:45.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:45 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:53:45.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:45 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:45.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:45 smithi077 ceph-mon[35095]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:45.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:45 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:53:45.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:45 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:45.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:45 smithi062 ceph-mon[30666]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:45.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:53:45.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:46.574 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:46 smithi077 ceph-mon[35095]: Deploying daemon osd.7 on smithi077 2024-09-12T01:53:46.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:46 smithi107 ceph-mon[35463]: Deploying daemon osd.7 on smithi077 2024-09-12T01:53:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:46 smithi062 ceph-mon[30666]: Deploying daemon osd.7 on smithi077 2024-09-12T01:53:47.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:47 smithi107 ceph-mon[35463]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:47 smithi077 ceph-mon[35095]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:47.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:47 smithi062 ceph-mon[30666]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:49.663 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:49 smithi077 ceph-mon[35095]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:49.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:49 smithi107 ceph-mon[35463]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:49.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:49 smithi062 ceph-mon[30666]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:51.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:51 smithi107 ceph-mon[35463]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:51.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:51 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:51.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:51 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:51.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:51 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:51.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:51 smithi077 ceph-mon[35095]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:51.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:51 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:51.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:51 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:51.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:51 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:51.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:51 smithi062 ceph-mon[30666]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:51.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:51 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:51.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:51 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:51.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:51 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:53.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:53 smithi077 ceph-mon[35095]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:53.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:53.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:53.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:53.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:53.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:53.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:53 smithi062 ceph-mon[30666]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:53.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:53.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:53 smithi107 ceph-mon[35463]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:53.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:53.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:53.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:53.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:53.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:54.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.395+0000 7f29ef7fe640 1 -- 172.21.15.77:0/1845635199 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2a00062630 con 0x7f29e80a2c30 2024-09-12T01:53:54.395 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 7 on host 'smithi077' 2024-09-12T01:53:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 -- 172.21.15.77:0/1845635199 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f29e80a2c30 msgr2=0x7f29e80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f29e80a2c30 0x7f29e80a50f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29f4000c00 tx=0x7f29f4031400 comp rx=0 tx=0).stop 2024-09-12T01:53:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 -- 172.21.15.77:0/1845635199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a00102700 msgr2=0x7f2a00197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a00102700 0x7f2a00197ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c920 tx=0x7f29f000cde0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 -- 172.21.15.77:0/1845635199 shutdown_connections 2024-09-12T01:53:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f29e80a2c30 0x7f29e80a50f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a00107960 0x7f2a0019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a00105030 0x7f2a00198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 --2- 172.21.15.77:0/1845635199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a00102700 0x7f2a00197ee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 -- 172.21.15.77:0/1845635199 >> 172.21.15.77:0/1845635199 conn(0x7f2a000fc2a0 msgr2=0x7f2a00102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 -- 172.21.15.77:0/1845635199 shutdown_connections 2024-09-12T01:53:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:53:54.397+0000 7f2a0495d640 1 -- 172.21.15.77:0/1845635199 wait complete. 2024-09-12T01:53:54.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:54.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:54.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:54.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:54.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:54.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:54.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:55.077 DEBUG:teuthology.orchestra.run.smithi077:osd.7> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T01:53:55.079 INFO:tasks.cephadm:Deploying osd.8 on smithi107 with /dev/vg_nvme/lv_2... 2024-09-12T01:53:55.079 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:53:55.330 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:53:55.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:55 smithi062 ceph-mon[30666]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:55.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:55 smithi107 ceph-mon[35463]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:55.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:55 smithi077 ceph-mon[35095]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:56.578 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:56 smithi077 ceph-mon[35095]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:56.779 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:56 smithi107 ceph-mon[35463]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:56.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:56 smithi062 ceph-mon[30666]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:57.306 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 01:53:56 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T01:53:56.965+0000 7fd7aecb2640 -1 osd.7 0 log_to_monitors true 2024-09-12T01:53:57.664 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:57 smithi077 ceph-mon[35095]: from='osd.7 [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:53:57.664 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:57 smithi077 ceph-mon[35095]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:53:57.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:57 smithi107 ceph-mon[35463]: from='osd.7 [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:53:57.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:57 smithi107 ceph-mon[35463]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:53:57.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:57 smithi062 ceph-mon[30666]: from='osd.7 [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:53:57.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:57 smithi062 ceph-mon[30666]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:53:58.017 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:53:58.043 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_2 2024-09-12T01:53:58.294 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:53:58.677 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:53:58.678 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T01:53:58.678 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:58.678 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='osd.7 [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:53:58.678 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:53:58.678 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:58.678 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi077 2024-09-12T01:53:58.678 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.679 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.679 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:58.679 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:58.679 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:58.679 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi077 to 5696M 2024-09-12T01:53:58.680 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.680 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:58.680 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:58.680 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.759+0000 7f526ce07640 1 -- 172.21.15.107:0/1711046153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52681037c0 msgr2=0x7f526810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.759+0000 7f526ce07640 1 --2- 172.21.15.107:0/1711046153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52681037c0 0x7f526810a050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5260009ca0 tx=0x7f526002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.759+0000 7f526ce07640 1 -- 172.21.15.107:0/1711046153 shutdown_connections 2024-09-12T01:53:58.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.759+0000 7f526ce07640 1 --2- 172.21.15.107:0/1711046153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52681037c0 0x7f526810a050 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.759+0000 7f526ce07640 1 --2- 172.21.15.107:0/1711046153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5268102e00 0x7f5268103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.759+0000 7f526ce07640 1 --2- 172.21.15.107:0/1711046153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5268101c00 0x7f5268102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.759+0000 7f526ce07640 1 -- 172.21.15.107:0/1711046153 >> 172.21.15.107:0/1711046153 conn(0x7f52680fd390 msgr2=0x7f52680ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:58.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.759+0000 7f526ce07640 1 -- 172.21.15.107:0/1711046153 shutdown_connections 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.759+0000 7f526ce07640 1 -- 172.21.15.107:0/1711046153 wait complete. 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f526ce07640 1 Processor -- start 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f526ce07640 1 -- start start 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f526ce07640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5268101c00 0x7f5268197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f526ce07640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5268102e00 0x7f5268198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f526ce07640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52681037c0 0x7f526819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f526ce07640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f526810d8e0 con 0x7f5268101c00 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f526ce07640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f526810d760 con 0x7f5268102e00 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f526ce07640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f526810da60 con 0x7f52681037c0 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f5266d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52681037c0 0x7f526819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f5266d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52681037c0 0x7f526819f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34594/0 (socket says 172.21.15.107:34594) 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f5266d9d640 1 -- 172.21.15.107:0/846231593 learned_addr learned my addr 172.21.15.107:0/846231593 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f5265d9b640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5268102e00 0x7f5268198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f526659c640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5268101c00 0x7f5268197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f5266d9d640 1 -- 172.21.15.107:0/846231593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5268102e00 msgr2=0x7f5268198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.760+0000 7f5266d9d640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5268102e00 0x7f5268198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.761+0000 7f5266d9d640 1 -- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5268101c00 msgr2=0x7f5268197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.761+0000 7f5266d9d640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5268101c00 0x7f5268197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.761+0000 7f5266d9d640 1 -- 172.21.15.107:0/846231593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526819fb00 con 0x7f52681037c0 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.761+0000 7f526659c640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5268101c00 0x7f5268197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.761+0000 7f5266d9d640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52681037c0 0x7f526819f490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f52600098d0 tx=0x7f526002f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:58.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.761+0000 7f52577fe640 1 -- 172.21.15.107:0/846231593 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526002fc30 con 0x7f52681037c0 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.761+0000 7f52577fe640 1 -- 172.21.15.107:0/846231593 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5260003e50 con 0x7f52681037c0 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.761+0000 7f526ce07640 1 -- 172.21.15.107:0/846231593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526819fd90 con 0x7f52681037c0 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.761+0000 7f52577fe640 1 -- 172.21.15.107:0/846231593 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5260004810 con 0x7f52681037c0 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.761+0000 7f526ce07640 1 -- 172.21.15.107:0/846231593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52681a02f0 con 0x7f52681037c0 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.762+0000 7f526ce07640 1 -- 172.21.15.107:0/846231593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5268108fb0 con 0x7f52681037c0 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.763+0000 7f52577fe640 1 -- 172.21.15.107:0/846231593 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5260003970 con 0x7f52681037c0 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.763+0000 7f52577fe640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f52500a2bb0 0x7f52500a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.764+0000 7f52577fe640 1 -- 172.21.15.107:0/846231593 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5117+0+0 (secure 0 0 0) 0x7f52600ef740 con 0x7f52681037c0 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.764+0000 7f526659c640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f52500a2bb0 0x7f52500a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.765+0000 7f526659c640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f52500a2bb0 0x7f52500a5070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5268102c60 tx=0x7f5258005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.768+0000 7f52577fe640 1 -- 172.21.15.107:0/846231593 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52600bd440 con 0x7f52681037c0 2024-09-12T01:53:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:53:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T01:53:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='osd.7 [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:53:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:53:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi077 2024-09-12T01:53:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:58.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:58.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:58.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi077 to 5696M 2024-09-12T01:53:58.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:58.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:58.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:53:58.942+0000 7f526ce07640 1 -- 172.21.15.107:0/846231593 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5268062630 con 0x7f52500a2bb0 2024-09-12T01:53:58.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:53:58.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T01:53:58.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='osd.7 [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi077 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi077 to 5696M 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:58.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:58.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:58.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:53:59.464 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T01:53:59.191+0000 7fd7ab449640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T01:53:59.464 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T01:53:59.199+0000 7fd7a2a55640 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:53:59.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:53:59.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T01:53:59.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:59.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:59.629 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:59.630 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:59.630 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:59.630 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:59.630 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: from='osd.7 ' entity='osd.7' 2024-09-12T01:53:59.630 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: osd.7 [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] boot 2024-09-12T01:53:59.630 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T01:53:59.630 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:53:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:59.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:53:59.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T01:53:59.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:59.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:59.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:59.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:59.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:59.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:59.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: from='osd.7 ' entity='osd.7' 2024-09-12T01:53:59.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: osd.7 [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] boot 2024-09-12T01:53:59.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T01:53:59.844 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:53:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:59.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:53:59.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T01:53:59.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:59.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:53:59.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:59.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:59.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:59.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:59.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: from='osd.7 ' entity='osd.7' 2024-09-12T01:53:59.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: osd.7 [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] boot 2024-09-12T01:53:59.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T01:53:59.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:53:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:54:00.640 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:00 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:54:00.640 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:00 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:54:00.640 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:00 smithi107 ceph-mon[35463]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:00.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:00 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:54:00.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:00 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:54:00.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:00 smithi062 ceph-mon[30666]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:00.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:00 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:54:00.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:00 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:54:00.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:00 smithi077 ceph-mon[35095]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:01.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:01 smithi062 ceph-mon[30666]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T01:54:01.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:01 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/637397171' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb"}]: dispatch 2024-09-12T01:54:01.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:01 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb"}]: dispatch 2024-09-12T01:54:01.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:01 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb"}]': finished 2024-09-12T01:54:01.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:01 smithi062 ceph-mon[30666]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:54:01.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:01 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:01.919 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:01 smithi107 ceph-mon[35463]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T01:54:01.919 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:01 smithi107 ceph-mon[35463]: from='client.? 172.21.15.107:0/637397171' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb"}]: dispatch 2024-09-12T01:54:01.919 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:01 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb"}]: dispatch 2024-09-12T01:54:01.919 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:01 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb"}]': finished 2024-09-12T01:54:01.919 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:01 smithi107 ceph-mon[35463]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:54:01.919 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:01 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:01.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:01 smithi077 ceph-mon[35095]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T01:54:01.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:01 smithi077 ceph-mon[35095]: from='client.? 172.21.15.107:0/637397171' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb"}]: dispatch 2024-09-12T01:54:01.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:01 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb"}]: dispatch 2024-09-12T01:54:01.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:01 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb"}]': finished 2024-09-12T01:54:01.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:01 smithi077 ceph-mon[35095]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:54:01.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:01 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:02.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:02 smithi062 ceph-mon[30666]: pgmap v182: 1 pgs: 1 remapped; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:02.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:02 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/3153806806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:54:02.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:02 smithi107 ceph-mon[35463]: pgmap v182: 1 pgs: 1 remapped; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:02.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:02 smithi107 ceph-mon[35463]: from='client.? 172.21.15.107:0/3153806806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:54:02.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:02 smithi077 ceph-mon[35095]: pgmap v182: 1 pgs: 1 remapped; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:02.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:02 smithi077 ceph-mon[35095]: from='client.? 172.21.15.107:0/3153806806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:54:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:03 smithi062 ceph-mon[30666]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:54:03.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:03.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:03 smithi107 ceph-mon[35463]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:54:03.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:03.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:03 smithi077 ceph-mon[35095]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:54:03.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:04.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:04 smithi062 ceph-mon[30666]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:04.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:04 smithi062 ceph-mon[30666]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T01:54:04.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:04 smithi062 ceph-mon[30666]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T01:54:04.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:04 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:04.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:04 smithi107 ceph-mon[35463]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:04.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:04 smithi107 ceph-mon[35463]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T01:54:04.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:04 smithi107 ceph-mon[35463]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T01:54:04.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:04 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:04.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:04 smithi077 ceph-mon[35095]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 636 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:04.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:04 smithi077 ceph-mon[35095]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T01:54:04.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:04 smithi077 ceph-mon[35095]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T01:54:04.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:04 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:05.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:05 smithi062 ceph-mon[30666]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T01:54:05.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:05 smithi062 ceph-mon[30666]: Cluster is now healthy 2024-09-12T01:54:05.911 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:05 smithi107 ceph-mon[35463]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T01:54:05.912 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:05 smithi107 ceph-mon[35463]: Cluster is now healthy 2024-09-12T01:54:05.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:05 smithi077 ceph-mon[35095]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T01:54:05.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:05 smithi077 ceph-mon[35095]: Cluster is now healthy 2024-09-12T01:54:06.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:06 smithi062 ceph-mon[30666]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:06.865 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:06 smithi077 ceph-mon[35095]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:06.918 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:06 smithi107 ceph-mon[35463]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:08.611 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:08 smithi107 ceph-mon[35463]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:08.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:08 smithi062 ceph-mon[30666]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:08.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:08 smithi077 ceph-mon[35095]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:10.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:10 smithi062 ceph-mon[30666]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:10.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:10 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:54:10.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:10 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:10.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:10 smithi062 ceph-mon[30666]: Deploying daemon osd.8 on smithi107 2024-09-12T01:54:10.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:10 smithi107 ceph-mon[35463]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:10.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:10 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:54:10.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:10 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:10.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:10 smithi107 ceph-mon[35463]: Deploying daemon osd.8 on smithi107 2024-09-12T01:54:10.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:10 smithi077 ceph-mon[35095]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:10.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:10 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:54:10.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:10 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:10.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:10 smithi077 ceph-mon[35095]: Deploying daemon osd.8 on smithi107 2024-09-12T01:54:12.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:12 smithi107 ceph-mon[35463]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:12.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:12 smithi062 ceph-mon[30666]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:12.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:12 smithi077 ceph-mon[35095]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:14.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:14 smithi062 ceph-mon[30666]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:14.913 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:14 smithi107 ceph-mon[35463]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:14.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:14 smithi077 ceph-mon[35095]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:16.864 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:16 smithi107 ceph-mon[35463]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:16.864 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:16.864 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:16.864 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:16.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:16 smithi077 ceph-mon[35095]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:16.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:16.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:16.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:17.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:16 smithi062 ceph-mon[30666]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:17.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:17.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:17.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:18.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:18 smithi107 ceph-mon[35463]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:18.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:18.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:18.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:18.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:18.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:18.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:18 smithi077 ceph-mon[35095]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:18.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:18.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:18.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:18.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:18.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:19.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:18 smithi062 ceph-mon[30666]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:19.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:19.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:19.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:19.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:19.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:19.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.613+0000 7f52577fe640 1 -- 172.21.15.107:0/846231593 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5268062630 con 0x7f52500a2bb0 2024-09-12T01:54:19.614 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 8 on host 'smithi107' 2024-09-12T01:54:19.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 -- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f52500a2bb0 msgr2=0x7f52500a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:19.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f52500a2bb0 0x7f52500a5070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5268102c60 tx=0x7f5258005d30 comp rx=0 tx=0).stop 2024-09-12T01:54:19.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 -- 172.21.15.107:0/846231593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52681037c0 msgr2=0x7f526819f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:19.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52681037c0 0x7f526819f490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f52600098d0 tx=0x7f526002f840 comp rx=0 tx=0).stop 2024-09-12T01:54:19.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 -- 172.21.15.107:0/846231593 shutdown_connections 2024-09-12T01:54:19.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f52500a2bb0 0x7f52500a5070 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52681037c0 0x7f526819f490 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5268102e00 0x7f5268198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 --2- 172.21.15.107:0/846231593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5268101c00 0x7f5268197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 -- 172.21.15.107:0/846231593 >> 172.21.15.107:0/846231593 conn(0x7f52680fd390 msgr2=0x7f5268106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:19.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 -- 172.21.15.107:0/846231593 shutdown_connections 2024-09-12T01:54:19.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:54:19.616+0000 7f526ce07640 1 -- 172.21.15.107:0/846231593 wait complete. 2024-09-12T01:54:20.318 DEBUG:teuthology.orchestra.run.smithi107:osd.8> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T01:54:20.320 INFO:tasks.cephadm:Deploying osd.9 on smithi062 with /dev/vg_nvme/lv_1... 2024-09-12T01:54:20.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:54:20.700 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:20.839 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:20 smithi062 ceph-mon[30666]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:20.840 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:20.840 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:20.840 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:20.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:20 smithi107 ceph-mon[35463]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:20.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:20.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:20.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:20.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:20 smithi077 ceph-mon[35095]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:20.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:20.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:20.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:22.457 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 01:54:22 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T01:54:22.140+0000 7f6189848640 -1 osd.8 0 log_to_monitors true 2024-09-12T01:54:22.703 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:22 smithi062 ceph-mon[30666]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:22.703 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:22 smithi062 ceph-mon[30666]: from='osd.8 [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:54:22.703 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:22 smithi062 ceph-mon[30666]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:54:22.888 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:22 smithi107 ceph-mon[35463]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:22.888 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:22 smithi107 ceph-mon[35463]: from='osd.8 [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:54:22.888 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:22 smithi107 ceph-mon[35463]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:54:22.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:22 smithi077 ceph-mon[35095]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:22.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:22 smithi077 ceph-mon[35095]: from='osd.8 [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:54:22.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:22 smithi077 ceph-mon[35095]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:54:23.945 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:54:23.945 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T01:54:23.945 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:23.945 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='osd.8 [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:54:23.945 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:54:23.945 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi107 2024-09-12T01:54:23.945 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.945 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.945 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:23.946 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:23.946 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:23.946 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi107 to 5695M 2024-09-12T01:54:23.946 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.946 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:23.946 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:23.946 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.953 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T01:54:23.616+0000 7f61857cb640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T01:54:23.953 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T01:54:23.624+0000 7f61815f3640 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:54:23.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='osd.8 [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi107 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi107 to 5695M 2024-09-12T01:54:23.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:23.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:23.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:54:23.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T01:54:23.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:23.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='osd.8 [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:54:23.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:54:23.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi107 2024-09-12T01:54:23.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:23.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:23.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:23.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi107 to 5695M 2024-09-12T01:54:23.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:23.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:23.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:23.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:24.101 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:54:24.130 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi062:vg_nvme/lv_1 2024-09-12T01:54:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:24.876 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:24 smithi062 ceph-mon[30666]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:24.876 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:24 smithi062 ceph-mon[30666]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:54:24.876 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:24 smithi062 ceph-mon[30666]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T01:54:24.876 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:24.876 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:24.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:24 smithi107 ceph-mon[35463]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:24.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:24 smithi107 ceph-mon[35463]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:54:24.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:24 smithi107 ceph-mon[35463]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T01:54:24.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:24.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:24.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:24 smithi077 ceph-mon[35095]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:24.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:24 smithi077 ceph-mon[35095]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:54:24.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:24 smithi077 ceph-mon[35095]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T01:54:24.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:24.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:25.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.088+0000 7f371c200640 1 -- 172.21.15.62:0/924698192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3714104f60 msgr2=0x7f37141053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:25.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.088+0000 7f371c200640 1 --2- 172.21.15.62:0/924698192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3714104f60 0x7f37141053e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3700009900 tx=0x7f370002a410 comp rx=0 tx=0).stop 2024-09-12T01:54:25.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.088+0000 7f371c200640 1 -- 172.21.15.62:0/924698192 shutdown_connections 2024-09-12T01:54:25.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.088+0000 7f371c200640 1 --2- 172.21.15.62:0/924698192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3714105920 0x7f371410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.088+0000 7f371c200640 1 --2- 172.21.15.62:0/924698192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3714104f60 0x7f37141053e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.088+0000 7f371c200640 1 --2- 172.21.15.62:0/924698192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3714103e00 0x7f3714104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.088+0000 7f371c200640 1 -- 172.21.15.62:0/924698192 >> 172.21.15.62:0/924698192 conn(0x7f37140ff5b0 msgr2=0x7f37141019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:25.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.088+0000 7f371c200640 1 -- 172.21.15.62:0/924698192 shutdown_connections 2024-09-12T01:54:25.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.088+0000 7f371c200640 1 -- 172.21.15.62:0/924698192 wait complete. 2024-09-12T01:54:25.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.089+0000 7f371c200640 1 Processor -- start 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.089+0000 7f371c200640 1 -- start start 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.089+0000 7f371c200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3714103e00 0x7f371419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.089+0000 7f371c200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3714104f60 0x7f371419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.089+0000 7f371c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3714105920 0x7f37141a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.089+0000 7f371c200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f371410fb00 con 0x7f3714104f60 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.089+0000 7f371c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f371410f980 con 0x7f3714105920 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.089+0000 7f371c200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f371410fc80 con 0x7f3714103e00 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f3718e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3714104f60 0x7f371419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f3718e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3714104f60 0x7f371419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54354/0 (socket says 172.21.15.62:54354) 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f3718e00640 1 -- 172.21.15.62:0/3839945693 learned_addr learned my addr 172.21.15.62:0/3839945693 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:54:25.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f371a200640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3714105920 0x7f37141a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f3719800640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3714103e00 0x7f371419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f371a200640 1 -- 172.21.15.62:0/3839945693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3714103e00 msgr2=0x7f371419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f371a200640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3714103e00 0x7f371419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f371a200640 1 -- 172.21.15.62:0/3839945693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3714104f60 msgr2=0x7f371419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f371a200640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3714104f60 0x7f371419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f371a200640 1 -- 172.21.15.62:0/3839945693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37141a1d30 con 0x7f3714105920 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.090+0000 7f3718e00640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3714104f60 0x7f371419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.091+0000 7f371a200640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3714105920 0x7f37141a16c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f370c009fd0 tx=0x7f370c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.091+0000 7f3712000640 1 -- 172.21.15.62:0/3839945693 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c00ce20 con 0x7f3714105920 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.091+0000 7f3712000640 1 -- 172.21.15.62:0/3839945693 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f370c005020 con 0x7f3714105920 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.091+0000 7f371c200640 1 -- 172.21.15.62:0/3839945693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37141a1fc0 con 0x7f3714105920 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.091+0000 7f3712000640 1 -- 172.21.15.62:0/3839945693 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c010720 con 0x7f3714105920 2024-09-12T01:54:25.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.091+0000 7f371c200640 1 -- 172.21.15.62:0/3839945693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37141a24d0 con 0x7f3714105920 2024-09-12T01:54:25.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.092+0000 7f371c200640 1 -- 172.21.15.62:0/3839945693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371410b120 con 0x7f3714105920 2024-09-12T01:54:25.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.094+0000 7f3712000640 1 -- 172.21.15.62:0/3839945693 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f370c005540 con 0x7f3714105920 2024-09-12T01:54:25.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.095+0000 7f3712000640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f36fc0a2bb0 0x7f36fc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:25.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.096+0000 7f3712000640 1 -- 172.21.15.62:0/3839945693 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5862+0+0 (secure 0 0 0) 0x7f370c0cedf0 con 0x7f3714105920 2024-09-12T01:54:25.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.096+0000 7f3719800640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f36fc0a2bb0 0x7f36fc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:25.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.096+0000 7f3719800640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f36fc0a2bb0 0x7f36fc0a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3708009bd0 tx=0x7f3708005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:25.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.097+0000 7f3712000640 1 -- 172.21.15.62:0/3839945693 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f370c09c6d0 con 0x7f3714105920 2024-09-12T01:54:25.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:25.291+0000 7f371c200640 1 -- 172.21.15.62:0/3839945693 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3714062630 con 0x7f36fc0a2bb0 2024-09-12T01:54:25.889 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:25 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:54:25.889 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:25 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:54:25.889 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:25 smithi062 ceph-mon[30666]: osd.8 [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] boot 2024-09-12T01:54:25.889 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:25 smithi062 ceph-mon[30666]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T01:54:25.889 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:25 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:25.890 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:25 smithi062 ceph-mon[30666]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:25.890 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:25 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:54:25.890 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:25 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:54:25.890 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:25 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:25.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:25 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:54:25.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:25 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:54:25.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:25 smithi107 ceph-mon[35463]: osd.8 [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] boot 2024-09-12T01:54:25.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:25 smithi107 ceph-mon[35463]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T01:54:25.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:25 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:25.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:25 smithi107 ceph-mon[35463]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:25.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:25 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:54:25.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:25 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:54:25.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:25 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:25.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:25 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:54:25.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:25 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:54:25.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:25 smithi077 ceph-mon[35095]: osd.8 [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] boot 2024-09-12T01:54:25.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:25 smithi077 ceph-mon[35095]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T01:54:25.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:25 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:54:25.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:25 smithi077 ceph-mon[35095]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:25.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:25 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:54:25.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:25 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:54:25.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:25 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:26.927 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:26 smithi062 ceph-mon[30666]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:26.928 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:26 smithi062 ceph-mon[30666]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T01:54:26.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:26 smithi107 ceph-mon[35463]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:26.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:26 smithi107 ceph-mon[35463]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T01:54:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:26 smithi077 ceph-mon[35095]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:54:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:26 smithi077 ceph-mon[35095]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T01:54:27.800 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:27 smithi062 ceph-mon[30666]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T01:54:27.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:27 smithi107 ceph-mon[35463]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T01:54:27.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:27 smithi077 ceph-mon[35095]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T01:54:28.901 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:28 smithi062 ceph-mon[30666]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:28.902 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:28 smithi062 ceph-mon[30666]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T01:54:28.902 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:28 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1125938266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0cc19007-e92e-4135-8154-2556a77daf4e"}]: dispatch 2024-09-12T01:54:28.902 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:28 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1125938266' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cc19007-e92e-4135-8154-2556a77daf4e"}]': finished 2024-09-12T01:54:28.902 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:28 smithi062 ceph-mon[30666]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:54:28.902 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:28 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:28.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:28 smithi107 ceph-mon[35463]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:28.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:28 smithi107 ceph-mon[35463]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T01:54:28.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:28 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1125938266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0cc19007-e92e-4135-8154-2556a77daf4e"}]: dispatch 2024-09-12T01:54:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:28 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1125938266' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cc19007-e92e-4135-8154-2556a77daf4e"}]': finished 2024-09-12T01:54:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:28 smithi107 ceph-mon[35463]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:54:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:28 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:28.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:28 smithi077 ceph-mon[35095]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:28.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:28 smithi077 ceph-mon[35095]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T01:54:28.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:28 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1125938266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0cc19007-e92e-4135-8154-2556a77daf4e"}]: dispatch 2024-09-12T01:54:28.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:28 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1125938266' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cc19007-e92e-4135-8154-2556a77daf4e"}]': finished 2024-09-12T01:54:28.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:28 smithi077 ceph-mon[35095]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:54:28.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:28 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:29.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:29 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/236615448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:54:29.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:29 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/236615448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:54:30.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:29 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/236615448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:54:30.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:30 smithi107 ceph-mon[35463]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:54:30.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:30 smithi077 ceph-mon[35095]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:54:31.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:30 smithi062 ceph-mon[30666]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:54:32.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:32 smithi107 ceph-mon[35463]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T01:54:32.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:32 smithi077 ceph-mon[35095]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T01:54:33.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:32 smithi062 ceph-mon[30666]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T01:54:34.948 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:34 smithi062 ceph-mon[30666]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:54:34.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:34 smithi107 ceph-mon[35463]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:54:34.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:34 smithi077 ceph-mon[35095]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:54:36.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:36 smithi107 ceph-mon[35463]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:54:36.959 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:36 smithi062 ceph-mon[30666]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:54:36.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:36 smithi077 ceph-mon[35095]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:54:38.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:38 smithi062 ceph-mon[30666]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:54:38.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:54:38.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:38.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:38 smithi062 ceph-mon[30666]: Deploying daemon osd.9 on smithi062 2024-09-12T01:54:38.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:38 smithi107 ceph-mon[35463]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:54:38.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:54:38.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:38.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:38 smithi107 ceph-mon[35463]: Deploying daemon osd.9 on smithi062 2024-09-12T01:54:38.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:38 smithi077 ceph-mon[35095]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:54:38.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:54:38.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:38.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:38 smithi077 ceph-mon[35095]: Deploying daemon osd.9 on smithi062 2024-09-12T01:54:40.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:40 smithi062 ceph-mon[30666]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T01:54:40.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:40 smithi107 ceph-mon[35463]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T01:54:40.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:40 smithi077 ceph-mon[35095]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T01:54:42.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:42 smithi107 ceph-mon[35463]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:42.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:42 smithi077 ceph-mon[35095]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:42.980 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:42 smithi062 ceph-mon[30666]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:44.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:44 smithi062 ceph-mon[30666]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:44.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:44 smithi107 ceph-mon[35463]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:44.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:44 smithi077 ceph-mon[35095]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:46.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:46 smithi107 ceph-mon[35463]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:46.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:46.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:46.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:46 smithi077 ceph-mon[35095]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:47.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:46 smithi062 ceph-mon[30666]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:47.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:47.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:47.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:48.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:48 smithi062 ceph-mon[30666]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:48.957 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:48 smithi107 ceph-mon[35463]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:48.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:48 smithi077 ceph-mon[35095]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:50.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:50.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:50.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:50.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:50.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:50.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:50.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:50.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:50.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:50.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:50.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.340+0000 7f3712000640 1 -- 172.21.15.62:0/3839945693 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3714062630 con 0x7f36fc0a2bb0 2024-09-12T01:54:50.342 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 9 on host 'smithi062' 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 -- 172.21.15.62:0/3839945693 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f36fc0a2bb0 msgr2=0x7f36fc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f36fc0a2bb0 0x7f36fc0a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3708009bd0 tx=0x7f3708005f90 comp rx=0 tx=0).stop 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 -- 172.21.15.62:0/3839945693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3714105920 msgr2=0x7f37141a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3714105920 0x7f37141a16c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f370c009fd0 tx=0x7f370c00ef10 comp rx=0 tx=0).stop 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 -- 172.21.15.62:0/3839945693 shutdown_connections 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f36fc0a2bb0 0x7f36fc0a5070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3714105920 0x7f37141a16c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3714104f60 0x7f371419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 --2- 172.21.15.62:0/3839945693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3714103e00 0x7f371419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 -- 172.21.15.62:0/3839945693 >> 172.21.15.62:0/3839945693 conn(0x7f37140ff5b0 msgr2=0x7f37141082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:50.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 -- 172.21.15.62:0/3839945693 shutdown_connections 2024-09-12T01:54:50.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:54:50.343+0000 7f371c200640 1 -- 172.21.15.62:0/3839945693 wait complete. 2024-09-12T01:54:51.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:50 smithi062 ceph-mon[30666]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:50 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:50 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:50 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:51.152 DEBUG:teuthology.orchestra.run.smithi062:osd.9> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T01:54:51.157 INFO:tasks.cephadm:Deploying osd.10 on smithi077 with /dev/vg_nvme/lv_1... 2024-09-12T01:54:51.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:54:51.185 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:50 smithi077 ceph-mon[35095]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:51.186 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:50 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:51.186 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:50 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:51.186 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:50 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:51.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:50 smithi107 ceph-mon[35463]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:51.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:50 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:51.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:50 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:51.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:50 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:51.412 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:54:51.816 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:51 smithi077 ceph-mon[35095]: from='osd.9 [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:54:51.816 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:51 smithi077 ceph-mon[35095]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:54:52.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:51 smithi062 ceph-mon[30666]: from='osd.9 [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:54:52.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:51 smithi062 ceph-mon[30666]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:54:52.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 01:54:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T01:54:51.658+0000 7f7cf382c640 -1 osd.9 0 log_to_monitors true 2024-09-12T01:54:52.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:51 smithi107 ceph-mon[35463]: from='osd.9 [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:54:52.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:51 smithi107 ceph-mon[35463]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:54:52.813 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 01:54:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T01:54:52.784+0000 7f7cee000640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T01:54:52.814 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 01:54:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T01:54:52.796+0000 7f7ce9000640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:54:52.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:52 smithi062 ceph-mon[30666]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:52.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:52 smithi062 ceph-mon[30666]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:54:52.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:52 smithi062 ceph-mon[30666]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T01:54:52.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:52 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:52.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:52 smithi062 ceph-mon[30666]: from='osd.9 [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:54:52.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:52 smithi062 ceph-mon[30666]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:54:53.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:52 smithi077 ceph-mon[35095]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:53.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:52 smithi077 ceph-mon[35095]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:54:53.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:52 smithi077 ceph-mon[35095]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T01:54:53.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:52 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:53.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:52 smithi077 ceph-mon[35095]: from='osd.9 [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:54:53.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:52 smithi077 ceph-mon[35095]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:54:53.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:52 smithi107 ceph-mon[35463]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:52 smithi107 ceph-mon[35463]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:54:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:52 smithi107 ceph-mon[35463]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T01:54:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:52 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:52 smithi107 ceph-mon[35463]: from='osd.9 [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:54:53.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:52 smithi107 ceph-mon[35463]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-09-12T01:54:53.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:53 smithi077 ceph-mon[35095]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:54:53.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:53 smithi077 ceph-mon[35095]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T01:54:53.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:53.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:53 smithi062 ceph-mon[30666]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:54:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:53 smithi062 ceph-mon[30666]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T01:54:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:54.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:53 smithi107 ceph-mon[35463]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-09-12T01:54:54.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:53 smithi107 ceph-mon[35463]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T01:54:54.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:54.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:54.327 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T01:54:54.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_1 2024-09-12T01:54:54.653 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:54:54.956 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:54 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:54:54.956 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:54 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:54:54.956 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:54 smithi077 ceph-mon[35095]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:54.957 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:54.957 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:54 smithi077 ceph-mon[35095]: osd.9 [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] boot 2024-09-12T01:54:54.957 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:54 smithi077 ceph-mon[35095]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T01:54:54.957 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:54 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:55.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:54 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:54:55.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:54 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:54:55.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:54 smithi062 ceph-mon[30666]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:55.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:55.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:54 smithi062 ceph-mon[30666]: osd.9 [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] boot 2024-09-12T01:54:55.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:54 smithi062 ceph-mon[30666]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T01:54:55.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:54 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:55.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.162+0000 7f08b6431640 1 -- 172.21.15.77:0/1001357445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08b0101cd0 msgr2=0x7f08b0102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:55.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.162+0000 7f08b6431640 1 --2- 172.21.15.77:0/1001357445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08b0101cd0 0x7f08b0102150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0898009900 tx=0x7f089802a410 comp rx=0 tx=0).stop 2024-09-12T01:54:55.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.163+0000 7f08b6431640 1 -- 172.21.15.77:0/1001357445 shutdown_connections 2024-09-12T01:54:55.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.163+0000 7f08b6431640 1 --2- 172.21.15.77:0/1001357445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08b0102690 0x7f08b0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.163+0000 7f08b6431640 1 --2- 172.21.15.77:0/1001357445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08b0101cd0 0x7f08b0102150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.163+0000 7f08b6431640 1 --2- 172.21.15.77:0/1001357445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08b0100ad0 0x7f08b0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.163+0000 7f08b6431640 1 -- 172.21.15.77:0/1001357445 >> 172.21.15.77:0/1001357445 conn(0x7f08b00fc280 msgr2=0x7f08b00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:55.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.163+0000 7f08b6431640 1 -- 172.21.15.77:0/1001357445 shutdown_connections 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.163+0000 7f08b6431640 1 -- 172.21.15.77:0/1001357445 wait complete. 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.163+0000 7f08b6431640 1 Processor -- start 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.163+0000 7f08b6431640 1 -- start start 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b6431640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08b0100ad0 0x7f08b0196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b6431640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08b0101cd0 0x7f08b01974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b6431640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08b0102690 0x7f08b019e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b6431640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f08b010c850 con 0x7f08b0100ad0 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b6431640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f08b010c6d0 con 0x7f08b0102690 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b6431640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f08b010c9d0 con 0x7f08b0101cd0 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b49ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08b0102690 0x7f08b019e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:55.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b49ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08b0102690 0x7f08b019e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37472/0 (socket says 172.21.15.77:37472) 2024-09-12T01:54:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b49ce640 1 -- 172.21.15.77:0/74987501 learned_addr learned my addr 172.21.15.77:0/74987501 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-12T01:54:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08af7fe640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08b0101cd0 0x7f08b01974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08affff640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08b0100ad0 0x7f08b0196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b49ce640 1 -- 172.21.15.77:0/74987501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08b0101cd0 msgr2=0x7f08b01974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b49ce640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08b0101cd0 0x7f08b01974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b49ce640 1 -- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08b0100ad0 msgr2=0x7f08b0196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b49ce640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08b0100ad0 0x7f08b0196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b49ce640 1 -- 172.21.15.77:0/74987501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b019ebc0 con 0x7f08b0102690 2024-09-12T01:54:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08affff640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08b0100ad0 0x7f08b0196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b49ce640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08b0102690 0x7f08b019e550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08a800b970 tx=0x7f08a800be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:55.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08ad7fa640 1 -- 172.21.15.77:0/74987501 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a8019070 con 0x7f08b0102690 2024-09-12T01:54:55.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08b6431640 1 -- 172.21.15.77:0/74987501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b019eeb0 con 0x7f08b0102690 2024-09-12T01:54:55.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08ad7fa640 1 -- 172.21.15.77:0/74987501 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08a800cb40 con 0x7f08b0102690 2024-09-12T01:54:55.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.164+0000 7f08ad7fa640 1 -- 172.21.15.77:0/74987501 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a8007610 con 0x7f08b0102690 2024-09-12T01:54:55.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.165+0000 7f08b6431640 1 -- 172.21.15.77:0/74987501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b019f3e0 con 0x7f08b0102690 2024-09-12T01:54:55.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.165+0000 7f08b6431640 1 -- 172.21.15.77:0/74987501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b0107f60 con 0x7f08b0102690 2024-09-12T01:54:55.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.167+0000 7f08ad7fa640 1 -- 172.21.15.77:0/74987501 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f08a801c070 con 0x7f08b0102690 2024-09-12T01:54:55.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.167+0000 7f08ad7fa640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f089c0a2bb0 0x7f089c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:55.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.167+0000 7f08ad7fa640 1 -- 172.21.15.77:0/74987501 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6261+0+0 (secure 0 0 0) 0x7f08a80ce2f0 con 0x7f08b0102690 2024-09-12T01:54:55.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.168+0000 7f08affff640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f089c0a2bb0 0x7f089c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:55.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.168+0000 7f08affff640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f089c0a2bb0 0x7f089c0a5070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08a0006fd0 tx=0x7f08a0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:55.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.175+0000 7f08ad7fa640 1 -- 172.21.15.77:0/74987501 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08a809ba50 con 0x7f08b0102690 2024-09-12T01:54:55.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:54 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:54:55.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:54 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:54:55.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:54 smithi107 ceph-mon[35463]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:54:55.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:55.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:54 smithi107 ceph-mon[35463]: osd.9 [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] boot 2024-09-12T01:54:55.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:54 smithi107 ceph-mon[35463]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T01:54:55.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:54 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:54:55.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:54:55.359+0000 7f08b6431640 1 -- 172.21.15.77:0/74987501 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f08b0062630 con 0x7f089c0a2bb0 2024-09-12T01:54:55.923 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T01:54:55.923 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi062 2024-09-12T01:54:55.923 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi062 to 4272M 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:54:55.924 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:54:55.925 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:55 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:56.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T01:54:56.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi062 2024-09-12T01:54:56.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:56.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:56.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:56.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:56.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:56.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:56.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi062 to 4272M 2024-09-12T01:54:56.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:56.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:56.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:56.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:56.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:56.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:54:56.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:54:56.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:55 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:56.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T01:54:56.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi062 2024-09-12T01:54:56.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:56.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:56.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:56.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi062 to 4272M 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:54:56.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:55 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:57.117 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:56 smithi077 ceph-mon[35095]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:54:57.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:56 smithi107 ceph-mon[35463]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:54:57.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:56 smithi062 ceph-mon[30666]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:54:58.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:57 smithi077 ceph-mon[35095]: from='client.? 172.21.15.77:0/1185863619' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f714105-925d-4bfe-9ec9-066ee4ea1632"}]: dispatch 2024-09-12T01:54:58.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:57 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f714105-925d-4bfe-9ec9-066ee4ea1632"}]: dispatch 2024-09-12T01:54:58.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:57 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f714105-925d-4bfe-9ec9-066ee4ea1632"}]': finished 2024-09-12T01:54:58.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:57 smithi077 ceph-mon[35095]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:54:58.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:57 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:54:58.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:57 smithi062 ceph-mon[30666]: from='client.? 172.21.15.77:0/1185863619' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f714105-925d-4bfe-9ec9-066ee4ea1632"}]: dispatch 2024-09-12T01:54:58.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:57 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f714105-925d-4bfe-9ec9-066ee4ea1632"}]: dispatch 2024-09-12T01:54:58.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:57 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f714105-925d-4bfe-9ec9-066ee4ea1632"}]': finished 2024-09-12T01:54:58.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:57 smithi062 ceph-mon[30666]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:54:58.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:57 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:54:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:57 smithi107 ceph-mon[35463]: from='client.? 172.21.15.77:0/1185863619' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f714105-925d-4bfe-9ec9-066ee4ea1632"}]: dispatch 2024-09-12T01:54:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:57 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f714105-925d-4bfe-9ec9-066ee4ea1632"}]: dispatch 2024-09-12T01:54:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:57 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f714105-925d-4bfe-9ec9-066ee4ea1632"}]': finished 2024-09-12T01:54:58.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:57 smithi107 ceph-mon[35463]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:54:58.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:57 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:54:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:58 smithi077 ceph-mon[35095]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:54:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:54:58 smithi077 ceph-mon[35095]: from='client.? 172.21.15.77:0/3478248622' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:54:59.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:58 smithi062 ceph-mon[30666]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:54:59.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:54:58 smithi062 ceph-mon[30666]: from='client.? 172.21.15.77:0/3478248622' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:54:59.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:58 smithi107 ceph-mon[35463]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:54:59.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:54:58 smithi107 ceph-mon[35463]: from='client.? 172.21.15.77:0/3478248622' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:55:01.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:00 smithi077 ceph-mon[35095]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:01.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:00 smithi062 ceph-mon[30666]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:01.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:00 smithi107 ceph-mon[35463]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:03.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:02 smithi077 ceph-mon[35095]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:03.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:02 smithi062 ceph-mon[30666]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:03.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:02 smithi107 ceph-mon[35463]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:05.249 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:04 smithi077 ceph-mon[35095]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:05.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:04 smithi062 ceph-mon[30666]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:05.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:04 smithi107 ceph-mon[35463]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:07.256 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:06 smithi107 ceph-mon[35463]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:07.256 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:06 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:55:07.256 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:06 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:07.294 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:06 smithi077 ceph-mon[35095]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:07.294 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:06 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:55:07.294 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:06 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:07.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:06 smithi062 ceph-mon[30666]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:06 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:55:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:06 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:08.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:07 smithi077 ceph-mon[35095]: Deploying daemon osd.10 on smithi077 2024-09-12T01:55:08.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:07 smithi062 ceph-mon[30666]: Deploying daemon osd.10 on smithi077 2024-09-12T01:55:08.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:07 smithi107 ceph-mon[35463]: Deploying daemon osd.10 on smithi077 2024-09-12T01:55:09.198 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:08 smithi077 ceph-mon[35095]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:09.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:08 smithi062 ceph-mon[30666]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:08 smithi107 ceph-mon[35463]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:11.120 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:10 smithi077 ceph-mon[35095]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:11.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:10 smithi062 ceph-mon[30666]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:11.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:10 smithi107 ceph-mon[35463]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:13.157 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:12 smithi077 ceph-mon[35095]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:13.157 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:13.158 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:13.158 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:13.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:12 smithi062 ceph-mon[30666]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:13.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:13.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:13.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:13.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:12 smithi107 ceph-mon[35463]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:13.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:13.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:13.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:15.111 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:14 smithi077 ceph-mon[35095]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:15.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:14 smithi062 ceph-mon[30666]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:15.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:14 smithi107 ceph-mon[35463]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:15.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.933+0000 7f08ad7fa640 1 -- 172.21.15.77:0/74987501 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f08b0062630 con 0x7f089c0a2bb0 2024-09-12T01:55:15.933 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 10 on host 'smithi077' 2024-09-12T01:55:15.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 -- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f089c0a2bb0 msgr2=0x7f089c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f089c0a2bb0 0x7f089c0a5070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08a0006fd0 tx=0x7f08a0008040 comp rx=0 tx=0).stop 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 -- 172.21.15.77:0/74987501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08b0102690 msgr2=0x7f08b019e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08b0102690 0x7f08b019e550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08a800b970 tx=0x7f08a800be30 comp rx=0 tx=0).stop 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 -- 172.21.15.77:0/74987501 shutdown_connections 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f089c0a2bb0 0x7f089c0a5070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08b0102690 0x7f08b019e550 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08b0101cd0 0x7f08b01974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 --2- 172.21.15.77:0/74987501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f08b0100ad0 0x7f08b0196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 -- 172.21.15.77:0/74987501 >> 172.21.15.77:0/74987501 conn(0x7f08b00fc280 msgr2=0x7f08b0105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 -- 172.21.15.77:0/74987501 shutdown_connections 2024-09-12T01:55:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T01:55:15.935+0000 7f08b6431640 1 -- 172.21.15.77:0/74987501 wait complete. 2024-09-12T01:55:16.665 DEBUG:teuthology.orchestra.run.smithi077:osd.10> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T01:55:16.667 INFO:tasks.cephadm:Deploying osd.11 on smithi107 with /dev/vg_nvme/lv_1... 2024-09-12T01:55:16.667 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:55:16.920 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:55:16.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:16 smithi107 ceph-mon[35463]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:16.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:16.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:16.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:16.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:16 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:17.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:16 smithi077 ceph-mon[35095]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:17.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:17.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:17.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:17.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:16 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:17.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:16 smithi062 ceph-mon[30666]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:17.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:17.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:17.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:17.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:16 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:18.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 01:55:18 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T01:55:18.471+0000 7f919c390640 -1 osd.10 0 log_to_monitors true 2024-09-12T01:55:19.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:18 smithi107 ceph-mon[35463]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:19.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:18 smithi107 ceph-mon[35463]: from='osd.10 [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:55:19.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:18 smithi107 ceph-mon[35463]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:55:19.210 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:18 smithi077 ceph-mon[35095]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:19.210 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:18 smithi077 ceph-mon[35095]: from='osd.10 [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:55:19.210 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:18 smithi077 ceph-mon[35095]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:55:19.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:18 smithi062 ceph-mon[30666]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:19.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:18 smithi062 ceph-mon[30666]: from='osd.10 [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:55:19.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:18 smithi062 ceph-mon[30666]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:55:20.031 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T01:55:20.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_1 2024-09-12T01:55:20.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:55:20.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='osd.10 [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:55:20.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:20.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:20.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:55:20.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T01:55:20.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:19 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:20.312 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:55:20.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='osd.10 [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:20.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:20.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:55:20.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T01:55:20.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:19 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:55:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='osd.10 [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:55:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:20.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:20.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:20.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-12T01:55:20.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T01:55:20.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:19 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:20.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.847+0000 7fb007fc8640 1 -- 172.21.15.107:0/1468613179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb000101d10 msgr2=0x7fb000102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.847+0000 7fb007fc8640 1 --2- 172.21.15.107:0/1468613179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb000101d10 0x7fb000102190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faff0009900 tx=0x7faff002a410 comp rx=0 tx=0).stop 2024-09-12T01:55:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.847+0000 7fb007fc8640 1 -- 172.21.15.107:0/1468613179 shutdown_connections 2024-09-12T01:55:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.847+0000 7fb007fc8640 1 --2- 172.21.15.107:0/1468613179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0001026d0 0x7fb000108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.847+0000 7fb007fc8640 1 --2- 172.21.15.107:0/1468613179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb000101d10 0x7fb000102190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.847+0000 7fb007fc8640 1 --2- 172.21.15.107:0/1468613179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb000100b10 0x7fb000100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.847+0000 7fb007fc8640 1 -- 172.21.15.107:0/1468613179 >> 172.21.15.107:0/1468613179 conn(0x7fb0000fc2a0 msgr2=0x7fb0000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb007fc8640 1 -- 172.21.15.107:0/1468613179 shutdown_connections 2024-09-12T01:55:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb007fc8640 1 -- 172.21.15.107:0/1468613179 wait complete. 2024-09-12T01:55:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb007fc8640 1 Processor -- start 2024-09-12T01:55:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb007fc8640 1 -- start start 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb007fc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000100b10 0x7fb00010b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb007fc8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb000101d10 0x7fb000109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb007fc8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0001026d0 0x7fb00010a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb007fc8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb00010d9a0 con 0x7fb000101d10 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb007fc8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb00010d820 con 0x7fb000100b10 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb007fc8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb00010db20 con 0x7fb0001026d0 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb006565640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0001026d0 0x7fb00010a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb006565640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0001026d0 0x7fb00010a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45828/0 (socket says 172.21.15.107:45828) 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.848+0000 7fb006565640 1 -- 172.21.15.107:0/1016968617 learned_addr learned my addr 172.21.15.107:0/1016968617 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7fb005d64640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000100b10 0x7fb00010b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7fb006565640 1 -- 172.21.15.107:0/1016968617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000100b10 msgr2=0x7fb00010b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:20.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7fb006565640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000100b10 0x7fb00010b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7fb006565640 1 -- 172.21.15.107:0/1016968617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb000101d10 msgr2=0x7fb000109ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7fb006565640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb000101d10 0x7fb000109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7fb006565640 1 -- 172.21.15.107:0/1016968617 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00010a8e0 con 0x7fb0001026d0 2024-09-12T01:55:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7fb006565640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0001026d0 0x7fb00010a020 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faff800b970 tx=0x7faff800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7faff6ffd640 1 -- 172.21.15.107:0/1016968617 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8019070 con 0x7fb0001026d0 2024-09-12T01:55:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7faff6ffd640 1 -- 172.21.15.107:0/1016968617 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faff8014440 con 0x7fb0001026d0 2024-09-12T01:55:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7fb007fc8640 1 -- 172.21.15.107:0/1016968617 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0001a2230 con 0x7fb0001026d0 2024-09-12T01:55:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7faff6ffd640 1 -- 172.21.15.107:0/1016968617 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff80075d0 con 0x7fb0001026d0 2024-09-12T01:55:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.849+0000 7fb007fc8640 1 -- 172.21.15.107:0/1016968617 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0001a27c0 con 0x7fb0001026d0 2024-09-12T01:55:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.850+0000 7fb007fc8640 1 -- 172.21.15.107:0/1016968617 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb000100f90 con 0x7fb0001026d0 2024-09-12T01:55:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.851+0000 7faff6ffd640 1 -- 172.21.15.107:0/1016968617 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7faff801c070 con 0x7fb0001026d0 2024-09-12T01:55:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.852+0000 7faff6ffd640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fafec0a2b80 0x7fafec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.852+0000 7faff6ffd640 1 -- 172.21.15.107:0/1016968617 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6414+0+0 (secure 0 0 0) 0x7faff80cde40 con 0x7fb0001026d0 2024-09-12T01:55:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.852+0000 7fb005d64640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fafec0a2b80 0x7fafec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.853+0000 7fb005d64640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fafec0a2b80 0x7fafec0a5040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb000101b70 tx=0x7faffc009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:20.856+0000 7faff6ffd640 1 -- 172.21.15.107:0/1016968617 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faff809b510 con 0x7fb0001026d0 2024-09-12T01:55:20.952 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T01:55:20.651+0000 7f9198313640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T01:55:20.952 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T01:55:20.664+0000 7f9190133640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:55:21.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:21.034+0000 7fb007fc8640 1 -- 172.21.15.107:0/1016968617 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb000062630 con 0x7fafec0a2b80 2024-09-12T01:55:21.035 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:21.035 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi077 2024-09-12T01:55:21.035 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi077 to 4272M 2024-09-12T01:55:21.035 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:21.035 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:21.035 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:21.035 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:21.035 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: from='osd.10 ' entity='osd.10' 2024-09-12T01:55:21.035 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: osd.10 [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] boot 2024-09-12T01:55:21.036 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T01:55:21.036 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:21.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:21.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi077 2024-09-12T01:55:21.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi077 to 4272M 2024-09-12T01:55:21.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:21.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: from='osd.10 ' entity='osd.10' 2024-09-12T01:55:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: osd.10 [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] boot 2024-09-12T01:55:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T01:55:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi077 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi077 to 4272M 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: from='osd.10 ' entity='osd.10' 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: osd.10 [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] boot 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T01:55:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:55:22.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:21 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:55:22.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:21 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:55:22.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:21 smithi107 ceph-mon[35463]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:22.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:55:22.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:55:22.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:22.138 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:21 smithi107 ceph-mon[35463]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T01:55:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:21 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:55:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:21 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:55:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:21 smithi077 ceph-mon[35095]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:55:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:55:22.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:22.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:21 smithi077 ceph-mon[35095]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T01:55:22.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:21 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:55:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:21 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:55:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:21 smithi062 ceph-mon[30666]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:55:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:55:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:21 smithi062 ceph-mon[30666]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T01:55:23.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:22 smithi107 ceph-mon[35463]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:23.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:22 smithi107 ceph-mon[35463]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T01:55:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:22 smithi077 ceph-mon[35095]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:22 smithi077 ceph-mon[35095]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T01:55:23.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:22 smithi062 ceph-mon[30666]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:55:23.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:22 smithi062 ceph-mon[30666]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T01:55:24.130 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:23 smithi107 ceph-mon[35463]: from='client.? 172.21.15.107:0/3059016919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "136b8ea9-0ba2-453f-bcd4-2f2a0a058fff"}]: dispatch 2024-09-12T01:55:24.130 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:23 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "136b8ea9-0ba2-453f-bcd4-2f2a0a058fff"}]: dispatch 2024-09-12T01:55:24.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:23 smithi107 ceph-mon[35463]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "136b8ea9-0ba2-453f-bcd4-2f2a0a058fff"}]': finished 2024-09-12T01:55:24.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:23 smithi107 ceph-mon[35463]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:55:24.131 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:24.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:23 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/3059016919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "136b8ea9-0ba2-453f-bcd4-2f2a0a058fff"}]: dispatch 2024-09-12T01:55:24.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:23 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "136b8ea9-0ba2-453f-bcd4-2f2a0a058fff"}]: dispatch 2024-09-12T01:55:24.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:23 smithi062 ceph-mon[30666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "136b8ea9-0ba2-453f-bcd4-2f2a0a058fff"}]': finished 2024-09-12T01:55:24.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:23 smithi062 ceph-mon[30666]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:55:24.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:23 smithi077 ceph-mon[35095]: from='client.? 172.21.15.107:0/3059016919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "136b8ea9-0ba2-453f-bcd4-2f2a0a058fff"}]: dispatch 2024-09-12T01:55:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:23 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "136b8ea9-0ba2-453f-bcd4-2f2a0a058fff"}]: dispatch 2024-09-12T01:55:24.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:23 smithi077 ceph-mon[35095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "136b8ea9-0ba2-453f-bcd4-2f2a0a058fff"}]': finished 2024-09-12T01:55:24.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:23 smithi077 ceph-mon[35095]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:55:24.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:25.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:24 smithi062 ceph-mon[30666]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:25.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:24 smithi062 ceph-mon[30666]: from='client.? 172.21.15.107:0/3758539075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:55:25.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:24 smithi062 ceph-mon[30666]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:55:25.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:24 smithi107 ceph-mon[35463]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:24 smithi107 ceph-mon[35463]: from='client.? 172.21.15.107:0/3758539075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:55:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:24 smithi107 ceph-mon[35463]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:55:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:25.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:24 smithi077 ceph-mon[35095]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:25.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:24 smithi077 ceph-mon[35095]: from='client.? 172.21.15.107:0/3758539075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:55:25.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:24 smithi077 ceph-mon[35095]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:55:25.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:27.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:26 smithi062 ceph-mon[30666]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:55:27.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:26 smithi107 ceph-mon[35463]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:55:27.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:26 smithi077 ceph-mon[35095]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:55:29.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:28 smithi062 ceph-mon[30666]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T01:55:29.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:28 smithi107 ceph-mon[35463]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T01:55:29.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:28 smithi077 ceph-mon[35095]: pgmap v246: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T01:55:31.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:30 smithi107 ceph-mon[35463]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:55:31.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:30 smithi062 ceph-mon[30666]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:55:31.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:30 smithi077 ceph-mon[35095]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:55:33.306 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:32 smithi107 ceph-mon[35463]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:55:33.306 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:32 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:55:33.306 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:32 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:33.306 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:32 smithi107 ceph-mon[35463]: Deploying daemon osd.11 on smithi107 2024-09-12T01:55:33.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:32 smithi062 ceph-mon[30666]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:55:33.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:32 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:55:33.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:32 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:33.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:32 smithi062 ceph-mon[30666]: Deploying daemon osd.11 on smithi107 2024-09-12T01:55:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:32 smithi077 ceph-mon[35095]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:55:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:32 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:55:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:32 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:32 smithi077 ceph-mon[35095]: Deploying daemon osd.11 on smithi107 2024-09-12T01:55:35.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:34 smithi107 ceph-mon[35463]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:55:35.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:34 smithi062 ceph-mon[30666]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:55:35.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:34 smithi077 ceph-mon[35095]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:55:37.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:36 smithi107 ceph-mon[35463]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:37.266 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:36 smithi077 ceph-mon[35095]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:37.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:36 smithi062 ceph-mon[30666]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:39.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:38 smithi062 ceph-mon[30666]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:39.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:39.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:39.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:39.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:38 smithi107 ceph-mon[35463]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:39.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:39.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:39.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:39.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:38 smithi077 ceph-mon[35095]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:39.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:39.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:39.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:41.108 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:40 smithi107 ceph-mon[35463]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:41.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:40 smithi062 ceph-mon[30666]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:41.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:40 smithi077 ceph-mon[35095]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:41.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.957+0000 7faff6ffd640 1 -- 172.21.15.107:0/1016968617 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb000062630 con 0x7fafec0a2b80 2024-09-12T01:55:41.958 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 11 on host 'smithi107' 2024-09-12T01:55:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 -- 172.21.15.107:0/1016968617 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fafec0a2b80 msgr2=0x7fafec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fafec0a2b80 0x7fafec0a5040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb000101b70 tx=0x7faffc009110 comp rx=0 tx=0).stop 2024-09-12T01:55:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 -- 172.21.15.107:0/1016968617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0001026d0 msgr2=0x7fb00010a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0001026d0 0x7fb00010a020 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faff800b970 tx=0x7faff800bd70 comp rx=0 tx=0).stop 2024-09-12T01:55:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 -- 172.21.15.107:0/1016968617 shutdown_connections 2024-09-12T01:55:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fafec0a2b80 0x7fafec0a5040 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0001026d0 0x7fb00010a020 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:41.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb000101d10 0x7fb000109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 --2- 172.21.15.107:0/1016968617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000100b10 0x7fb00010b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 -- 172.21.15.107:0/1016968617 >> 172.21.15.107:0/1016968617 conn(0x7fb0000fc2a0 msgr2=0x7fb000105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 -- 172.21.15.107:0/1016968617 shutdown_connections 2024-09-12T01:55:41.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:41.960+0000 7fb007fc8640 1 -- 172.21.15.107:0/1016968617 wait complete. 2024-09-12T01:55:42.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:42.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:42.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:42.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:42 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.644 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.644 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.644 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:42.645 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:42.645 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.645 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:42.645 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.645 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:42 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.674 DEBUG:teuthology.orchestra.run.smithi107:osd.11> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T01:55:42.676 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T01:55:42.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:55:42.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:42.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:42.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:42.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:42.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:42 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:43.061 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:43.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:43 smithi062 ceph-mon[30666]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:43.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:43 smithi107 ceph-mon[35463]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:43.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:43 smithi077 ceph-mon[35095]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:43.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.719+0000 7f2881a00640 1 -- 172.21.15.62:0/1063246503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f287c10e1e0 msgr2=0x7f287c1105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:43.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.719+0000 7f2881a00640 1 --2- 172.21.15.62:0/1063246503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f287c10e1e0 0x7f287c1105d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2874009ca0 tx=0x7f287402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:43.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.720+0000 7f2881a00640 1 -- 172.21.15.62:0/1063246503 shutdown_connections 2024-09-12T01:55:43.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.720+0000 7f2881a00640 1 --2- 172.21.15.62:0/1063246503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f287c10e1e0 0x7f287c1105d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:43.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.720+0000 7f2881a00640 1 --2- 172.21.15.62:0/1063246503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f287c074c50 0x7f287c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:43.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.720+0000 7f2881a00640 1 --2- 172.21.15.62:0/1063246503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f287c076220 0x7f287c074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:43.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.720+0000 7f2881a00640 1 -- 172.21.15.62:0/1063246503 >> 172.21.15.62:0/1063246503 conn(0x7f287c0fd390 msgr2=0x7f287c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:43.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.720+0000 7f2881a00640 1 -- 172.21.15.62:0/1063246503 shutdown_connections 2024-09-12T01:55:43.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.720+0000 7f2881a00640 1 -- 172.21.15.62:0/1063246503 wait complete. 2024-09-12T01:55:43.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2881a00640 1 Processor -- start 2024-09-12T01:55:43.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2881a00640 1 -- start start 2024-09-12T01:55:43.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2881a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f287c074c50 0x7f287c19e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:43.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2881a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f287c076220 0x7f287c19e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:43.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2881a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f287c10e1e0 0x7f287c1a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:43.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2881a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f287c113ef0 con 0x7f287c076220 2024-09-12T01:55:43.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2881a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f287c113d70 con 0x7f287c10e1e0 2024-09-12T01:55:43.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2881a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f287c114070 con 0x7f287c074c50 2024-09-12T01:55:43.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2872000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f287c076220 0x7f287c19e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:43.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f287aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f287c074c50 0x7f287c19e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:43.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2872000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f287c076220 0x7f287c19e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36692/0 (socket says 172.21.15.62:36692) 2024-09-12T01:55:43.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f287aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f287c074c50 0x7f287c19e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:51250/0 (socket says 172.21.15.62:51250) 2024-09-12T01:55:43.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f2872000640 1 -- 172.21.15.62:0/2643595497 learned_addr learned my addr 172.21.15.62:0/2643595497 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:55:43.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.721+0000 7f287b400640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f287c10e1e0 0x7f287c1a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:43.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f287aa00640 1 -- 172.21.15.62:0/2643595497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f287c10e1e0 msgr2=0x7f287c1a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f287aa00640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f287c10e1e0 0x7f287c1a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f287aa00640 1 -- 172.21.15.62:0/2643595497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f287c076220 msgr2=0x7f287c19e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f287aa00640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f287c076220 0x7f287c19e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f287aa00640 1 -- 172.21.15.62:0/2643595497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287c1a60d0 con 0x7f287c074c50 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f287aa00640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f287c074c50 0x7f287c19e4a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f286c00e9c0 tx=0x7f286c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f2873e00640 1 -- 172.21.15.62:0/2643595497 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c00ccc0 con 0x7f287c074c50 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f2873e00640 1 -- 172.21.15.62:0/2643595497 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f286c010910 con 0x7f287c074c50 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f2881a00640 1 -- 172.21.15.62:0/2643595497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287c1a63c0 con 0x7f287c074c50 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f2873e00640 1 -- 172.21.15.62:0/2643595497 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c0188c0 con 0x7f287c074c50 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.722+0000 7f2881a00640 1 -- 172.21.15.62:0/2643595497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f287c1a6950 con 0x7f287c074c50 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.723+0000 7f2881a00640 1 -- 172.21.15.62:0/2643595497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f287c104290 con 0x7f287c074c50 2024-09-12T01:55:43.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.725+0000 7f2873e00640 1 -- 172.21.15.62:0/2643595497 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f286c010ac0 con 0x7f287c074c50 2024-09-12T01:55:43.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.726+0000 7f2873e00640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f28600a2c30 0x7f28600a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:43.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.727+0000 7f2873e00640 1 -- 172.21.15.62:0/2643595497 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7f286c0cf160 con 0x7f287c074c50 2024-09-12T01:55:43.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.727+0000 7f2872000640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f28600a2c30 0x7f28600a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:43.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.727+0000 7f2872000640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f28600a2c30 0x7f28600a50f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f287c19f9c0 tx=0x7f286400b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:43.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.728+0000 7f2873e00640 1 -- 172.21.15.62:0/2643595497 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f286c09bfb0 con 0x7f287c074c50 2024-09-12T01:55:43.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.916+0000 7f2881a00640 1 -- 172.21.15.62:0/2643595497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f287c062df0 con 0x7f287c074c50 2024-09-12T01:55:43.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.917+0000 7f2873e00640 1 -- 172.21.15.62:0/2643595497 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f286c0a02b0 con 0x7f287c074c50 2024-09-12T01:55:43.918 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:55:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 -- 172.21.15.62:0/2643595497 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f28600a2c30 msgr2=0x7f28600a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f28600a2c30 0x7f28600a50f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f287c19f9c0 tx=0x7f286400b480 comp rx=0 tx=0).stop 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 -- 172.21.15.62:0/2643595497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f287c074c50 msgr2=0x7f287c19e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f287c074c50 0x7f287c19e4a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f286c00e9c0 tx=0x7f286c00ee80 comp rx=0 tx=0).stop 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 -- 172.21.15.62:0/2643595497 shutdown_connections 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f28600a2c30 0x7f28600a50f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f287c10e1e0 0x7f287c1a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f287c076220 0x7f287c19e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 --2- 172.21.15.62:0/2643595497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f287c074c50 0x7f287c19e4a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 -- 172.21.15.62:0/2643595497 >> 172.21.15.62:0/2643595497 conn(0x7f287c0fd390 msgr2=0x7f287c101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 -- 172.21.15.62:0/2643595497 shutdown_connections 2024-09-12T01:55:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:43.920+0000 7f2881a00640 1 -- 172.21.15.62:0/2643595497 wait complete. 2024-09-12T01:55:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:44 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2643595497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:55:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:44 smithi107 ceph-mon[35463]: from='osd.11 [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:55:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:44 smithi107 ceph-mon[35463]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:55:44.454 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 01:55:44 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T01:55:44.104+0000 7fe4d07b0640 -1 osd.11 0 log_to_monitors true 2024-09-12T01:55:44.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:44 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2643595497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:55:44.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:44 smithi062 ceph-mon[30666]: from='osd.11 [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:55:44.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:44 smithi062 ceph-mon[30666]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:55:44.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:44 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2643595497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:55:44.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:44 smithi077 ceph-mon[35095]: from='osd.11 [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:55:44.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:44 smithi077 ceph-mon[35095]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:55:44.824 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726106120,"num_in_osds":12,"osd_in_since":1726106123,"num_remapped_pgs":0} 2024-09-12T01:55:45.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:45 smithi107 ceph-mon[35463]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:45.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:45 smithi107 ceph-mon[35463]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:55:45.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:45 smithi107 ceph-mon[35463]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T01:55:45.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:45 smithi107 ceph-mon[35463]: from='osd.11 [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:55:45.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:45 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:45.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:45 smithi107 ceph-mon[35463]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:55:45.454 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 01:55:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T01:55:45.278+0000 7fe4cc733640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T01:55:45.454 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 01:55:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T01:55:45.294+0000 7fe4c855b640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:55:45.548 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:45 smithi062 ceph-mon[30666]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:45.548 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:45 smithi062 ceph-mon[30666]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:55:45.548 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:45 smithi062 ceph-mon[30666]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T01:55:45.548 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:45 smithi062 ceph-mon[30666]: from='osd.11 [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:55:45.548 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:45 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:45.548 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:45 smithi062 ceph-mon[30666]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:55:45.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:45 smithi077 ceph-mon[35095]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:45.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:45 smithi077 ceph-mon[35095]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:55:45.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:45 smithi077 ceph-mon[35095]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T01:55:45.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:45 smithi077 ceph-mon[35095]: from='osd.11 [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:55:45.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:45 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:45.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:45 smithi077 ceph-mon[35095]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-09-12T01:55:45.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:55:46.208 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:46.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:55:46.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T01:55:46.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:46.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:46.508 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:46.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:46.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:46.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:55:46.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:46.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:46.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.705 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:46.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-09-12T01:55:46.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:46.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:46.716 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:46.716 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:46.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.771+0000 7f160f200640 1 -- 172.21.15.62:0/572360407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1610102c40 msgr2=0x7f16101030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.771+0000 7f160f200640 1 --2- 172.21.15.62:0/572360407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1610102c40 0x7f16101030c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009900 tx=0x7f15fc02a3f0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.771+0000 7f160f200640 1 -- 172.21.15.62:0/572360407 shutdown_connections 2024-09-12T01:55:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.771+0000 7f160f200640 1 --2- 172.21.15.62:0/572360407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1610103600 0x7f1610109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.771+0000 7f160f200640 1 --2- 172.21.15.62:0/572360407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1610102c40 0x7f16101030c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.771+0000 7f160f200640 1 --2- 172.21.15.62:0/572360407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1610101a40 0x7f1610101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.771+0000 7f160f200640 1 -- 172.21.15.62:0/572360407 >> 172.21.15.62:0/572360407 conn(0x7f16100fd1f0 msgr2=0x7f16100ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.771+0000 7f160f200640 1 -- 172.21.15.62:0/572360407 shutdown_connections 2024-09-12T01:55:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.771+0000 7f160f200640 1 -- 172.21.15.62:0/572360407 wait complete. 2024-09-12T01:55:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.772+0000 7f160f200640 1 Processor -- start 2024-09-12T01:55:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.772+0000 7f160f200640 1 -- start start 2024-09-12T01:55:46.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1610101a40 0x7f161019e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160f200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1610102c40 0x7f161019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1610103600 0x7f16101a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160f200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f161010d710 con 0x7f1610102c40 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f161010d590 con 0x7f1610101a40 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f161010d890 con 0x7f1610103600 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1610102c40 0x7f161019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1610102c40 0x7f161019e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36702/0 (socket says 172.21.15.62:36702) 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160d400640 1 -- 172.21.15.62:0/2500617670 learned_addr learned my addr 172.21.15.62:0/2500617670 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160de00640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1610101a40 0x7f161019e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.773+0000 7f160e800640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1610103600 0x7f16101a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f160d400640 1 -- 172.21.15.62:0/2500617670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1610103600 msgr2=0x7f16101a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f160d400640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1610103600 0x7f16101a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f160d400640 1 -- 172.21.15.62:0/2500617670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1610101a40 msgr2=0x7f161019e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f160d400640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1610101a40 0x7f161019e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f160d400640 1 -- 172.21.15.62:0/2500617670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16101a5f70 con 0x7f1610102c40 2024-09-12T01:55:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f160de00640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1610101a40 0x7f161019e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f160d400640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1610102c40 0x7f161019e880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f15fc031440 tx=0x7f15fc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f1606a00640 1 -- 172.21.15.62:0/2500617670 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc03f030 con 0x7f1610102c40 2024-09-12T01:55:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f1606a00640 1 -- 172.21.15.62:0/2500617670 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15fc003ce0 con 0x7f1610102c40 2024-09-12T01:55:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f1606a00640 1 -- 172.21.15.62:0/2500617670 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc035070 con 0x7f1610102c40 2024-09-12T01:55:46.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f160f200640 1 -- 172.21.15.62:0/2500617670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16101a6200 con 0x7f1610102c40 2024-09-12T01:55:46.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.774+0000 7f160f200640 1 -- 172.21.15.62:0/2500617670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16101a66e0 con 0x7f1610102c40 2024-09-12T01:55:46.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.776+0000 7f160f200640 1 -- 172.21.15.62:0/2500617670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16101a6940 con 0x7f1610102c40 2024-09-12T01:55:46.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.777+0000 7f1606a00640 1 -- 172.21.15.62:0/2500617670 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f15fc042030 con 0x7f1610102c40 2024-09-12T01:55:46.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.779+0000 7f1606a00640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f15f40a2bb0 0x7f15f40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:46.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.779+0000 7f1606a00640 1 -- 172.21.15.62:0/2500617670 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f15fc0ef080 con 0x7f1610102c40 2024-09-12T01:55:46.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.779+0000 7f160de00640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f15f40a2bb0 0x7f15f40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:46.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.780+0000 7f160de00640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f15f40a2bb0 0x7f15f40a5070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1610102aa0 tx=0x7f1600005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:46.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.783+0000 7f1606a00640 1 -- 172.21.15.62:0/2500617670 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f15fc0bbd90 con 0x7f1610102c40 2024-09-12T01:55:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.972+0000 7f160f200640 1 -- 172.21.15.62:0/2500617670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f16101a7030 con 0x7f1610102c40 2024-09-12T01:55:46.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.973+0000 7f1606a00640 1 -- 172.21.15.62:0/2500617670 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f15fc0c0090 con 0x7f1610102c40 2024-09-12T01:55:46.974 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:55:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.975+0000 7f160f200640 1 -- 172.21.15.62:0/2500617670 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f15f40a2bb0 msgr2=0x7f15f40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.975+0000 7f160f200640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f15f40a2bb0 0x7f15f40a5070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1610102aa0 tx=0x7f1600005f90 comp rx=0 tx=0).stop 2024-09-12T01:55:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.975+0000 7f160f200640 1 -- 172.21.15.62:0/2500617670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1610102c40 msgr2=0x7f161019e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.975+0000 7f160f200640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1610102c40 0x7f161019e880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f15fc031440 tx=0x7f15fc032ce0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.976+0000 7f160f200640 1 -- 172.21.15.62:0/2500617670 shutdown_connections 2024-09-12T01:55:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.976+0000 7f160f200640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f15f40a2bb0 0x7f15f40a5070 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.976+0000 7f160f200640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1610103600 0x7f16101a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.976+0000 7f160f200640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1610102c40 0x7f161019e880 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.976+0000 7f160f200640 1 --2- 172.21.15.62:0/2500617670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1610101a40 0x7f161019e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.976+0000 7f160f200640 1 -- 172.21.15.62:0/2500617670 >> 172.21.15.62:0/2500617670 conn(0x7f16100fd1f0 msgr2=0x7f1610074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.976+0000 7f160f200640 1 -- 172.21.15.62:0/2500617670 shutdown_connections 2024-09-12T01:55:46.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:46.976+0000 7f160f200640 1 -- 172.21.15.62:0/2500617670 wait complete. 2024-09-12T01:55:47.359 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:47 smithi062 ceph-mon[30666]: purged_snaps scrub starts 2024-09-12T01:55:47.360 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:47 smithi062 ceph-mon[30666]: purged_snaps scrub ok 2024-09-12T01:55:47.360 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:47 smithi062 ceph-mon[30666]: Detected new or changed devices on smithi107 2024-09-12T01:55:47.360 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:47 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi107 to 4271M 2024-09-12T01:55:47.360 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:47 smithi062 ceph-mon[30666]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:47.360 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:47 smithi062 ceph-mon[30666]: osd.11 [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] boot 2024-09-12T01:55:47.360 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:47 smithi062 ceph-mon[30666]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:55:47.360 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:47 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:47.360 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:47 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2500617670' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:55:47.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:47 smithi107 ceph-mon[35463]: purged_snaps scrub starts 2024-09-12T01:55:47.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:47 smithi107 ceph-mon[35463]: purged_snaps scrub ok 2024-09-12T01:55:47.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:47 smithi107 ceph-mon[35463]: Detected new or changed devices on smithi107 2024-09-12T01:55:47.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:47 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi107 to 4271M 2024-09-12T01:55:47.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:47 smithi107 ceph-mon[35463]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:47.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:47 smithi107 ceph-mon[35463]: osd.11 [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] boot 2024-09-12T01:55:47.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:47 smithi107 ceph-mon[35463]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:55:47.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:47 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:47.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:47 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2500617670' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:55:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:47 smithi077 ceph-mon[35095]: purged_snaps scrub starts 2024-09-12T01:55:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:47 smithi077 ceph-mon[35095]: purged_snaps scrub ok 2024-09-12T01:55:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:47 smithi077 ceph-mon[35095]: Detected new or changed devices on smithi107 2024-09-12T01:55:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:47 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi107 to 4271M 2024-09-12T01:55:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:47 smithi077 ceph-mon[35095]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:55:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:47 smithi077 ceph-mon[35095]: osd.11 [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] boot 2024-09-12T01:55:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:47 smithi077 ceph-mon[35095]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:55:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:47 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:55:47.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:47 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2500617670' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:55:47.876 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726106146,"num_in_osds":12,"osd_in_since":1726106123,"num_remapped_pgs":0} 2024-09-12T01:55:47.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:55:48.249 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:48.676 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:48 smithi062 ceph-mon[30666]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:55:48.676 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:48 smithi062 ceph-mon[30666]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.788+0000 7f3025c00640 1 -- 172.21.15.62:0/125402430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30201019c0 msgr2=0x7f3020101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.788+0000 7f3025c00640 1 --2- 172.21.15.62:0/125402430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30201019c0 0x7f3020101e20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f300c009930 tx=0x7f300c02a440 comp rx=0 tx=0).stop 2024-09-12T01:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.788+0000 7f3025c00640 1 -- 172.21.15.62:0/125402430 shutdown_connections 2024-09-12T01:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.788+0000 7f3025c00640 1 --2- 172.21.15.62:0/125402430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3020102360 0x7f302010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.788+0000 7f3025c00640 1 --2- 172.21.15.62:0/125402430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30201019c0 0x7f3020101e20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.788+0000 7f3025c00640 1 --2- 172.21.15.62:0/125402430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30201079c0 0x7f3020107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.788+0000 7f3025c00640 1 -- 172.21.15.62:0/125402430 >> 172.21.15.62:0/125402430 conn(0x7f30200fd6e0 msgr2=0x7f30200ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.788+0000 7f3025c00640 1 -- 172.21.15.62:0/125402430 shutdown_connections 2024-09-12T01:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.788+0000 7f3025c00640 1 -- 172.21.15.62:0/125402430 wait complete. 2024-09-12T01:55:48.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.789+0000 7f3025c00640 1 Processor -- start 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.790+0000 7f3025c00640 1 -- start start 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.790+0000 7f3025c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30201019c0 0x7f30200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.790+0000 7f3025c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3020102360 0x7f3020074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.790+0000 7f3025c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30201079c0 0x7f3020074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.790+0000 7f3025c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3020111e10 con 0x7f30201079c0 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.790+0000 7f3025c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3020111c90 con 0x7f3020102360 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.790+0000 7f3025c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3020111f90 con 0x7f30201019c0 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.790+0000 7f301f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3020102360 0x7f3020074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f301fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30201019c0 0x7f30200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f301f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3020102360 0x7f3020074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:50880/0 (socket says 172.21.15.62:50880) 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f301f400640 1 -- 172.21.15.62:0/4178392422 learned_addr learned my addr 172.21.15.62:0/4178392422 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:55:48.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f3025200640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30201079c0 0x7f3020074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:48.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f301f400640 1 -- 172.21.15.62:0/4178392422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30201019c0 msgr2=0x7f30200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f301f400640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30201019c0 0x7f30200744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f301f400640 1 -- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30201079c0 msgr2=0x7f3020074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f301f400640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30201079c0 0x7f3020074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f301f400640 1 -- 172.21.15.62:0/4178392422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30201a6750 con 0x7f3020102360 2024-09-12T01:55:48.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f3025200640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30201079c0 0x7f3020074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:48.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.791+0000 7f301f400640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3020102360 0x7f3020074a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f300c02a960 tx=0x7f300c003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:48.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.792+0000 7f301cc00640 1 -- 172.21.15.62:0/4178392422 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c03f070 con 0x7f3020102360 2024-09-12T01:55:48.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.792+0000 7f3025c00640 1 -- 172.21.15.62:0/4178392422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30201a69e0 con 0x7f3020102360 2024-09-12T01:55:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.792+0000 7f3025c00640 1 -- 172.21.15.62:0/4178392422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30201a6f10 con 0x7f3020102360 2024-09-12T01:55:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.792+0000 7f301cc00640 1 -- 172.21.15.62:0/4178392422 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f300c031c90 con 0x7f3020102360 2024-09-12T01:55:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.792+0000 7f301cc00640 1 -- 172.21.15.62:0/4178392422 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c049060 con 0x7f3020102360 2024-09-12T01:55:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.793+0000 7f3025c00640 1 -- 172.21.15.62:0/4178392422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3000005290 con 0x7f3020102360 2024-09-12T01:55:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.795+0000 7f301cc00640 1 -- 172.21.15.62:0/4178392422 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f300c042070 con 0x7f3020102360 2024-09-12T01:55:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.796+0000 7f301cc00640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30040a2b80 0x7f30040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.796+0000 7f301cc00640 1 -- 172.21.15.62:0/4178392422 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f300c0ef1d0 con 0x7f3020102360 2024-09-12T01:55:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.796+0000 7f301fe00640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30040a2b80 0x7f30040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.797+0000 7f301fe00640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30040a2b80 0x7f30040a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3010009b50 tx=0x7f3010005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:48.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.798+0000 7f301cc00640 1 -- 172.21.15.62:0/4178392422 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f300c0bc530 con 0x7f3020102360 2024-09-12T01:55:48.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:48 smithi107 ceph-mon[35463]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:55:48.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:48 smithi107 ceph-mon[35463]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:48.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:48 smithi077 ceph-mon[35095]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:55:48.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:48 smithi077 ceph-mon[35095]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.984+0000 7f3025c00640 1 -- 172.21.15.62:0/4178392422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3000005850 con 0x7f3020102360 2024-09-12T01:55:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.985+0000 7f301cc00640 1 -- 172.21.15.62:0/4178392422 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18454 (secure 0 0 0) 0x7f300c0bbe30 con 0x7f3020102360 2024-09-12T01:55:48.986 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:55:48.986 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":77,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:55:47.516767+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.987+0000 7f3025c00640 1 -- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30040a2b80 msgr2=0x7f30040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.987+0000 7f3025c00640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30040a2b80 0x7f30040a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3010009b50 tx=0x7f3010005f90 comp rx=0 tx=0).stop 2024-09-12T01:55:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.987+0000 7f3025c00640 1 -- 172.21.15.62:0/4178392422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3020102360 msgr2=0x7f3020074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.987+0000 7f3025c00640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3020102360 0x7f3020074a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f300c02a960 tx=0x7f300c003b20 comp rx=0 tx=0).stop 2024-09-12T01:55:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.988+0000 7f3025c00640 1 -- 172.21.15.62:0/4178392422 shutdown_connections 2024-09-12T01:55:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.988+0000 7f3025c00640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30040a2b80 0x7f30040a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.988+0000 7f3025c00640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30201079c0 0x7f3020074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.988+0000 7f3025c00640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3020102360 0x7f3020074a30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.988+0000 7f3025c00640 1 --2- 172.21.15.62:0/4178392422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30201019c0 0x7f30200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.988+0000 7f3025c00640 1 -- 172.21.15.62:0/4178392422 >> 172.21.15.62:0/4178392422 conn(0x7f30200fd6e0 msgr2=0x7f30200fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.988+0000 7f3025c00640 1 -- 172.21.15.62:0/4178392422 shutdown_connections 2024-09-12T01:55:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:48.988+0000 7f3025c00640 1 -- 172.21.15.62:0/4178392422 wait complete. 2024-09-12T01:55:49.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:49 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4178392422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:49.944 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:51:44.080754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:55:49.944 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T01:55:49.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:49 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4178392422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:49.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:49 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4178392422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:50.314 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:50.785 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:50 smithi062 ceph-mon[30666]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:50.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.900+0000 7f688b600640 1 -- 172.21.15.62:0/3445421516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884103ff0 msgr2=0x7f68841043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.900+0000 7f688b600640 1 --2- 172.21.15.62:0/3445421516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884103ff0 0x7f68841043d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6878009900 tx=0x7f687802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.901+0000 7f688b600640 1 -- 172.21.15.62:0/3445421516 shutdown_connections 2024-09-12T01:55:50.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.901+0000 7f688b600640 1 --2- 172.21.15.62:0/3445421516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6884109120 0x7f6884110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.901+0000 7f688b600640 1 --2- 172.21.15.62:0/3445421516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68841049a0 0x7f68841089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.901+0000 7f688b600640 1 --2- 172.21.15.62:0/3445421516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884103ff0 0x7f68841043d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.901+0000 7f688b600640 1 -- 172.21.15.62:0/3445421516 >> 172.21.15.62:0/3445421516 conn(0x7f68840ffa90 msgr2=0x7f6884101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:50.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.901+0000 7f688b600640 1 -- 172.21.15.62:0/3445421516 shutdown_connections 2024-09-12T01:55:50.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.901+0000 7f688b600640 1 -- 172.21.15.62:0/3445421516 wait complete. 2024-09-12T01:55:50.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.902+0000 7f688b600640 1 Processor -- start 2024-09-12T01:55:50.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.902+0000 7f688b600640 1 -- start start 2024-09-12T01:55:50.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.902+0000 7f688b600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6884103ff0 0x7f688419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.902+0000 7f688b600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68841049a0 0x7f688419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.902+0000 7f688b600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884109120 0x7f688419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.902+0000 7f688b600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6884114150 con 0x7f6884109120 2024-09-12T01:55:50.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.902+0000 7f688b600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6884113fd0 con 0x7f6884103ff0 2024-09-12T01:55:50.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.902+0000 7f688b600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f68841142d0 con 0x7f68841049a0 2024-09-12T01:55:50.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.902+0000 7f6889600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884109120 0x7f688419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.902+0000 7f6889600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884109120 0x7f688419eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36738/0 (socket says 172.21.15.62:36738) 2024-09-12T01:55:50.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.903+0000 7f6889600640 1 -- 172.21.15.62:0/871110804 learned_addr learned my addr 172.21.15.62:0/871110804 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:55:50.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.903+0000 7f6888c00640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6884103ff0 0x7f688419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.903+0000 7f6883e00640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68841049a0 0x7f688419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.903+0000 7f6888c00640 1 -- 172.21.15.62:0/871110804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68841049a0 msgr2=0x7f688419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.903+0000 7f6888c00640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68841049a0 0x7f688419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.903+0000 7f6888c00640 1 -- 172.21.15.62:0/871110804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884109120 msgr2=0x7f688419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.903+0000 7f6888c00640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884109120 0x7f688419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.903+0000 7f6888c00640 1 -- 172.21.15.62:0/871110804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688419f5a0 con 0x7f6884103ff0 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.903+0000 7f6883e00640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68841049a0 0x7f688419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.903+0000 7f6888c00640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6884103ff0 0x7f688419a5f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6878005940 tx=0x7f68780040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.904+0000 7f6881600640 1 -- 172.21.15.62:0/871110804 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687803f030 con 0x7f6884103ff0 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.904+0000 7f6881600640 1 -- 172.21.15.62:0/871110804 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68780044c0 con 0x7f6884103ff0 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.904+0000 7f688b600640 1 -- 172.21.15.62:0/871110804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688419f830 con 0x7f6884103ff0 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.904+0000 7f6881600640 1 -- 172.21.15.62:0/871110804 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878035070 con 0x7f6884103ff0 2024-09-12T01:55:50.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.904+0000 7f688b600640 1 -- 172.21.15.62:0/871110804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68841a7170 con 0x7f6884103ff0 2024-09-12T01:55:50.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.905+0000 7f688b600640 1 -- 172.21.15.62:0/871110804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68841043d0 con 0x7f6884103ff0 2024-09-12T01:55:50.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.907+0000 7f6881600640 1 -- 172.21.15.62:0/871110804 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6878042030 con 0x7f6884103ff0 2024-09-12T01:55:50.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.908+0000 7f6881600640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f686c0a2c00 0x7f686c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.908+0000 7f6881600640 1 -- 172.21.15.62:0/871110804 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f68780eeec0 con 0x7f6884103ff0 2024-09-12T01:55:50.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.908+0000 7f6883e00640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f686c0a2c00 0x7f686c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.909+0000 7f6883e00640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f686c0a2c00 0x7f686c0a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f68700095f0 tx=0x7f6870005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:50.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:50.912+0000 7f6881600640 1 -- 172.21.15.62:0/871110804 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68780bbbd0 con 0x7f6884103ff0 2024-09-12T01:55:50.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:50 smithi107 ceph-mon[35463]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:50.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:50 smithi077 ceph-mon[35095]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:51.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.102+0000 7f688b600640 1 -- 172.21.15.62:0/871110804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f688410c300 con 0x7f6884103ff0 2024-09-12T01:55:51.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.103+0000 7f6881600640 1 -- 172.21.15.62:0/871110804 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f68780bfed0 con 0x7f6884103ff0 2024-09-12T01:55:51.103 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-09-12T01:55:51.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 -- 172.21.15.62:0/871110804 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f686c0a2c00 msgr2=0x7f686c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f686c0a2c00 0x7f686c0a50c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f68700095f0 tx=0x7f6870005f90 comp rx=0 tx=0).stop 2024-09-12T01:55:51.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 -- 172.21.15.62:0/871110804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6884103ff0 msgr2=0x7f688419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6884103ff0 0x7f688419a5f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6878005940 tx=0x7f68780040c0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 -- 172.21.15.62:0/871110804 shutdown_connections 2024-09-12T01:55:51.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f686c0a2c00 0x7f686c0a50c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6884109120 0x7f688419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68841049a0 0x7f688419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 --2- 172.21.15.62:0/871110804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6884103ff0 0x7f688419a5f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 -- 172.21.15.62:0/871110804 >> 172.21.15.62:0/871110804 conn(0x7f68840ffa90 msgr2=0x7f6884100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:51.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 -- 172.21.15.62:0/871110804 shutdown_connections 2024-09-12T01:55:51.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:51.105+0000 7f688b600640 1 -- 172.21.15.62:0/871110804 wait complete. 2024-09-12T01:55:51.799 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:51 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/871110804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:55:51.838 INFO:tasks.cephadm:Adding mds.a on smithi062 2024-09-12T01:55:51.838 INFO:tasks.cephadm:Adding mds.d on smithi062 2024-09-12T01:55:51.838 INFO:tasks.cephadm:Adding mds.g on smithi062 2024-09-12T01:55:51.838 INFO:tasks.cephadm:Adding mds.j on smithi062 2024-09-12T01:55:51.838 INFO:tasks.cephadm:Adding mds.b on smithi077 2024-09-12T01:55:51.838 INFO:tasks.cephadm:Adding mds.e on smithi077 2024-09-12T01:55:51.838 INFO:tasks.cephadm:Adding mds.h on smithi077 2024-09-12T01:55:51.839 INFO:tasks.cephadm:Adding mds.k on smithi077 2024-09-12T01:55:51.839 INFO:tasks.cephadm:Adding mds.c on smithi107 2024-09-12T01:55:51.839 INFO:tasks.cephadm:Adding mds.f on smithi107 2024-09-12T01:55:51.839 INFO:tasks.cephadm:Adding mds.i on smithi107 2024-09-12T01:55:51.839 INFO:tasks.cephadm:Adding mds.l on smithi107 2024-09-12T01:55:51.839 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi062=a;smithi062=d;smithi062=g;smithi062=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l' 2024-09-12T01:55:51.868 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:51 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/871110804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:55:51.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:51 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/871110804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:55:52.095 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:55:52.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.575+0000 7fed54a33640 1 -- 172.21.15.107:0/63843829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed50100ad0 msgr2=0x7fed50100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.575+0000 7fed54a33640 1 --2- 172.21.15.107:0/63843829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed50100ad0 0x7fed50100ed0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed40009900 tx=0x7fed4002a410 comp rx=0 tx=0).stop 2024-09-12T01:55:52.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.575+0000 7fed54a33640 1 -- 172.21.15.107:0/63843829 shutdown_connections 2024-09-12T01:55:52.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.575+0000 7fed54a33640 1 --2- 172.21.15.107:0/63843829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed50102690 0x7fed50108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.576+0000 7fed54a33640 1 --2- 172.21.15.107:0/63843829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50101cd0 0x7fed50102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.576+0000 7fed54a33640 1 --2- 172.21.15.107:0/63843829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed50100ad0 0x7fed50100ed0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.576+0000 7fed54a33640 1 -- 172.21.15.107:0/63843829 >> 172.21.15.107:0/63843829 conn(0x7fed500fc280 msgr2=0x7fed500fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.576+0000 7fed54a33640 1 -- 172.21.15.107:0/63843829 shutdown_connections 2024-09-12T01:55:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.576+0000 7fed54a33640 1 -- 172.21.15.107:0/63843829 wait complete. 2024-09-12T01:55:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.576+0000 7fed54a33640 1 Processor -- start 2024-09-12T01:55:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.576+0000 7fed54a33640 1 -- start start 2024-09-12T01:55:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.576+0000 7fed54a33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50100ad0 0x7fed50196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.576+0000 7fed54a33640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed50101cd0 0x7fed501973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.576+0000 7fed54a33640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed50102690 0x7fed5019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed54a33640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fed5010c7d0 con 0x7fed50102690 2024-09-12T01:55:52.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed54a33640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed5010c650 con 0x7fed50100ad0 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed54a33640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fed5010c950 con 0x7fed50101cd0 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4dd9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed50101cd0 0x7fed501973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4dd9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed50101cd0 0x7fed501973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37600/0 (socket says 172.21.15.107:37600) 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4dd9b640 1 -- 172.21.15.107:0/3157872487 learned_addr learned my addr 172.21.15.107:0/3157872487 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4e59c640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50100ad0 0x7fed50196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4dd9b640 1 -- 172.21.15.107:0/3157872487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50100ad0 msgr2=0x7fed50196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4dd9b640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50100ad0 0x7fed50196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4dd9b640 1 -- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed50102690 msgr2=0x7fed5019e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4ed9d640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed50102690 0x7fed5019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4dd9b640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed50102690 0x7fed5019e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4dd9b640 1 -- 172.21.15.107:0/3157872487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5019eaa0 con 0x7fed50101cd0 2024-09-12T01:55:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4e59c640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50100ad0 0x7fed50196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4ed9d640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed50102690 0x7fed5019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed4dd9b640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed50101cd0 0x7fed501973b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed4400d770 tx=0x7fed4400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed3f7fe640 1 -- 172.21.15.107:0/3157872487 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44017070 con 0x7fed50101cd0 2024-09-12T01:55:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed3f7fe640 1 -- 172.21.15.107:0/3157872487 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed44005500 con 0x7fed50101cd0 2024-09-12T01:55:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed54a33640 1 -- 172.21.15.107:0/3157872487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5019ed90 con 0x7fed50101cd0 2024-09-12T01:55:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.577+0000 7fed3f7fe640 1 -- 172.21.15.107:0/3157872487 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44004e00 con 0x7fed50101cd0 2024-09-12T01:55:52.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.578+0000 7fed54a33640 1 -- 172.21.15.107:0/3157872487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed50069f70 con 0x7fed50101cd0 2024-09-12T01:55:52.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.579+0000 7fed54a33640 1 -- 172.21.15.107:0/3157872487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed5006a990 con 0x7fed50101cd0 2024-09-12T01:55:52.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.580+0000 7fed3f7fe640 1 -- 172.21.15.107:0/3157872487 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fed44004fa0 con 0x7fed50101cd0 2024-09-12T01:55:52.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.581+0000 7fed3f7fe640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fed380a4dc0 0x7fed380a7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.581+0000 7fed3f7fe640 1 -- 172.21.15.107:0/3157872487 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fed440ce650 con 0x7fed50101cd0 2024-09-12T01:55:52.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.581+0000 7fed4e59c640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fed380a4dc0 0x7fed380a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.582+0000 7fed4e59c640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fed380a4dc0 0x7fed380a7280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed40006010 tx=0x7fed40032dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.585+0000 7fed3f7fe640 1 -- 172.21.15.107:0/3157872487 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed4409ba50 con 0x7fed50101cd0 2024-09-12T01:55:52.755 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:52 smithi107 ceph-mon[35463]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:52.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.764+0000 7fed54a33640 1 -- 172.21.15.107:0/3157872487 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi062=a;smithi062=d;smithi062=g;smithi062=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l", "target": ["mon-mgr", ""]}) -- 0x7fed50107bb0 con 0x7fed380a4dc0 2024-09-12T01:55:52.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.773+0000 7fed3f7fe640 1 -- 172.21.15.107:0/3157872487 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fed50107bb0 con 0x7fed380a4dc0 2024-09-12T01:55:52.773 INFO:teuthology.orchestra.run.smithi107.stdout:Scheduled mds.all update... 2024-09-12T01:55:52.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.775+0000 7fed54a33640 1 -- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fed380a4dc0 msgr2=0x7fed380a7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.775+0000 7fed54a33640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fed380a4dc0 0x7fed380a7280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed40006010 tx=0x7fed40032dd0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.775+0000 7fed54a33640 1 -- 172.21.15.107:0/3157872487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed50101cd0 msgr2=0x7fed501973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.775+0000 7fed54a33640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed50101cd0 0x7fed501973b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed4400d770 tx=0x7fed4400dc30 comp rx=0 tx=0).stop 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.775+0000 7fed54a33640 1 -- 172.21.15.107:0/3157872487 shutdown_connections 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.775+0000 7fed54a33640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fed380a4dc0 0x7fed380a7280 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.775+0000 7fed54a33640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed50102690 0x7fed5019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.775+0000 7fed54a33640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed50101cd0 0x7fed501973b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.775+0000 7fed54a33640 1 --2- 172.21.15.107:0/3157872487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed50100ad0 0x7fed50196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.775+0000 7fed54a33640 1 -- 172.21.15.107:0/3157872487 >> 172.21.15.107:0/3157872487 conn(0x7fed500fc280 msgr2=0x7fed501050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.776+0000 7fed54a33640 1 -- 172.21.15.107:0/3157872487 shutdown_connections 2024-09-12T01:55:52.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T01:55:52.776+0000 7fed54a33640 1 -- 172.21.15.107:0/3157872487 wait complete. 2024-09-12T01:55:52.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:52 smithi062 ceph-mon[30666]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:52.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:52 smithi077 ceph-mon[35095]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:53.533 DEBUG:teuthology.orchestra.run.smithi062:mds.a> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T01:55:53.537 DEBUG:teuthology.orchestra.run.smithi062:mds.d> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T01:55:53.583 DEBUG:teuthology.orchestra.run.smithi062:mds.g> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T01:55:53.628 DEBUG:teuthology.orchestra.run.smithi062:mds.j> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T01:55:53.673 DEBUG:teuthology.orchestra.run.smithi077:mds.b> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T01:55:53.675 DEBUG:teuthology.orchestra.run.smithi077:mds.e> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T01:55:53.721 DEBUG:teuthology.orchestra.run.smithi077:mds.h> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T01:55:53.764 DEBUG:teuthology.orchestra.run.smithi077:mds.k> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T01:55:53.809 DEBUG:teuthology.orchestra.run.smithi107:mds.c> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T01:55:53.811 DEBUG:teuthology.orchestra.run.smithi107:mds.f> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T01:55:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi062=a;smithi062=d;smithi062=g;smithi062=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: Saving service mds.all spec with placement smithi062=a;smithi062=d;smithi062=g;smithi062=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l;count:12 2024-09-12T01:55:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:53.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:55:53.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:55:53.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:53.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:53 smithi062 ceph-mon[30666]: Deploying daemon mds.l on smithi107 2024-09-12T01:55:53.856 DEBUG:teuthology.orchestra.run.smithi107:mds.i> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T01:55:53.900 DEBUG:teuthology.orchestra.run.smithi107:mds.l> sudo journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T01:55:53.943 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T01:55:53.943 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:55:53.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi062=a;smithi062=d;smithi062=g;smithi062=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:53.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: Saving service mds.all spec with placement smithi062=a;smithi062=d;smithi062=g;smithi062=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l;count:12 2024-09-12T01:55:53.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:53.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:53.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:53.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:53.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:53.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:55:53.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:55:53.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:53.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:53 smithi077 ceph-mon[35095]: Deploying daemon mds.l on smithi107 2024-09-12T01:55:54.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi062=a;smithi062=d;smithi062=g;smithi062=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:54.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: Saving service mds.all spec with placement smithi062=a;smithi062=d;smithi062=g;smithi062=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l;count:12 2024-09-12T01:55:54.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:54.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:54.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:54.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:54.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:54.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:55:54.091 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:55:54.092 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:54.092 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:53 smithi107 ceph-mon[35463]: Deploying daemon mds.l on smithi107 2024-09-12T01:55:54.313 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.898+0000 7fc0f7200640 1 -- 172.21.15.62:0/1348079926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f0102790 msgr2=0x7fc0f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.898+0000 7fc0f7200640 1 --2- 172.21.15.62:0/1348079926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f0102790 0x7fc0f01067e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009900 tx=0x7fc0dc02a410 comp rx=0 tx=0).stop 2024-09-12T01:55:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.898+0000 7fc0f7200640 1 -- 172.21.15.62:0/1348079926 shutdown_connections 2024-09-12T01:55:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.898+0000 7fc0f7200640 1 --2- 172.21.15.62:0/1348079926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f0106f10 0x7fc0f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.898+0000 7fc0f7200640 1 --2- 172.21.15.62:0/1348079926 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f0102790 0x7fc0f01067e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.898+0000 7fc0f7200640 1 --2- 172.21.15.62:0/1348079926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0f0101de0 0x7fc0f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.898+0000 7fc0f7200640 1 -- 172.21.15.62:0/1348079926 >> 172.21.15.62:0/1348079926 conn(0x7fc0f00fd8c0 msgr2=0x7fc0f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.898+0000 7fc0f7200640 1 -- 172.21.15.62:0/1348079926 shutdown_connections 2024-09-12T01:55:54.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.898+0000 7fc0f7200640 1 -- 172.21.15.62:0/1348079926 wait complete. 2024-09-12T01:55:54.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.899+0000 7fc0f7200640 1 Processor -- start 2024-09-12T01:55:54.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.899+0000 7fc0f7200640 1 -- start start 2024-09-12T01:55:54.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.899+0000 7fc0f7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0f0101de0 0x7fc0f019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.899+0000 7fc0f7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f0102790 0x7fc0f019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.899+0000 7fc0f7200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f0106f10 0x7fc0f019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.899+0000 7fc0f7200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f0111fc0 con 0x7fc0f0106f10 2024-09-12T01:55:54.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.899+0000 7fc0f7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f0111e40 con 0x7fc0f0102790 2024-09-12T01:55:54.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.899+0000 7fc0f7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f0112140 con 0x7fc0f0101de0 2024-09-12T01:55:54.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.900+0000 7fc0f5200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f0106f10 0x7fc0f019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.900+0000 7fc0ef400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f0102790 0x7fc0f019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.900+0000 7fc0ef400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f0102790 0x7fc0f019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:33960/0 (socket says 172.21.15.62:33960) 2024-09-12T01:55:54.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.900+0000 7fc0ef400640 1 -- 172.21.15.62:0/588052604 learned_addr learned my addr 172.21.15.62:0/588052604 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:55:54.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.900+0000 7fc0efe00640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0f0101de0 0x7fc0f019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.900+0000 7fc0ef400640 1 -- 172.21.15.62:0/588052604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0f0101de0 msgr2=0x7fc0f019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.900+0000 7fc0ef400640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0f0101de0 0x7fc0f019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.900+0000 7fc0ef400640 1 -- 172.21.15.62:0/588052604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f0106f10 msgr2=0x7fc0f019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.900+0000 7fc0ef400640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f0106f10 0x7fc0f019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.900+0000 7fc0ef400640 1 -- 172.21.15.62:0/588052604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f019f650 con 0x7fc0f0102790 2024-09-12T01:55:54.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.901+0000 7fc0ef400640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f0102790 0x7fc0f019abe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc004770 tx=0x7fc0dc003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:54.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.901+0000 7fc0ecc00640 1 -- 172.21.15.62:0/588052604 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc03f070 con 0x7fc0f0102790 2024-09-12T01:55:54.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.901+0000 7fc0f7200640 1 -- 172.21.15.62:0/588052604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f019f8e0 con 0x7fc0f0102790 2024-09-12T01:55:54.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.901+0000 7fc0ecc00640 1 -- 172.21.15.62:0/588052604 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0dc031ca0 con 0x7fc0f0102790 2024-09-12T01:55:54.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.901+0000 7fc0ecc00640 1 -- 172.21.15.62:0/588052604 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc035030 con 0x7fc0f0102790 2024-09-12T01:55:54.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.901+0000 7fc0f7200640 1 -- 172.21.15.62:0/588052604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f01a7220 con 0x7fc0f0102790 2024-09-12T01:55:54.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.902+0000 7fc0f7200640 1 -- 172.21.15.62:0/588052604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f01021c0 con 0x7fc0f0102790 2024-09-12T01:55:54.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.905+0000 7fc0ecc00640 1 -- 172.21.15.62:0/588052604 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc0dc042070 con 0x7fc0f0102790 2024-09-12T01:55:54.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.906+0000 7fc0ecc00640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0d40a2b80 0x7fc0d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.906+0000 7fc0ecc00640 1 -- 172.21.15.62:0/588052604 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fc0dc0ef450 con 0x7fc0f0102790 2024-09-12T01:55:54.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.907+0000 7fc0efe00640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0d40a2b80 0x7fc0d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.907+0000 7fc0efe00640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0d40a2b80 0x7fc0d40a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009bd0 tx=0x7fc0e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:54.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:54.908+0000 7fc0ecc00640 1 -- 172.21.15.62:0/588052604 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0dc0bc220 con 0x7fc0f0102790 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.132+0000 7fc0f7200640 1 -- 172.21.15.62:0/588052604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0f019ba00 con 0x7fc0f0102790 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.133+0000 7fc0ecc00640 1 -- 172.21.15.62:0/588052604 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fc0dc0c0520 con 0x7fc0f0102790 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":1,"btime":"2024-09-12T01:48:25:739215+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 1 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.135+0000 7fc0f7200640 1 -- 172.21.15.62:0/588052604 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0d40a2b80 msgr2=0x7fc0d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.135+0000 7fc0f7200640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0d40a2b80 0x7fc0d40a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009bd0 tx=0x7fc0e0005f90 comp rx=0 tx=0).stop 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.135+0000 7fc0f7200640 1 -- 172.21.15.62:0/588052604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f0102790 msgr2=0x7fc0f019abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.135+0000 7fc0f7200640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f0102790 0x7fc0f019abe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc004770 tx=0x7fc0dc003c10 comp rx=0 tx=0).stop 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.136+0000 7fc0f7200640 1 -- 172.21.15.62:0/588052604 shutdown_connections 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.136+0000 7fc0f7200640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0d40a2b80 0x7fc0d40a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.136+0000 7fc0f7200640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0f0106f10 0x7fc0f019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.136+0000 7fc0f7200640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f0102790 0x7fc0f019abe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.136+0000 7fc0f7200640 1 --2- 172.21.15.62:0/588052604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc0f0101de0 0x7fc0f019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.136+0000 7fc0f7200640 1 -- 172.21.15.62:0/588052604 >> 172.21.15.62:0/588052604 conn(0x7fc0f00fd8c0 msgr2=0x7fc0f00feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.136+0000 7fc0f7200640 1 -- 172.21.15.62:0/588052604 shutdown_connections 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:55.136+0000 7fc0f7200640 1 -- 172.21.15.62:0/588052604 wait complete. 2024-09-12T01:55:55.451 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:55 smithi107 ceph-mon[35463]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:55.451 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:55 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/588052604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:55.451 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 01:55:55 smithi107 systemd[1]: Starting Ceph mds.l for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:55:55.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:55 smithi077 ceph-mon[35095]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:55.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:55 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/588052604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:55.542 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:55 smithi062 ceph-mon[30666]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:55.542 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:55 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/588052604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:55.703 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 01:55:55 smithi107 podman[64923]: 2024-09-12 01:55:55.35386846 +0000 UTC m=+0.016087378 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:55:55.703 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 01:55:55 smithi107 podman[64923]: 2024-09-12 01:55:55.490435149 +0000 UTC m=+0.152654062 container create 4b7050e0c909c9b9598570613a9b89c1bb316a35f99e12eb9b57911d01230d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T01:55:56.203 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 01:55:55 smithi107 podman[64923]: 2024-09-12 01:55:55.759341021 +0000 UTC m=+0.421559926 container init 4b7050e0c909c9b9598570613a9b89c1bb316a35f99e12eb9b57911d01230d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-l, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T01:55:56.203 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 01:55:55 smithi107 podman[64923]: 2024-09-12 01:55:55.762202754 +0000 UTC m=+0.424421659 container start 4b7050e0c909c9b9598570613a9b89c1bb316a35f99e12eb9b57911d01230d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-l, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T01:55:56.204 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 01:55:55 smithi107 ceph-mds[64942]: -- 172.21.15.107:0/348859300 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f81483860 con 0x558f81460800 2024-09-12T01:55:56.204 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 01:55:55 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-l[64938]: starting mds.l at 2024-09-12T01:55:56.204 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 01:55:55 smithi107 bash[64923]: 4b7050e0c909c9b9598570613a9b89c1bb316a35f99e12eb9b57911d01230d1e 2024-09-12T01:55:56.204 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 01:55:55 smithi107 systemd[1]: Started Ceph mds.l for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:55:56.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:56.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.107:6832/1286528646,v1:172.21.15.107:6833/1286528646] up:boot 2024-09-12T01:55:56.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: fsmap 1 up:standby 2024-09-12T01:55:56.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:55:56.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:56.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:56.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:56.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:55:56.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:55:56.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:56.966 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:56 smithi077 ceph-mon[35095]: Deploying daemon mds.k on smithi077 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.107:6832/1286528646,v1:172.21.15.107:6833/1286528646] up:boot 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: fsmap 1 up:standby 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:57.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:56 smithi062 ceph-mon[30666]: Deploying daemon mds.k on smithi077 2024-09-12T01:55:57.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:57.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.107:6832/1286528646,v1:172.21.15.107:6833/1286528646] up:boot 2024-09-12T01:55:57.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: fsmap 1 up:standby 2024-09-12T01:55:57.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:55:57.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:57.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:57.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:57.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:55:57.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:55:57.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:57.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:56 smithi107 ceph-mon[35463]: Deploying daemon mds.k on smithi077 2024-09-12T01:55:58.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:55:58.124 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 01:55:57 smithi077 systemd[1]: Starting Ceph mds.k for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:55:58.394 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 01:55:58 smithi077 podman[64377]: 2024-09-12 01:55:58.026220867 +0000 UTC m=+0.016185783 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:55:58.394 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 01:55:58 smithi077 podman[64377]: 2024-09-12 01:55:58.141755121 +0000 UTC m=+0.131720034 container create dce792c92bc6fbf978603227c224f498e8c2eb8de97732ffa3b454b8e3163eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T01:55:58.395 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 01:55:58 smithi077 podman[64377]: 2024-09-12 01:55:58.394610351 +0000 UTC m=+0.384575264 container init dce792c92bc6fbf978603227c224f498e8c2eb8de97732ffa3b454b8e3163eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T01:55:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:58.714 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 01:55:58 smithi077 podman[64377]: 2024-09-12 01:55:58.397466028 +0000 UTC m=+0.387430942 container start dce792c92bc6fbf978603227c224f498e8c2eb8de97732ffa3b454b8e3163eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T01:55:58.714 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 01:55:58 smithi077 ceph-mds[64396]: -- 172.21.15.77:0/1980214314 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572c8895860 con 0x5572c8873400 2024-09-12T01:55:58.714 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 01:55:58 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-k[64392]: starting mds.k at 2024-09-12T01:55:58.715 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 01:55:58 smithi077 bash[64377]: dce792c92bc6fbf978603227c224f498e8c2eb8de97732ffa3b454b8e3163eb5 2024-09-12T01:55:58.715 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 01:55:58 smithi077 systemd[1]: Started Ceph mds.k for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:55:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:58 smithi062 ceph-mon[30666]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:55:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:55:58.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:58 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:59.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.004+0000 7fcaf5a00640 1 -- 172.21.15.62:0/3548881839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf01047e0 msgr2=0x7fcaf0108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.004+0000 7fcaf5a00640 1 --2- 172.21.15.62:0/3548881839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf01047e0 0x7fcaf0108830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009900 tx=0x7fcad802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.004+0000 7fcaf5a00640 1 -- 172.21.15.62:0/3548881839 shutdown_connections 2024-09-12T01:55:59.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.004+0000 7fcaf5a00640 1 --2- 172.21.15.62:0/3548881839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf0108f60 0x7fcaf0110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.004+0000 7fcaf5a00640 1 --2- 172.21.15.62:0/3548881839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf01047e0 0x7fcaf0108830 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.004+0000 7fcaf5a00640 1 --2- 172.21.15.62:0/3548881839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0103e30 0x7fcaf0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.004+0000 7fcaf5a00640 1 -- 172.21.15.62:0/3548881839 >> 172.21.15.62:0/3548881839 conn(0x7fcaf00ff8d0 msgr2=0x7fcaf0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:59.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.004+0000 7fcaf5a00640 1 -- 172.21.15.62:0/3548881839 shutdown_connections 2024-09-12T01:55:59.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.004+0000 7fcaf5a00640 1 -- 172.21.15.62:0/3548881839 wait complete. 2024-09-12T01:55:59.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.005+0000 7fcaf5a00640 1 Processor -- start 2024-09-12T01:55:59.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.005+0000 7fcaf5a00640 1 -- start start 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.005+0000 7fcaf5a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf0103e30 0x7fcaf019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.005+0000 7fcaf5a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf01047e0 0x7fcaf019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.005+0000 7fcaf5a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0108f60 0x7fcaf019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.005+0000 7fcaf5a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0114010 con 0x7fcaf0108f60 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.005+0000 7fcaf5a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0113e90 con 0x7fcaf0103e30 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.005+0000 7fcaf5a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0114190 con 0x7fcaf01047e0 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcaefe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf0103e30 0x7fcaf019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcae7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf01047e0 0x7fcaf019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcae7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf01047e0 0x7fcaf019a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:51466/0 (socket says 172.21.15.62:51466) 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcae7400640 1 -- 172.21.15.62:0/644270610 learned_addr learned my addr 172.21.15.62:0/644270610 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:55:59.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcaf5000640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0108f60 0x7fcaf019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcaefe00640 1 -- 172.21.15.62:0/644270610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf01047e0 msgr2=0x7fcaf019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcaefe00640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf01047e0 0x7fcaf019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcaefe00640 1 -- 172.21.15.62:0/644270610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0108f60 msgr2=0x7fcaf019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcaefe00640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0108f60 0x7fcaf019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcaefe00640 1 -- 172.21.15.62:0/644270610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf019f440 con 0x7fcaf0103e30 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.006+0000 7fcaefe00640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf0103e30 0x7fcaf019a490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9f0 tx=0x7fcae000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.007+0000 7fcaed600640 1 -- 172.21.15.62:0/644270610 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae000ccc0 con 0x7fcaf0103e30 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.007+0000 7fcaed600640 1 -- 172.21.15.62:0/644270610 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae0010910 con 0x7fcaf0103e30 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.007+0000 7fcaed600640 1 -- 172.21.15.62:0/644270610 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0018960 con 0x7fcaf0103e30 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.007+0000 7fcaf5a00640 1 -- 172.21.15.62:0/644270610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf019f730 con 0x7fcaf0103e30 2024-09-12T01:55:59.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.007+0000 7fcaf5a00640 1 -- 172.21.15.62:0/644270610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf01a7010 con 0x7fcaf0103e30 2024-09-12T01:55:59.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.008+0000 7fcaf5a00640 1 -- 172.21.15.62:0/644270610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf0104210 con 0x7fcaf0103e30 2024-09-12T01:55:59.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.009+0000 7fcaed600640 1 -- 172.21.15.62:0/644270610 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcae0010ac0 con 0x7fcaf0103e30 2024-09-12T01:55:59.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.011+0000 7fcaed600640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcad40a2c00 0x7fcad40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:59.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.011+0000 7fcaed600640 1 -- 172.21.15.62:0/644270610 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fcae00cef30 con 0x7fcaf0103e30 2024-09-12T01:55:59.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.011+0000 7fcae7400640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcad40a2c00 0x7fcad40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:59.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.012+0000 7fcae7400640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcad40a2c00 0x7fcad40a50c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcad80096c0 tx=0x7fcad80046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:59.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.015+0000 7fcaed600640 1 -- 172.21.15.62:0/644270610 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcae009bc40 con 0x7fcaf0103e30 2024-09-12T01:55:59.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:58 smithi107 ceph-mon[35463]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:59.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:59.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:59.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:59.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:55:59.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:55:59.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:58 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:58 smithi077 ceph-mon[35095]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:55:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:55:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:55:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:58 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:59.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.268+0000 7fcaf5a00640 1 -- 172.21.15.62:0/644270610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaf010c200 con 0x7fcaf0103e30 2024-09-12T01:55:59.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.268+0000 7fcaed600640 1 -- 172.21.15.62:0/644270610 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7fcae009ff40 con 0x7fcaf0103e30 2024-09-12T01:55:59.269 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:55:59.269 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":3,"btime":"2024-09-12T01:55:58:797319+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T01:55:59.270 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 3 2024-09-12T01:55:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 -- 172.21.15.62:0/644270610 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcad40a2c00 msgr2=0x7fcad40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcad40a2c00 0x7fcad40a50c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcad80096c0 tx=0x7fcad80046c0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 -- 172.21.15.62:0/644270610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf0103e30 msgr2=0x7fcaf019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf0103e30 0x7fcaf019a490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9f0 tx=0x7fcae000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 -- 172.21.15.62:0/644270610 shutdown_connections 2024-09-12T01:55:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fcad40a2c00 0x7fcad40a50c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcaf0108f60 0x7fcaf019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcaf01047e0 0x7fcaf019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 --2- 172.21.15.62:0/644270610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf0103e30 0x7fcaf019a490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:59.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 -- 172.21.15.62:0/644270610 >> 172.21.15.62:0/644270610 conn(0x7fcaf00ff8d0 msgr2=0x7fcaf0100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:59.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 -- 172.21.15.62:0/644270610 shutdown_connections 2024-09-12T01:55:59.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:55:59.271+0000 7fcaf5a00640 1 -- 172.21.15.62:0/644270610 wait complete. 2024-09-12T01:56:00.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:59 smithi062 ceph-mon[30666]: Deploying daemon mds.j on smithi062 2024-09-12T01:56:00.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:59 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.77:6832/2149975547,v1:172.21.15.77:6833/2149975547] up:boot 2024-09-12T01:56:00.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:59 smithi062 ceph-mon[30666]: fsmap 2 up:standby 2024-09-12T01:56:00.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:59 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:56:00.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:55:59 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/644270610' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:00.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:59 smithi107 ceph-mon[35463]: Deploying daemon mds.j on smithi062 2024-09-12T01:56:00.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:59 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.77:6832/2149975547,v1:172.21.15.77:6833/2149975547] up:boot 2024-09-12T01:56:00.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:59 smithi107 ceph-mon[35463]: fsmap 2 up:standby 2024-09-12T01:56:00.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:59 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:56:00.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:55:59 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/644270610' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:00.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:59 smithi077 ceph-mon[35095]: Deploying daemon mds.j on smithi062 2024-09-12T01:56:00.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:59 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.77:6832/2149975547,v1:172.21.15.77:6833/2149975547] up:boot 2024-09-12T01:56:00.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:59 smithi077 ceph-mon[35095]: fsmap 2 up:standby 2024-09-12T01:56:00.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:59 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:56:00.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:55:59 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/644270610' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:01.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:00 smithi062 ceph-mon[30666]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:01.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:00 smithi107 ceph-mon[35463]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:01.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:00 smithi077 ceph-mon[35095]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:02.092 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 01:56:01 smithi062 systemd[1]: Starting Ceph mds.j for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:02.405 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 01:56:02 smithi062 podman[70551]: 2024-09-12 01:56:02.027747339 +0000 UTC m=+0.027630534 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:02.405 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 01:56:02 smithi062 podman[70551]: 2024-09-12 01:56:02.132029783 +0000 UTC m=+0.131912984 container create ac2606fdddeac63eb5982cf2a2ca732665dcc79e5f78a6f73c87e338652afaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T01:56:02.405 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 01:56:02 smithi062 podman[70551]: 2024-09-12 01:56:02.359757826 +0000 UTC m=+0.359641021 container init ac2606fdddeac63eb5982cf2a2ca732665dcc79e5f78a6f73c87e338652afaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:02.405 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 01:56:02 smithi062 podman[70551]: 2024-09-12 01:56:02.366063919 +0000 UTC m=+0.365947123 container start ac2606fdddeac63eb5982cf2a2ca732665dcc79e5f78a6f73c87e338652afaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T01:56:02.818 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 01:56:02 smithi062 ceph-mds[70570]: -- 172.21.15.62:0/2211766755 <== mon.0 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5593246afc20 con 0x55932468d000 2024-09-12T01:56:02.818 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 01:56:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-j[70566]: starting mds.j at 2024-09-12T01:56:02.818 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 01:56:02 smithi062 bash[70551]: ac2606fdddeac63eb5982cf2a2ca732665dcc79e5f78a6f73c87e338652afaeb 2024-09-12T01:56:02.818 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 01:56:02 smithi062 systemd[1]: Started Ceph mds.j for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:03.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:02 smithi062 ceph-mon[30666]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:03.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:02 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:03.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:02 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:03.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:02 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:03.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:02 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:03.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:02 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:03.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:02 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:03.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:02 smithi107 ceph-mon[35463]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:03.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:02 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:03.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:02 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:03.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:02 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:03.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:02 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:03.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:02 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:03.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:02 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:03.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:02 smithi077 ceph-mon[35095]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:03.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:02 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:03.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:02 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:03.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:02 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:03.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:02 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:03.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:02 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:03.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:02 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:03.377 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:04.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:03 smithi062 ceph-mon[30666]: Deploying daemon mds.d on smithi062 2024-09-12T01:56:04.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:03 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.62:6834/2717043895,v1:172.21.15.62:6835/2717043895] up:boot 2024-09-12T01:56:04.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:03 smithi062 ceph-mon[30666]: fsmap 3 up:standby 2024-09-12T01:56:04.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:03 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:56:04.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:03 smithi107 ceph-mon[35463]: Deploying daemon mds.d on smithi062 2024-09-12T01:56:04.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:03 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.62:6834/2717043895,v1:172.21.15.62:6835/2717043895] up:boot 2024-09-12T01:56:04.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:03 smithi107 ceph-mon[35463]: fsmap 3 up:standby 2024-09-12T01:56:04.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:03 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:56:04.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:03 smithi077 ceph-mon[35095]: Deploying daemon mds.d on smithi062 2024-09-12T01:56:04.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:03 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.62:6834/2717043895,v1:172.21.15.62:6835/2717043895] up:boot 2024-09-12T01:56:04.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:03 smithi077 ceph-mon[35095]: fsmap 3 up:standby 2024-09-12T01:56:04.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:03 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:56:04.342 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:05.031 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:04 smithi062 ceph-mon[30666]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:05.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.031+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2085384370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7dc1019c0 msgr2=0x7ff7dc101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.031+0000 7ff7e2e00640 1 --2- 172.21.15.62:0/2085384370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7dc1019c0 0x7ff7dc101e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009930 tx=0x7ff7c802a420 comp rx=0 tx=0).stop 2024-09-12T01:56:05.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.031+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2085384370 shutdown_connections 2024-09-12T01:56:05.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.031+0000 7ff7e2e00640 1 --2- 172.21.15.62:0/2085384370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7dc102360 0x7ff7dc10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.031+0000 7ff7e2e00640 1 --2- 172.21.15.62:0/2085384370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7dc1019c0 0x7ff7dc101e20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.031+0000 7ff7e2e00640 1 --2- 172.21.15.62:0/2085384370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7dc1079c0 0x7ff7dc107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.031+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2085384370 >> 172.21.15.62:0/2085384370 conn(0x7ff7dc0fd740 msgr2=0x7ff7dc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.031+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2085384370 shutdown_connections 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.031+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2085384370 wait complete. 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.032+0000 7ff7e2e00640 1 Processor -- start 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e2e00640 1 -- start start 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e2e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7dc1019c0 0x7ff7dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e2e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7dc102360 0x7ff7dc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e2e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7dc1079c0 0x7ff7dc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e2e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc111e10 con 0x7ff7dc1019c0 2024-09-12T01:56:05.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e2e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc111c90 con 0x7ff7dc102360 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e2e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc111f90 con 0x7ff7dc1079c0 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e1a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7dc1019c0 0x7ff7dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e1000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7dc102360 0x7ff7dc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e1a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7dc1019c0 0x7ff7dc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38566/0 (socket says 172.21.15.62:38566) 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.033+0000 7ff7e1a00640 1 -- 172.21.15.62:0/2755491552 learned_addr learned my addr 172.21.15.62:0/2755491552 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.034+0000 7ff7e2400640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7dc1079c0 0x7ff7dc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.034+0000 7ff7e1000640 1 -- 172.21.15.62:0/2755491552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7dc1079c0 msgr2=0x7ff7dc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.034+0000 7ff7e1000640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7dc1079c0 0x7ff7dc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.034+0000 7ff7e1000640 1 -- 172.21.15.62:0/2755491552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7dc1019c0 msgr2=0x7ff7dc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.034+0000 7ff7e1000640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7dc1019c0 0x7ff7dc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.034+0000 7ff7e1000640 1 -- 172.21.15.62:0/2755491552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc1a6770 con 0x7ff7dc102360 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.034+0000 7ff7e2400640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7dc1079c0 0x7ff7dc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.034+0000 7ff7e1000640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7dc102360 0x7ff7dc074a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7c802a940 tx=0x7ff7c8003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.035+0000 7ff7da000640 1 -- 172.21.15.62:0/2755491552 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c803f070 con 0x7ff7dc102360 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.035+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2755491552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7dc1a6a00 con 0x7ff7dc102360 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.035+0000 7ff7da000640 1 -- 172.21.15.62:0/2755491552 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7c8031c90 con 0x7ff7dc102360 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.035+0000 7ff7da000640 1 -- 172.21.15.62:0/2755491552 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8035030 con 0x7ff7dc102360 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.035+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2755491552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7dc1a6ee0 con 0x7ff7dc102360 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.036+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2755491552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7dc101e20 con 0x7ff7dc102360 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.038+0000 7ff7da000640 1 -- 172.21.15.62:0/2755491552 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff7c8042070 con 0x7ff7dc102360 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.039+0000 7ff7da000640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff7c40a2b80 0x7ff7c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.039+0000 7ff7da000640 1 -- 172.21.15.62:0/2755491552 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff7c80efbc0 con 0x7ff7dc102360 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.039+0000 7ff7e1a00640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff7c40a2b80 0x7ff7c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.040+0000 7ff7e1a00640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff7c40a2b80 0x7ff7c40a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00095f0 tx=0x7ff7d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.042+0000 7ff7da000640 1 -- 172.21.15.62:0/2755491552 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7c80bcf20 con 0x7ff7dc102360 2024-09-12T01:56:05.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:04 smithi107 ceph-mon[35463]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:05.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:04 smithi077 ceph-mon[35095]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:05.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.284+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2755491552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7dc075a20 con 0x7ff7dc102360 2024-09-12T01:56:05.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.285+0000 7ff7da000640 1 -- 172.21.15.62:0/2755491552 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7ff7dc075a20 con 0x7ff7dc102360 2024-09-12T01:56:05.285 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:05.285 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":4,"btime":"2024-09-12T01:56:02:817430+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T01:56:05.285 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 4 2024-09-12T01:56:05.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2755491552 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff7c40a2b80 msgr2=0x7ff7c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff7c40a2b80 0x7ff7c40a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00095f0 tx=0x7ff7d0005f90 comp rx=0 tx=0).stop 2024-09-12T01:56:05.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2755491552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7dc102360 msgr2=0x7ff7dc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7dc102360 0x7ff7dc074a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7c802a940 tx=0x7ff7c8003b20 comp rx=0 tx=0).stop 2024-09-12T01:56:05.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2755491552 shutdown_connections 2024-09-12T01:56:05.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff7c40a2b80 0x7ff7c40a5040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7dc1079c0 0x7ff7dc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7dc102360 0x7ff7dc074a30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 --2- 172.21.15.62:0/2755491552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7dc1019c0 0x7ff7dc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2755491552 >> 172.21.15.62:0/2755491552 conn(0x7ff7dc0fd740 msgr2=0x7ff7dc0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:05.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2755491552 shutdown_connections 2024-09-12T01:56:05.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:05.288+0000 7ff7e2e00640 1 -- 172.21.15.62:0/2755491552 wait complete. 2024-09-12T01:56:05.592 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 01:56:05 smithi062 podman[70945]: 2024-09-12 01:56:05.301121947 +0000 UTC m=+0.028159112 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:06.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:05 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2755491552' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:06.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:05 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2755491552' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:06.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:05 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2755491552' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:06.421 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 01:56:06 smithi062 podman[70945]: 2024-09-12 01:56:06.263784023 +0000 UTC m=+0.990821186 container create c011d2c1515f3813ddf35cc61628d7baa5e9d387327c3002e9062dc6076903c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-d, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T01:56:06.841 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 01:56:06 smithi062 podman[70945]: 2024-09-12 01:56:06.524769691 +0000 UTC m=+1.251806855 container init c011d2c1515f3813ddf35cc61628d7baa5e9d387327c3002e9062dc6076903c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T01:56:06.842 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 01:56:06 smithi062 podman[70945]: 2024-09-12 01:56:06.53117652 +0000 UTC m=+1.258213685 container start c011d2c1515f3813ddf35cc61628d7baa5e9d387327c3002e9062dc6076903c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-12T01:56:06.842 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 01:56:06 smithi062 ceph-mds[70980]: -- 172.21.15.62:0/2598214364 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558b8750f860 con 0x558b874ec800 2024-09-12T01:56:06.842 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 01:56:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-d[70976]: starting mds.d at 2024-09-12T01:56:06.842 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 01:56:06 smithi062 bash[70945]: c011d2c1515f3813ddf35cc61628d7baa5e9d387327c3002e9062dc6076903c3 2024-09-12T01:56:06.842 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 01:56:06 smithi062 systemd[1]: Started Ceph mds.d for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:07.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:06 smithi107 ceph-mon[35463]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:07.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:06 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:07.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:06 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:07.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:06 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:07.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:06 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:07.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:06 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:07.105 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:06 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:07.115 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:06 smithi077 ceph-mon[35095]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:07.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:06 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:07.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:06 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:07.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:06 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:07.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:06 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:07.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:06 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:07.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:06 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:06 smithi062 ceph-mon[30666]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:06 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:06 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:06 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:06 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:06 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:06 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:08.164 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:07 smithi077 ceph-mon[35095]: Deploying daemon mds.e on smithi077 2024-09-12T01:56:08.165 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:07 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.62:6836/2380166524,v1:172.21.15.62:6837/2380166524] up:boot 2024-09-12T01:56:08.165 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:07 smithi077 ceph-mon[35095]: fsmap 4 up:standby 2024-09-12T01:56:08.165 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:07 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:56:08.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:08.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:07 smithi107 ceph-mon[35463]: Deploying daemon mds.e on smithi077 2024-09-12T01:56:08.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:07 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.62:6836/2380166524,v1:172.21.15.62:6837/2380166524] up:boot 2024-09-12T01:56:08.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:07 smithi107 ceph-mon[35463]: fsmap 4 up:standby 2024-09-12T01:56:08.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:07 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:56:08.248 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:07 smithi062 ceph-mon[30666]: Deploying daemon mds.e on smithi077 2024-09-12T01:56:08.248 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:07 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.62:6836/2380166524,v1:172.21.15.62:6837/2380166524] up:boot 2024-09-12T01:56:08.248 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:07 smithi062 ceph-mon[30666]: fsmap 4 up:standby 2024-09-12T01:56:08.248 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:07 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:56:08.583 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:08.853 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 01:56:08 smithi077 systemd[1]: Starting Ceph mds.e for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:09.070 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:08 smithi062 ceph-mon[30666]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:09.103 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:08 smithi077 ceph-mon[35095]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:09.103 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 01:56:08 smithi077 podman[64685]: 2024-09-12 01:56:08.852478417 +0000 UTC m=+0.016029845 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:09.103 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 01:56:08 smithi077 podman[64685]: 2024-09-12 01:56:08.973068188 +0000 UTC m=+0.136619655 container create f0ed852c57957521dbe25803349637081b3f98c04b4bea3aa9d9675c46bcb2ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T01:56:09.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.184+0000 7f8564000640 1 -- 172.21.15.62:0/4263582463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c1049a0 msgr2=0x7f855c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:09.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.184+0000 7f8564000640 1 --2- 172.21.15.62:0/4263582463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c1049a0 0x7f855c1089f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8548009900 tx=0x7f854802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.184+0000 7f8564000640 1 -- 172.21.15.62:0/4263582463 shutdown_connections 2024-09-12T01:56:09.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.184+0000 7f8564000640 1 --2- 172.21.15.62:0/4263582463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c109120 0x7f855c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.184+0000 7f8564000640 1 --2- 172.21.15.62:0/4263582463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c1049a0 0x7f855c1089f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.184+0000 7f8564000640 1 --2- 172.21.15.62:0/4263582463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c103ff0 0x7f855c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.184+0000 7f8564000640 1 -- 172.21.15.62:0/4263582463 >> 172.21.15.62:0/4263582463 conn(0x7f855c0ffa90 msgr2=0x7f855c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:09.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.184+0000 7f8564000640 1 -- 172.21.15.62:0/4263582463 shutdown_connections 2024-09-12T01:56:09.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.184+0000 7f8564000640 1 -- 172.21.15.62:0/4263582463 wait complete. 2024-09-12T01:56:09.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.185+0000 7f8564000640 1 Processor -- start 2024-09-12T01:56:09.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.185+0000 7f8564000640 1 -- start start 2024-09-12T01:56:09.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8564000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c103ff0 0x7f855c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:09.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8564000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c1049a0 0x7f855c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8564000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c109120 0x7f855c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8564000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f855c114190 con 0x7f855c109120 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8564000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f855c114010 con 0x7f855c1049a0 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8564000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f855c114310 con 0x7f855c103ff0 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8562000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c109120 0x7f855c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8562000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c109120 0x7f855c19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38594/0 (socket says 172.21.15.62:38594) 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8562000640 1 -- 172.21.15.62:0/2847839279 learned_addr learned my addr 172.21.15.62:0/2847839279 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8561600640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c103ff0 0x7f855c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8560c00640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c1049a0 0x7f855c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8562000640 1 -- 172.21.15.62:0/2847839279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c103ff0 msgr2=0x7f855c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8562000640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c103ff0 0x7f855c19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8562000640 1 -- 172.21.15.62:0/2847839279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c1049a0 msgr2=0x7f855c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8562000640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c1049a0 0x7f855c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.186+0000 7f8562000640 1 -- 172.21.15.62:0/2847839279 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c19f5e0 con 0x7f855c109120 2024-09-12T01:56:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.187+0000 7f8562000640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c109120 0x7f855c19ef00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f855400efd0 tx=0x7f855400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.187+0000 7f855a000640 1 -- 172.21.15.62:0/2847839279 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554003b70 con 0x7f855c109120 2024-09-12T01:56:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.187+0000 7f8564000640 1 -- 172.21.15.62:0/2847839279 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855c19f8d0 con 0x7f855c109120 2024-09-12T01:56:09.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.187+0000 7f855a000640 1 -- 172.21.15.62:0/2847839279 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8554003d10 con 0x7f855c109120 2024-09-12T01:56:09.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.187+0000 7f855a000640 1 -- 172.21.15.62:0/2847839279 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85540109f0 con 0x7f855c109120 2024-09-12T01:56:09.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.187+0000 7f8564000640 1 -- 172.21.15.62:0/2847839279 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855c1a71b0 con 0x7f855c109120 2024-09-12T01:56:09.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.188+0000 7f8564000640 1 -- 172.21.15.62:0/2847839279 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855c1043d0 con 0x7f855c109120 2024-09-12T01:56:09.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.190+0000 7f855a000640 1 -- 172.21.15.62:0/2847839279 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8554010b90 con 0x7f855c109120 2024-09-12T01:56:09.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.191+0000 7f855a000640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f85440a2c00 0x7f85440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:09.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.192+0000 7f855a000640 1 -- 172.21.15.62:0/2847839279 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f85540cf340 con 0x7f855c109120 2024-09-12T01:56:09.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.192+0000 7f8561600640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f85440a2c00 0x7f85440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:09.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.193+0000 7f8561600640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f85440a2c00 0x7f85440a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8550009bd0 tx=0x7f8550005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:09.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.194+0000 7f855a000640 1 -- 172.21.15.62:0/2847839279 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f855409c6a0 con 0x7f855c109120 2024-09-12T01:56:09.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:08 smithi107 ceph-mon[35463]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:09.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.425+0000 7f8564000640 1 -- 172.21.15.62:0/2847839279 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f855c10bdd0 con 0x7f855c109120 2024-09-12T01:56:09.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.426+0000 7f855a000640 1 -- 172.21.15.62:0/2847839279 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f855409bfa0 con 0x7f855c109120 2024-09-12T01:56:09.427 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:09.427 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"btime":"2024-09-12T01:56:06:837181+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T01:56:09.427 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 5 2024-09-12T01:56:09.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.428+0000 7f8564000640 1 -- 172.21.15.62:0/2847839279 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f85440a2c00 msgr2=0x7f85440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:09.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.428+0000 7f8564000640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f85440a2c00 0x7f85440a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8550009bd0 tx=0x7f8550005f90 comp rx=0 tx=0).stop 2024-09-12T01:56:09.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.428+0000 7f8564000640 1 -- 172.21.15.62:0/2847839279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c109120 msgr2=0x7f855c19ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:09.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.428+0000 7f8564000640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c109120 0x7f855c19ef00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f855400efd0 tx=0x7f855400c6a0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.428+0000 7f8564000640 1 -- 172.21.15.62:0/2847839279 shutdown_connections 2024-09-12T01:56:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.428+0000 7f8564000640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f85440a2c00 0x7f85440a50c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.428+0000 7f8564000640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c109120 0x7f855c19ef00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.428+0000 7f8564000640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c1049a0 0x7f855c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.428+0000 7f8564000640 1 --2- 172.21.15.62:0/2847839279 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c103ff0 0x7f855c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.428+0000 7f8564000640 1 -- 172.21.15.62:0/2847839279 >> 172.21.15.62:0/2847839279 conn(0x7f855c0ffa90 msgr2=0x7f855c100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.429+0000 7f8564000640 1 -- 172.21.15.62:0/2847839279 shutdown_connections 2024-09-12T01:56:09.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:09.429+0000 7f8564000640 1 -- 172.21.15.62:0/2847839279 wait complete. 2024-09-12T01:56:09.464 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 01:56:09 smithi077 podman[64685]: 2024-09-12 01:56:09.209517528 +0000 UTC m=+0.373068954 container init f0ed852c57957521dbe25803349637081b3f98c04b4bea3aa9d9675c46bcb2ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T01:56:09.464 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 01:56:09 smithi077 podman[64685]: 2024-09-12 01:56:09.212446479 +0000 UTC m=+0.375997905 container start f0ed852c57957521dbe25803349637081b3f98c04b4bea3aa9d9675c46bcb2ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T01:56:09.465 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 01:56:09 smithi077 ceph-mds[64704]: -- 172.21.15.77:0/3985316754 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563a0a8dbc20 con 0x563a0a8b9000 2024-09-12T01:56:09.465 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 01:56:09 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-e[64700]: starting mds.e at 2024-09-12T01:56:09.465 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 01:56:09 smithi077 bash[64685]: f0ed852c57957521dbe25803349637081b3f98c04b4bea3aa9d9675c46bcb2ec 2024-09-12T01:56:09.465 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 01:56:09 smithi077 systemd[1]: Started Ceph mds.e for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:10.334 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:10.334 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:10.334 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:10.334 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:10.334 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:10.334 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:10.334 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: Deploying daemon mds.f on smithi107 2024-09-12T01:56:10.334 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2847839279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:10.334 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.77:6834/2003629503,v1:172.21.15.77:6835/2003629503] up:boot 2024-09-12T01:56:10.334 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: fsmap 5 up:standby 2024-09-12T01:56:10.335 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:10 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:56:10.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:10.860 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:10.860 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:10.860 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:10.861 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:10.861 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:10.861 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: Deploying daemon mds.f on smithi107 2024-09-12T01:56:10.861 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2847839279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:10.861 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.77:6834/2003629503,v1:172.21.15.77:6835/2003629503] up:boot 2024-09-12T01:56:10.861 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: fsmap 5 up:standby 2024-09-12T01:56:10.861 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:10 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: Deploying daemon mds.f on smithi107 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2847839279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.77:6834/2003629503,v1:172.21.15.77:6835/2003629503] up:boot 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: fsmap 5 up:standby 2024-09-12T01:56:10.862 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:10 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:56:11.352 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 01:56:11 smithi107 systemd[1]: Starting Ceph mds.f for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:11.607 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:11 smithi107 ceph-mon[35463]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:11.607 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 01:56:11 smithi107 podman[65233]: 2024-09-12 01:56:11.371039618 +0000 UTC m=+0.015808355 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:11.607 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 01:56:11 smithi107 podman[65233]: 2024-09-12 01:56:11.48507333 +0000 UTC m=+0.129842048 container create 588b9e99331b3ec698968a2872d11d62ad2174a1fdba5b4b552c28d8ef6b1b45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T01:56:11.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:11 smithi077 ceph-mon[35095]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:11.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:11 smithi062 ceph-mon[30666]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:12.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:12.203 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 01:56:11 smithi107 podman[65233]: 2024-09-12 01:56:11.729435564 +0000 UTC m=+0.374204292 container init 588b9e99331b3ec698968a2872d11d62ad2174a1fdba5b4b552c28d8ef6b1b45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:12.203 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 01:56:11 smithi107 podman[65233]: 2024-09-12 01:56:11.732209401 +0000 UTC m=+0.376978131 container start 588b9e99331b3ec698968a2872d11d62ad2174a1fdba5b4b552c28d8ef6b1b45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T01:56:12.203 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 01:56:11 smithi107 ceph-mds[65252]: -- 172.21.15.107:0/1205831021 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c8301f9860 con 0x55c8301d7400 2024-09-12T01:56:12.203 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 01:56:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-f[65248]: starting mds.f at 2024-09-12T01:56:12.204 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 01:56:11 smithi107 bash[65233]: 588b9e99331b3ec698968a2872d11d62ad2174a1fdba5b4b552c28d8ef6b1b45 2024-09-12T01:56:12.204 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 01:56:11 smithi107 systemd[1]: Started Ceph mds.f for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:12.513 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: Deploying daemon mds.c on smithi107 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.107:6834/3488072304,v1:172.21.15.107:6835/3488072304] up:boot 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: fsmap 6 up:standby 2024-09-12T01:56:12.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:12 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:56:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.076+0000 7f8e27600640 1 -- 172.21.15.62:0/599796445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e20103ff0 msgr2=0x7f8e201043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.076+0000 7f8e27600640 1 --2- 172.21.15.62:0/599796445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e20103ff0 0x7f8e201043d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009900 tx=0x7f8e1402a410 comp rx=0 tx=0).stop 2024-09-12T01:56:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.076+0000 7f8e27600640 1 -- 172.21.15.62:0/599796445 shutdown_connections 2024-09-12T01:56:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.076+0000 7f8e27600640 1 --2- 172.21.15.62:0/599796445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e20109120 0x7f8e20110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.076+0000 7f8e27600640 1 --2- 172.21.15.62:0/599796445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e201049a0 0x7f8e201089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.076+0000 7f8e27600640 1 --2- 172.21.15.62:0/599796445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e20103ff0 0x7f8e201043d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.076+0000 7f8e27600640 1 -- 172.21.15.62:0/599796445 >> 172.21.15.62:0/599796445 conn(0x7f8e200ffa90 msgr2=0x7f8e20101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.076+0000 7f8e27600640 1 -- 172.21.15.62:0/599796445 shutdown_connections 2024-09-12T01:56:13.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.076+0000 7f8e27600640 1 -- 172.21.15.62:0/599796445 wait complete. 2024-09-12T01:56:13.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.077+0000 7f8e27600640 1 Processor -- start 2024-09-12T01:56:13.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.077+0000 7f8e27600640 1 -- start start 2024-09-12T01:56:13.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.077+0000 7f8e27600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e20103ff0 0x7f8e2019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.077+0000 7f8e27600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e201049a0 0x7f8e2019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.077+0000 7f8e27600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e20109120 0x7f8e2019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.077+0000 7f8e27600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20114190 con 0x7f8e20109120 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.077+0000 7f8e27600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20114010 con 0x7f8e201049a0 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.077+0000 7f8e27600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20114310 con 0x7f8e20103ff0 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e1fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e201049a0 0x7f8e2019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e24c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e20103ff0 0x7f8e2019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e1fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e201049a0 0x7f8e2019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:42226/0 (socket says 172.21.15.62:42226) 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e1fe00640 1 -- 172.21.15.62:0/2738498277 learned_addr learned my addr 172.21.15.62:0/2738498277 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e25600640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e20109120 0x7f8e2019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e1fe00640 1 -- 172.21.15.62:0/2738498277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e20103ff0 msgr2=0x7f8e2019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e1fe00640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e20103ff0 0x7f8e2019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e1fe00640 1 -- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e20109120 msgr2=0x7f8e2019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e1fe00640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e20109120 0x7f8e2019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e1fe00640 1 -- 172.21.15.62:0/2738498277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2019f640 con 0x7f8e201049a0 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e24c00640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e20103ff0 0x7f8e2019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.078+0000 7f8e25600640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e20109120 0x7f8e2019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.079+0000 7f8e1fe00640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e201049a0 0x7f8e2019abd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00e9f0 tx=0x7f8e0c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.079+0000 7f8e1d600640 1 -- 172.21.15.62:0/2738498277 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00cd80 con 0x7f8e201049a0 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.079+0000 7f8e1d600640 1 -- 172.21.15.62:0/2738498277 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e0c005500 con 0x7f8e201049a0 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.079+0000 7f8e27600640 1 -- 172.21.15.62:0/2738498277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2019f930 con 0x7f8e201049a0 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.079+0000 7f8e1d600640 1 -- 172.21.15.62:0/2738498277 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c010690 con 0x7f8e201049a0 2024-09-12T01:56:13.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.079+0000 7f8e27600640 1 -- 172.21.15.62:0/2738498277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e201a7210 con 0x7f8e201049a0 2024-09-12T01:56:13.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.080+0000 7f8e27600640 1 -- 172.21.15.62:0/2738498277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e201043d0 con 0x7f8e201049a0 2024-09-12T01:56:13.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.082+0000 7f8e1d600640 1 -- 172.21.15.62:0/2738498277 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8e0c0046c0 con 0x7f8e201049a0 2024-09-12T01:56:13.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.083+0000 7f8e1d600640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e080a2c00 0x7f8e080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:13.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.083+0000 7f8e1d600640 1 -- 172.21.15.62:0/2738498277 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f8e0c0cf070 con 0x7f8e201049a0 2024-09-12T01:56:13.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.083+0000 7f8e24c00640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e080a2c00 0x7f8e080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:13.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.084+0000 7f8e24c00640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e080a2c00 0x7f8e080a50c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e14000c00 tx=0x7f8e14031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:13.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.087+0000 7f8e1d600640 1 -- 172.21.15.62:0/2738498277 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e0c09c3d0 con 0x7f8e201049a0 2024-09-12T01:56:13.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:13.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:13.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:13.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:13.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:13.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:13.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:13.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: Deploying daemon mds.c on smithi107 2024-09-12T01:56:13.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.107:6834/3488072304,v1:172.21.15.107:6835/3488072304] up:boot 2024-09-12T01:56:13.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: fsmap 6 up:standby 2024-09-12T01:56:13.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:12 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:56:13.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:13.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:13.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:13.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:13.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:13.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:13.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:13.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: Deploying daemon mds.c on smithi107 2024-09-12T01:56:13.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.107:6834/3488072304,v1:172.21.15.107:6835/3488072304] up:boot 2024-09-12T01:56:13.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: fsmap 6 up:standby 2024-09-12T01:56:13.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:12 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:56:13.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.309+0000 7f8e27600640 1 -- 172.21.15.62:0/2738498277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e2010c300 con 0x7f8e201049a0 2024-09-12T01:56:13.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.310+0000 7f8e1d600640 1 -- 172.21.15.62:0/2738498277 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7f8e0c09bcd0 con 0x7f8e201049a0 2024-09-12T01:56:13.310 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:13.311 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"btime":"2024-09-12T01:56:12:352035+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-12T01:56:13.311 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2024-09-12T01:56:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 -- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e080a2c00 msgr2=0x7f8e080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e080a2c00 0x7f8e080a50c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8e14000c00 tx=0x7f8e14031510 comp rx=0 tx=0).stop 2024-09-12T01:56:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 -- 172.21.15.62:0/2738498277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e201049a0 msgr2=0x7f8e2019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e201049a0 0x7f8e2019abd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00e9f0 tx=0x7f8e0c00edf0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 -- 172.21.15.62:0/2738498277 shutdown_connections 2024-09-12T01:56:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e080a2c00 0x7f8e080a50c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e20109120 0x7f8e2019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e201049a0 0x7f8e2019abd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 --2- 172.21.15.62:0/2738498277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e20103ff0 0x7f8e2019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 -- 172.21.15.62:0/2738498277 >> 172.21.15.62:0/2738498277 conn(0x7f8e200ffa90 msgr2=0x7f8e20100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:13.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.312+0000 7f8e27600640 1 -- 172.21.15.62:0/2738498277 shutdown_connections 2024-09-12T01:56:13.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:13.313+0000 7f8e27600640 1 -- 172.21.15.62:0/2738498277 wait complete. 2024-09-12T01:56:13.885 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 01:56:13 smithi107 systemd[1]: Starting Ceph mds.c for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:14.084 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:13 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2738498277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:14.193 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:13 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2738498277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:14.193 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 01:56:14 smithi107 podman[65537]: 2024-09-12 01:56:13.931619097 +0000 UTC m=+0.015996398 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:14.193 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 01:56:14 smithi107 podman[65537]: 2024-09-12 01:56:14.057457924 +0000 UTC m=+0.141835257 container create efd3a644ad094ede63d470ea37d25fa5c8a916a76adf52231cbd8ef2dbfe8535 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:56:14.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:13 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2738498277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:14.703 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 01:56:14 smithi107 podman[65537]: 2024-09-12 01:56:14.34367974 +0000 UTC m=+0.428057031 container init efd3a644ad094ede63d470ea37d25fa5c8a916a76adf52231cbd8ef2dbfe8535 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:56:14.703 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 01:56:14 smithi107 podman[65537]: 2024-09-12 01:56:14.346530996 +0000 UTC m=+0.430908286 container start efd3a644ad094ede63d470ea37d25fa5c8a916a76adf52231cbd8ef2dbfe8535 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T01:56:14.703 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 01:56:14 smithi107 ceph-mds[65556]: -- 172.21.15.107:0/3436478323 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac03e99860 con 0x55ac03e77000 2024-09-12T01:56:14.704 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 01:56:14 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-c[65552]: starting mds.c at 2024-09-12T01:56:14.704 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 01:56:14 smithi107 bash[65537]: efd3a644ad094ede63d470ea37d25fa5c8a916a76adf52231cbd8ef2dbfe8535 2024-09-12T01:56:14.704 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 01:56:14 smithi107 systemd[1]: Started Ceph mds.c for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:15.145 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:14 smithi062 ceph-mon[30666]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:15.145 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:15.145 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:15.145 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:15.145 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:15.145 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:15.146 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:14 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:14 smithi107 ceph-mon[35463]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:15.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:15.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:15.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:15.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:14 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:14 smithi077 ceph-mon[35095]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:15.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:15.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:14 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:16.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:15 smithi062 ceph-mon[30666]: Deploying daemon mds.h on smithi077 2024-09-12T01:56:16.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:15 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.107:6836/2432202684,v1:172.21.15.107:6837/2432202684] up:boot 2024-09-12T01:56:16.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:15 smithi062 ceph-mon[30666]: fsmap 7 up:standby 2024-09-12T01:56:16.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:15 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:56:16.125 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:16.168 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:15 smithi077 ceph-mon[35095]: Deploying daemon mds.h on smithi077 2024-09-12T01:56:16.169 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:15 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.107:6836/2432202684,v1:172.21.15.107:6837/2432202684] up:boot 2024-09-12T01:56:16.169 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:15 smithi077 ceph-mon[35095]: fsmap 7 up:standby 2024-09-12T01:56:16.169 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:15 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:56:16.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:15 smithi107 ceph-mon[35463]: Deploying daemon mds.h on smithi077 2024-09-12T01:56:16.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:15 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.107:6836/2432202684,v1:172.21.15.107:6837/2432202684] up:boot 2024-09-12T01:56:16.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:15 smithi107 ceph-mon[35463]: fsmap 7 up:standby 2024-09-12T01:56:16.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:15 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:56:16.504 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:16.905 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 01:56:16 smithi077 podman[64989]: 2024-09-12 01:56:16.8045405 +0000 UTC m=+0.133252469 container create 566c45f3f9ba3f9690b9043920c7f94a16ce1c11957257862de942cee3823b9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T01:56:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.075+0000 7f7923a00640 1 -- 172.21.15.62:0/1696348346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791c1049a0 msgr2=0x7f791c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.075+0000 7f7923a00640 1 --2- 172.21.15.62:0/1696348346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791c1049a0 0x7f791c1089f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7908009900 tx=0x7f790802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.076+0000 7f7923a00640 1 -- 172.21.15.62:0/1696348346 shutdown_connections 2024-09-12T01:56:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.076+0000 7f7923a00640 1 --2- 172.21.15.62:0/1696348346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f791c109120 0x7f791c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.076+0000 7f7923a00640 1 --2- 172.21.15.62:0/1696348346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791c1049a0 0x7f791c1089f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.076+0000 7f7923a00640 1 --2- 172.21.15.62:0/1696348346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c103ff0 0x7f791c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.076+0000 7f7923a00640 1 -- 172.21.15.62:0/1696348346 >> 172.21.15.62:0/1696348346 conn(0x7f791c0ffa90 msgr2=0x7f791c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.076+0000 7f7923a00640 1 -- 172.21.15.62:0/1696348346 shutdown_connections 2024-09-12T01:56:17.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.076+0000 7f7923a00640 1 -- 172.21.15.62:0/1696348346 wait complete. 2024-09-12T01:56:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f7923a00640 1 Processor -- start 2024-09-12T01:56:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f7923a00640 1 -- start start 2024-09-12T01:56:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f7923a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c103ff0 0x7f791c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f7923a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791c1049a0 0x7f791c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f7923a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f791c109120 0x7f791c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f7923a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f791c114190 con 0x7f791c109120 2024-09-12T01:56:17.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f7923a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f791c114010 con 0x7f791c1049a0 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f7923a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f791c114310 con 0x7f791c103ff0 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f791be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791c1049a0 0x7f791c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f791be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791c1049a0 0x7f791c19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:42254/0 (socket says 172.21.15.62:42254) 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f791be00640 1 -- 172.21.15.62:0/2673841449 learned_addr learned my addr 172.21.15.62:0/2673841449 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.077+0000 7f7921000640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c103ff0 0x7f791c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f7921a00640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f791c109120 0x7f791c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f791be00640 1 -- 172.21.15.62:0/2673841449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c103ff0 msgr2=0x7f791c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f791be00640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c103ff0 0x7f791c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f791be00640 1 -- 172.21.15.62:0/2673841449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f791c109120 msgr2=0x7f791c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f791be00640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f791c109120 0x7f791c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f791be00640 1 -- 172.21.15.62:0/2673841449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c19f5c0 con 0x7f791c1049a0 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f791be00640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791c1049a0 0x7f791c19ab50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7908004770 tx=0x7f7908003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f7919600640 1 -- 172.21.15.62:0/2673841449 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790803f070 con 0x7f791c1049a0 2024-09-12T01:56:17.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f7919600640 1 -- 172.21.15.62:0/2673841449 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7908031ca0 con 0x7f791c1049a0 2024-09-12T01:56:17.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f7923a00640 1 -- 172.21.15.62:0/2673841449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791c19f850 con 0x7f791c1049a0 2024-09-12T01:56:17.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.078+0000 7f7919600640 1 -- 172.21.15.62:0/2673841449 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908035030 con 0x7f791c1049a0 2024-09-12T01:56:17.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.079+0000 7f7923a00640 1 -- 172.21.15.62:0/2673841449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f791c1a7190 con 0x7f791c1049a0 2024-09-12T01:56:17.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.080+0000 7f7923a00640 1 -- 172.21.15.62:0/2673841449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f791c1054d0 con 0x7f791c1049a0 2024-09-12T01:56:17.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.081+0000 7f7919600640 1 -- 172.21.15.62:0/2673841449 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7908042070 con 0x7f791c1049a0 2024-09-12T01:56:17.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.083+0000 7f7919600640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f79040a2b80 0x7f79040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:17.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.083+0000 7f7919600640 1 -- 172.21.15.62:0/2673841449 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f79080ef200 con 0x7f791c1049a0 2024-09-12T01:56:17.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.083+0000 7f7921000640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f79040a2b80 0x7f79040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:17.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.084+0000 7f7921000640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f79040a2b80 0x7f79040a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7910009bd0 tx=0x7f7910005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:17.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.086+0000 7f7919600640 1 -- 172.21.15.62:0/2673841449 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79080bbfd0 con 0x7f791c1049a0 2024-09-12T01:56:17.157 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:16 smithi077 ceph-mon[35095]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:17.157 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 01:56:17 smithi077 podman[64989]: 2024-09-12 01:56:17.049647275 +0000 UTC m=+0.378359243 container init 566c45f3f9ba3f9690b9043920c7f94a16ce1c11957257862de942cee3823b9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:56:17.157 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 01:56:17 smithi077 podman[64989]: 2024-09-12 01:56:17.052427779 +0000 UTC m=+0.381139749 container start 566c45f3f9ba3f9690b9043920c7f94a16ce1c11957257862de942cee3823b9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T01:56:17.157 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 01:56:17 smithi077 ceph-mds[65007]: -- 172.21.15.77:0/3916592933 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d07b7cf860 con 0x55d07b7ac800 2024-09-12T01:56:17.157 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 01:56:17 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-h[65003]: starting mds.h at 2024-09-12T01:56:17.158 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 01:56:17 smithi077 bash[64989]: 566c45f3f9ba3f9690b9043920c7f94a16ce1c11957257862de942cee3823b9e 2024-09-12T01:56:17.158 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 01:56:17 smithi077 systemd[1]: Started Ceph mds.h for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:17.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:16 smithi107 ceph-mon[35463]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:17.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.325+0000 7f7923a00640 1 -- 172.21.15.62:0/2673841449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f791c10c360 con 0x7f791c1049a0 2024-09-12T01:56:17.326 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:16 smithi062 ceph-mon[30666]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:17.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.326+0000 7f7919600640 1 -- 172.21.15.62:0/2673841449 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f79080c02d0 con 0x7f791c1049a0 2024-09-12T01:56:17.326 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":8,"btime":"2024-09-12T01:56:14:885872+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T01:56:17.327 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 8 2024-09-12T01:56:17.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 -- 172.21.15.62:0/2673841449 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f79040a2b80 msgr2=0x7f79040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f79040a2b80 0x7f79040a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7910009bd0 tx=0x7f7910005f90 comp rx=0 tx=0).stop 2024-09-12T01:56:17.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 -- 172.21.15.62:0/2673841449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791c1049a0 msgr2=0x7f791c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:17.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791c1049a0 0x7f791c19ab50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7908004770 tx=0x7f7908003c10 comp rx=0 tx=0).stop 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 -- 172.21.15.62:0/2673841449 shutdown_connections 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f79040a2b80 0x7f79040a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f791c109120 0x7f791c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f791c1049a0 0x7f791c19ab50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 --2- 172.21.15.62:0/2673841449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f791c103ff0 0x7f791c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 -- 172.21.15.62:0/2673841449 >> 172.21.15.62:0/2673841449 conn(0x7f791c0ffa90 msgr2=0x7f791c100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 -- 172.21.15.62:0/2673841449 shutdown_connections 2024-09-12T01:56:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:17.329+0000 7f7923a00640 1 -- 172.21.15.62:0/2673841449 wait complete. 2024-09-12T01:56:18.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:18.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:18.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:18.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:18.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:18.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:18.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: Deploying daemon mds.i on smithi107 2024-09-12T01:56:18.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2673841449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:18.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.77:6836/1577534280,v1:172.21.15.77:6837/1577534280] up:boot 2024-09-12T01:56:18.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: fsmap 8 up:standby 2024-09-12T01:56:18.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:18 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:56:18.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: Deploying daemon mds.i on smithi107 2024-09-12T01:56:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2673841449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.77:6836/1577534280,v1:172.21.15.77:6837/1577534280] up:boot 2024-09-12T01:56:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: fsmap 8 up:standby 2024-09-12T01:56:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:18 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:56:18.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:18.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:18.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:18.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:18.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:18.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:18.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: Deploying daemon mds.i on smithi107 2024-09-12T01:56:18.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2673841449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:18.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.77:6836/1577534280,v1:172.21.15.77:6837/1577534280] up:boot 2024-09-12T01:56:18.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: fsmap 8 up:standby 2024-09-12T01:56:18.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:18 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:56:19.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:19 smithi107 ceph-mon[35463]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:19.454 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 01:56:19 smithi107 systemd[1]: Starting Ceph mds.i for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:19.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:19 smithi062 ceph-mon[30666]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:19.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:19 smithi077 ceph-mon[35095]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:19.741 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 01:56:19 smithi107 podman[65833]: 2024-09-12 01:56:19.386262622 +0000 UTC m=+0.015558050 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:19.741 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 01:56:19 smithi107 podman[65833]: 2024-09-12 01:56:19.497110165 +0000 UTC m=+0.126405623 container create c8c800cfffdf407eef49d27597fd95709877e9389699e0ee2e5db5b4dc77c453 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T01:56:19.741 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 01:56:19 smithi107 podman[65833]: 2024-09-12 01:56:19.741573585 +0000 UTC m=+0.370869004 container init c8c800cfffdf407eef49d27597fd95709877e9389699e0ee2e5db5b4dc77c453 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T01:56:20.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:20.206 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 01:56:19 smithi107 podman[65833]: 2024-09-12 01:56:19.744562881 +0000 UTC m=+0.373858297 container start c8c800cfffdf407eef49d27597fd95709877e9389699e0ee2e5db5b4dc77c453 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T01:56:20.206 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 01:56:19 smithi107 ceph-mds[65852]: -- 172.21.15.107:0/3997104703 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a3382a1860 con 0x55a33827f400 2024-09-12T01:56:20.206 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 01:56:19 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i[65848]: starting mds.i at 2024-09-12T01:56:20.206 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 01:56:19 smithi107 bash[65833]: c8c800cfffdf407eef49d27597fd95709877e9389699e0ee2e5db5b4dc77c453 2024-09-12T01:56:20.206 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 01:56:19 smithi107 systemd[1]: Started Ceph mds.i for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:21.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:21.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:21.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:21.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:21.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:21.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:21.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:21.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: Deploying daemon mds.g on smithi062 2024-09-12T01:56:21.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.107:6838/4011311424,v1:172.21.15.107:6839/4011311424] up:boot 2024-09-12T01:56:21.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: fsmap 9 up:standby 2024-09-12T01:56:21.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:20 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:56:21.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:21.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:21.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:21.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: Deploying daemon mds.g on smithi062 2024-09-12T01:56:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.107:6838/4011311424,v1:172.21.15.107:6839/4011311424] up:boot 2024-09-12T01:56:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: fsmap 9 up:standby 2024-09-12T01:56:21.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:20 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:56:21.232 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: Deploying daemon mds.g on smithi062 2024-09-12T01:56:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.107:6838/4011311424,v1:172.21.15.107:6839/4011311424] up:boot 2024-09-12T01:56:21.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: fsmap 9 up:standby 2024-09-12T01:56:21.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:20 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.362+0000 7f45d8800640 1 -- 172.21.15.62:0/1127309755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d0103ff0 msgr2=0x7f45d01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.362+0000 7f45d8800640 1 --2- 172.21.15.62:0/1127309755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d0103ff0 0x7f45d01043d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009900 tx=0x7f45c402a410 comp rx=0 tx=0).stop 2024-09-12T01:56:22.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.363+0000 7f45d8800640 1 -- 172.21.15.62:0/1127309755 shutdown_connections 2024-09-12T01:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.363+0000 7f45d8800640 1 --2- 172.21.15.62:0/1127309755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d0109120 0x7f45d0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.363+0000 7f45d8800640 1 --2- 172.21.15.62:0/1127309755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45d01049a0 0x7f45d01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.363+0000 7f45d8800640 1 --2- 172.21.15.62:0/1127309755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d0103ff0 0x7f45d01043d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.363+0000 7f45d8800640 1 -- 172.21.15.62:0/1127309755 >> 172.21.15.62:0/1127309755 conn(0x7f45d00ffa90 msgr2=0x7f45d0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.363+0000 7f45d8800640 1 -- 172.21.15.62:0/1127309755 shutdown_connections 2024-09-12T01:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.363+0000 7f45d8800640 1 -- 172.21.15.62:0/1127309755 wait complete. 2024-09-12T01:56:22.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.364+0000 7f45d8800640 1 Processor -- start 2024-09-12T01:56:22.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.364+0000 7f45d8800640 1 -- start start 2024-09-12T01:56:22.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.364+0000 7f45d8800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45d0103ff0 0x7f45d019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.364+0000 7f45d8800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d01049a0 0x7f45d019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.364+0000 7f45d8800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d0109120 0x7f45d019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.364+0000 7f45d8800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0114170 con 0x7f45d01049a0 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.364+0000 7f45d8800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0113ff0 con 0x7f45d0103ff0 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.364+0000 7f45d8800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01142f0 con 0x7f45d0109120 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d01049a0 0x7f45d019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45d0103ff0 0x7f45d019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45d0103ff0 0x7f45d019a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:57454/0 (socket says 172.21.15.62:57454) 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d6800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d0109120 0x7f45d019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d5e00640 1 -- 172.21.15.62:0/2328375180 learned_addr learned my addr 172.21.15.62:0/2328375180 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d5e00640 1 -- 172.21.15.62:0/2328375180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d0109120 msgr2=0x7f45d019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d5e00640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d0109120 0x7f45d019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d5e00640 1 -- 172.21.15.62:0/2328375180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d01049a0 msgr2=0x7f45d019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d5e00640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d01049a0 0x7f45d019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d5e00640 1 -- 172.21.15.62:0/2328375180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d019f640 con 0x7f45d0103ff0 2024-09-12T01:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.365+0000 7f45d5e00640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45d0103ff0 0x7f45d019a690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f45c4004770 tx=0x7f45c4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.366+0000 7f45caa00640 1 -- 172.21.15.62:0/2328375180 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c403f070 con 0x7f45d0103ff0 2024-09-12T01:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.366+0000 7f45d8800640 1 -- 172.21.15.62:0/2328375180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d019f8d0 con 0x7f45d0103ff0 2024-09-12T01:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.366+0000 7f45caa00640 1 -- 172.21.15.62:0/2328375180 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c4031ca0 con 0x7f45d0103ff0 2024-09-12T01:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.366+0000 7f45caa00640 1 -- 172.21.15.62:0/2328375180 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c4035030 con 0x7f45d0103ff0 2024-09-12T01:56:22.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.366+0000 7f45d8800640 1 -- 172.21.15.62:0/2328375180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d01a7210 con 0x7f45d0103ff0 2024-09-12T01:56:22.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.367+0000 7f45d8800640 1 -- 172.21.15.62:0/2328375180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d01054d0 con 0x7f45d0103ff0 2024-09-12T01:56:22.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.369+0000 7f45caa00640 1 -- 172.21.15.62:0/2328375180 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f45c4042070 con 0x7f45d0103ff0 2024-09-12T01:56:22.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.370+0000 7f45caa00640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f45b80a2b80 0x7f45b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.370+0000 7f45caa00640 1 -- 172.21.15.62:0/2328375180 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f45c40ef4e0 con 0x7f45d0103ff0 2024-09-12T01:56:22.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.371+0000 7f45d5400640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f45b80a2b80 0x7f45b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.371+0000 7f45d5400640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f45b80a2b80 0x7f45b80a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f45d00fffb0 tx=0x7f45c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.373+0000 7f45caa00640 1 -- 172.21.15.62:0/2328375180 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45c40bc1f0 con 0x7f45d0103ff0 2024-09-12T01:56:22.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.604+0000 7f45d8800640 1 -- 172.21.15.62:0/2328375180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45d01043d0 con 0x7f45d0103ff0 2024-09-12T01:56:22.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.605+0000 7f45caa00640 1 -- 172.21.15.62:0/2328375180 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8049 (secure 0 0 0) 0x7f45d01043d0 con 0x7f45d0103ff0 2024-09-12T01:56:22.606 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:22.606 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"btime":"2024-09-12T01:56:20:232026+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T01:56:22.606 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 10 2024-09-12T01:56:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.607+0000 7f45d8800640 1 -- 172.21.15.62:0/2328375180 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f45b80a2b80 msgr2=0x7f45b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.607+0000 7f45d8800640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f45b80a2b80 0x7f45b80a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f45d00fffb0 tx=0x7f45c0005f90 comp rx=0 tx=0).stop 2024-09-12T01:56:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.607+0000 7f45d8800640 1 -- 172.21.15.62:0/2328375180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45d0103ff0 msgr2=0x7f45d019a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.607+0000 7f45d8800640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45d0103ff0 0x7f45d019a690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f45c4004770 tx=0x7f45c4003c10 comp rx=0 tx=0).stop 2024-09-12T01:56:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.608+0000 7f45d8800640 1 -- 172.21.15.62:0/2328375180 shutdown_connections 2024-09-12T01:56:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.608+0000 7f45d8800640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f45b80a2b80 0x7f45b80a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.608+0000 7f45d8800640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f45d0109120 0x7f45d019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.608+0000 7f45d8800640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45d01049a0 0x7f45d019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.608+0000 7f45d8800640 1 --2- 172.21.15.62:0/2328375180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45d0103ff0 0x7f45d019a690 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.608+0000 7f45d8800640 1 -- 172.21.15.62:0/2328375180 >> 172.21.15.62:0/2328375180 conn(0x7f45d00ffa90 msgr2=0x7f45d0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.608+0000 7f45d8800640 1 -- 172.21.15.62:0/2328375180 shutdown_connections 2024-09-12T01:56:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:22.608+0000 7f45d8800640 1 -- 172.21.15.62:0/2328375180 wait complete. 2024-09-12T01:56:23.193 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:22 smithi062 ceph-mon[30666]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:23.193 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:22 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2328375180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:23.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:22 smithi107 ceph-mon[35463]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:23.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:22 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2328375180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:22 smithi077 ceph-mon[35095]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:22 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2328375180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:23.899 INFO:journalctl@ceph.mds.g.smithi062.stdout:Sep 12 01:56:23 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-g[71733]: starting mds.g at 2024-09-12T01:56:23.899 INFO:journalctl@ceph.mds.g.smithi062.stdout:Sep 12 01:56:23 smithi062 bash[71717]: 0e9f16d8fc642cabaee2287966febea8d4f4137f107c4f39ea9e71180ea3be78 2024-09-12T01:56:24.341 INFO:journalctl@ceph.mds.g.smithi062.stdout:Sep 12 01:56:23 smithi062 systemd[1]: Started Ceph mds.g for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:25.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:25.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.62:6838/3993694747,v1:172.21.15.62:6839/3993694747] up:boot 2024-09-12T01:56:25.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: fsmap 10 up:standby 2024-09-12T01:56:25.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:56:25.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:25.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:25.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:25.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:25.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:25.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:25.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:24 smithi107 ceph-mon[35463]: Deploying daemon mds.a on smithi062 2024-09-12T01:56:25.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:25.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.62:6838/3993694747,v1:172.21.15.62:6839/3993694747] up:boot 2024-09-12T01:56:25.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: fsmap 10 up:standby 2024-09-12T01:56:25.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:56:25.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:25.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:25.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:25.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:25.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:25.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:25.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:24 smithi077 ceph-mon[35095]: Deploying daemon mds.a on smithi062 2024-09-12T01:56:25.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.62:6838/3993694747,v1:172.21.15.62:6839/3993694747] up:boot 2024-09-12T01:56:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: fsmap 10 up:standby 2024-09-12T01:56:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:56:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:24 smithi062 ceph-mon[30666]: Deploying daemon mds.a on smithi062 2024-09-12T01:56:25.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:26.076 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.755+0000 7ff3c8800640 1 -- 172.21.15.62:0/3763114866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c0074ee0 msgr2=0x7ff3c010dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.755+0000 7ff3c8800640 1 --2- 172.21.15.62:0/3763114866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c0074ee0 0x7ff3c010dee0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009900 tx=0x7ff3b002a480 comp rx=0 tx=0).stop 2024-09-12T01:56:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.755+0000 7ff3c8800640 1 -- 172.21.15.62:0/3763114866 shutdown_connections 2024-09-12T01:56:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.755+0000 7ff3c8800640 1 --2- 172.21.15.62:0/3763114866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3c010e420 0x7ff3c0110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.755+0000 7ff3c8800640 1 --2- 172.21.15.62:0/3763114866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c0074ee0 0x7ff3c010dee0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.755+0000 7ff3c8800640 1 --2- 172.21.15.62:0/3763114866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c00745c0 0x7ff3c00749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.755+0000 7ff3c8800640 1 -- 172.21.15.62:0/3763114866 >> 172.21.15.62:0/3763114866 conn(0x7ff3c00fd8c0 msgr2=0x7ff3c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.755+0000 7ff3c8800640 1 -- 172.21.15.62:0/3763114866 shutdown_connections 2024-09-12T01:56:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.755+0000 7ff3c8800640 1 -- 172.21.15.62:0/3763114866 wait complete. 2024-09-12T01:56:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.756+0000 7ff3c8800640 1 Processor -- start 2024-09-12T01:56:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.756+0000 7ff3c8800640 1 -- start start 2024-09-12T01:56:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.756+0000 7ff3c8800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3c00745c0 0x7ff3c019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.756+0000 7ff3c8800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c0074ee0 0x7ff3c019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.756+0000 7ff3c8800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c010e420 0x7ff3c019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.756+0000 7ff3c8800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c0114160 con 0x7ff3c0074ee0 2024-09-12T01:56:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.756+0000 7ff3c8800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c0113fe0 con 0x7ff3c00745c0 2024-09-12T01:56:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.756+0000 7ff3c8800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c01142e0 con 0x7ff3c010e420 2024-09-12T01:56:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.757+0000 7ff3c5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c0074ee0 0x7ff3c019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.757+0000 7ff3c5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3c00745c0 0x7ff3c019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.757+0000 7ff3c5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3c00745c0 0x7ff3c019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:57488/0 (socket says 172.21.15.62:57488) 2024-09-12T01:56:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.757+0000 7ff3c5e00640 1 -- 172.21.15.62:0/4211961613 learned_addr learned my addr 172.21.15.62:0/4211961613 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.757+0000 7ff3c6800640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c010e420 0x7ff3c019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.757+0000 7ff3c5e00640 1 -- 172.21.15.62:0/4211961613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c010e420 msgr2=0x7ff3c019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.757+0000 7ff3c5e00640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c010e420 0x7ff3c019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.757+0000 7ff3c5e00640 1 -- 172.21.15.62:0/4211961613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c0074ee0 msgr2=0x7ff3c019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.757+0000 7ff3c5e00640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c0074ee0 0x7ff3c019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.757+0000 7ff3c5e00640 1 -- 172.21.15.62:0/4211961613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c019f610 con 0x7ff3c00745c0 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.758+0000 7ff3c5e00640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3c00745c0 0x7ff3c019a660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400e9f0 tx=0x7ff3b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.758+0000 7ff3baa00640 1 -- 172.21.15.62:0/4211961613 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b400cd80 con 0x7ff3c00745c0 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.758+0000 7ff3baa00640 1 -- 172.21.15.62:0/4211961613 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3b4010910 con 0x7ff3c00745c0 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.758+0000 7ff3baa00640 1 -- 172.21.15.62:0/4211961613 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4018990 con 0x7ff3c00745c0 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.758+0000 7ff3c8800640 1 -- 172.21.15.62:0/4211961613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c019f900 con 0x7ff3c00745c0 2024-09-12T01:56:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.758+0000 7ff3c8800640 1 -- 172.21.15.62:0/4211961613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c01a71e0 con 0x7ff3c00745c0 2024-09-12T01:56:26.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.759+0000 7ff3c8800640 1 -- 172.21.15.62:0/4211961613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c00749a0 con 0x7ff3c00745c0 2024-09-12T01:56:26.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.761+0000 7ff3baa00640 1 -- 172.21.15.62:0/4211961613 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff3b4010ac0 con 0x7ff3c00745c0 2024-09-12T01:56:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.763+0000 7ff3baa00640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff3a80a2b80 0x7ff3a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.763+0000 7ff3baa00640 1 -- 172.21.15.62:0/4211961613 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff3b40cef50 con 0x7ff3c00745c0 2024-09-12T01:56:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.763+0000 7ff3c5400640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff3a80a2b80 0x7ff3a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.764+0000 7ff3c5400640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff3a80a2b80 0x7ff3a80a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009230 tx=0x7ff3b00058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.767+0000 7ff3baa00640 1 -- 172.21.15.62:0/4211961613 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3b409bc60 con 0x7ff3c00745c0 2024-09-12T01:56:26.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.996+0000 7ff3c8800640 1 -- 172.21.15.62:0/4211961613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3c019b9c0 con 0x7ff3c00745c0 2024-09-12T01:56:26.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:26.998+0000 7ff3baa00640 1 -- 172.21.15.62:0/4211961613 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7ff3b409ff60 con 0x7ff3c00745c0 2024-09-12T01:56:26.998 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:26.998 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":11,"btime":"2024-09-12T01:56:23:896672+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T01:56:26.999 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 11 2024-09-12T01:56:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 -- 172.21.15.62:0/4211961613 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff3a80a2b80 msgr2=0x7ff3a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff3a80a2b80 0x7ff3a80a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009230 tx=0x7ff3b00058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 -- 172.21.15.62:0/4211961613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3c00745c0 msgr2=0x7ff3c019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3c00745c0 0x7ff3c019a660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400e9f0 tx=0x7ff3b400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 -- 172.21.15.62:0/4211961613 shutdown_connections 2024-09-12T01:56:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff3a80a2b80 0x7ff3a80a5040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3c010e420 0x7ff3c019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3c0074ee0 0x7ff3c019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 --2- 172.21.15.62:0/4211961613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3c00745c0 0x7ff3c019a660 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 -- 172.21.15.62:0/4211961613 >> 172.21.15.62:0/4211961613 conn(0x7ff3c00fd8c0 msgr2=0x7ff3c00fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 -- 172.21.15.62:0/4211961613 shutdown_connections 2024-09-12T01:56:27.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:27.000+0000 7ff3c8800640 1 -- 172.21.15.62:0/4211961613 wait complete. 2024-09-12T01:56:27.014 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:26 smithi062 ceph-mon[30666]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:27.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:26 smithi107 ceph-mon[35463]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:27.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:26 smithi077 ceph-mon[35095]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:27.821 INFO:journalctl@ceph.mds.a.smithi062.stdout:Sep 12 01:56:27 smithi062 systemd[1]: Started Ceph mds.a for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:27 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4211961613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:27 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:28.186 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:27 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4211961613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:28.186 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:28.186 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:28.186 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:28.186 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:28.187 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:28.187 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:27 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:27 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4211961613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:56:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:56:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:27 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:29.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:28 smithi107 ceph-mon[35463]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:29.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:28 smithi107 ceph-mon[35463]: Deploying daemon mds.b on smithi077 2024-09-12T01:56:29.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:28 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.62:6840/886174121,v1:172.21.15.62:6841/886174121] up:boot 2024-09-12T01:56:29.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:28 smithi107 ceph-mon[35463]: fsmap 11 up:standby 2024-09-12T01:56:29.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:28 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:56:29.209 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:28 smithi077 ceph-mon[35095]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:29.209 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:28 smithi077 ceph-mon[35095]: Deploying daemon mds.b on smithi077 2024-09-12T01:56:29.209 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:28 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.62:6840/886174121,v1:172.21.15.62:6841/886174121] up:boot 2024-09-12T01:56:29.209 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:28 smithi077 ceph-mon[35095]: fsmap 11 up:standby 2024-09-12T01:56:29.209 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:28 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:56:29.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:28 smithi062 ceph-mon[30666]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:29.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:28 smithi062 ceph-mon[30666]: Deploying daemon mds.b on smithi077 2024-09-12T01:56:29.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:28 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.62:6840/886174121,v1:172.21.15.62:6841/886174121] up:boot 2024-09-12T01:56:29.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:28 smithi062 ceph-mon[30666]: fsmap 11 up:standby 2024-09-12T01:56:29.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:28 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:56:29.900 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 01:56:29 smithi077 systemd[1]: Starting Ceph mds.b for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:30.180 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 01:56:29 smithi077 podman[65290]: 2024-09-12 01:56:29.802812519 +0000 UTC m=+0.015796578 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:30.180 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 01:56:29 smithi077 podman[65290]: 2024-09-12 01:56:29.91092311 +0000 UTC m=+0.123907160 container create 68f5bc005918a752e561a3136e57fcb2af15700503df3a44562d48c2cb243e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:56:30.180 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 01:56:30 smithi077 podman[65290]: 2024-09-12 01:56:30.180658658 +0000 UTC m=+0.393642705 container init 68f5bc005918a752e561a3136e57fcb2af15700503df3a44562d48c2cb243e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:56:30.260 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:30.464 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 01:56:30 smithi077 podman[65290]: 2024-09-12 01:56:30.183445897 +0000 UTC m=+0.396429956 container start 68f5bc005918a752e561a3136e57fcb2af15700503df3a44562d48c2cb243e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:56:30.464 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 01:56:30 smithi077 ceph-mds[65309]: -- 172.21.15.77:0/94991188 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56320d6f5860 con 0x56320d6d2800 2024-09-12T01:56:30.464 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 01:56:30 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b[65305]: starting mds.b at 2024-09-12T01:56:30.464 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 01:56:30 smithi077 bash[65290]: 68f5bc005918a752e561a3136e57fcb2af15700503df3a44562d48c2cb243e2b 2024-09-12T01:56:30.464 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 01:56:30 smithi077 systemd[1]: Started Ceph mds.b for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:30.687 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:31.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.265+0000 7fa8ce400640 1 -- 172.21.15.62:0/4113796336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c81019d0 msgr2=0x7fa8c8101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.265+0000 7fa8ce400640 1 --2- 172.21.15.62:0/4113796336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c81019d0 0x7fa8c8101e30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009930 tx=0x7fa8b402a420 comp rx=0 tx=0).stop 2024-09-12T01:56:31.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.265+0000 7fa8ce400640 1 -- 172.21.15.62:0/4113796336 shutdown_connections 2024-09-12T01:56:31.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.265+0000 7fa8ce400640 1 --2- 172.21.15.62:0/4113796336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8c8102370 0x7fa8c810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.265+0000 7fa8ce400640 1 --2- 172.21.15.62:0/4113796336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c81019d0 0x7fa8c8101e30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.265+0000 7fa8ce400640 1 --2- 172.21.15.62:0/4113796336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8c81079d0 0x7fa8c8107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.265+0000 7fa8ce400640 1 -- 172.21.15.62:0/4113796336 >> 172.21.15.62:0/4113796336 conn(0x7fa8c80fd710 msgr2=0x7fa8c80ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:31.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.266+0000 7fa8ce400640 1 -- 172.21.15.62:0/4113796336 shutdown_connections 2024-09-12T01:56:31.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.266+0000 7fa8ce400640 1 -- 172.21.15.62:0/4113796336 wait complete. 2024-09-12T01:56:31.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.267+0000 7fa8ce400640 1 Processor -- start 2024-09-12T01:56:31.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.267+0000 7fa8ce400640 1 -- start start 2024-09-12T01:56:31.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.267+0000 7fa8ce400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8c81019d0 0x7fa8c819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.267+0000 7fa8ce400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8c8102370 0x7fa8c819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.267+0000 7fa8ce400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c81079d0 0x7fa8c819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.267+0000 7fa8ce400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c8111dd0 con 0x7fa8c81079d0 2024-09-12T01:56:31.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.267+0000 7fa8ce400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c8111c50 con 0x7fa8c8102370 2024-09-12T01:56:31.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.267+0000 7fa8ce400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c8111f50 con 0x7fa8c81019d0 2024-09-12T01:56:31.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8c7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8c8102370 0x7fa8c819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8cd000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8c81019d0 0x7fa8c819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8cd000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8c81019d0 0x7fa8c819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:45284/0 (socket says 172.21.15.62:45284) 2024-09-12T01:56:31.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8cd000640 1 -- 172.21.15.62:0/3454704515 learned_addr learned my addr 172.21.15.62:0/3454704515 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:31.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8cda00640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c81079d0 0x7fa8c819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8cd000640 1 -- 172.21.15.62:0/3454704515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8c8102370 msgr2=0x7fa8c819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8cd000640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8c8102370 0x7fa8c819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8cd000640 1 -- 172.21.15.62:0/3454704515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c81079d0 msgr2=0x7fa8c819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8cd000640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c81079d0 0x7fa8c819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8cd000640 1 -- 172.21.15.62:0/3454704515 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c819f4a0 con 0x7fa8c81019d0 2024-09-12T01:56:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.268+0000 7fa8cd000640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8c81019d0 0x7fa8c819a4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00d950 tx=0x7fa8bc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.269+0000 7fa8c5600640 1 -- 172.21.15.62:0/3454704515 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc017070 con 0x7fa8c81019d0 2024-09-12T01:56:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.269+0000 7fa8ce400640 1 -- 172.21.15.62:0/3454704515 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c819f790 con 0x7fa8c81019d0 2024-09-12T01:56:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.269+0000 7fa8c5600640 1 -- 172.21.15.62:0/3454704515 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8bc009c30 con 0x7fa8c81019d0 2024-09-12T01:56:31.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.269+0000 7fa8c5600640 1 -- 172.21.15.62:0/3454704515 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00f6b0 con 0x7fa8c81019d0 2024-09-12T01:56:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.269+0000 7fa8ce400640 1 -- 172.21.15.62:0/3454704515 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c81a7070 con 0x7fa8c81019d0 2024-09-12T01:56:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.270+0000 7fa8ce400640 1 -- 172.21.15.62:0/3454704515 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c8101e30 con 0x7fa8c81019d0 2024-09-12T01:56:31.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.272+0000 7fa8c5600640 1 -- 172.21.15.62:0/3454704515 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa8bc0109d0 con 0x7fa8c81019d0 2024-09-12T01:56:31.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.273+0000 7fa8c5600640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8b00a2c00 0x7fa8b00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:31.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.273+0000 7fa8c5600640 1 -- 172.21.15.62:0/3454704515 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fa8bc0ce720 con 0x7fa8c81019d0 2024-09-12T01:56:31.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.273+0000 7fa8c7e00640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8b00a2c00 0x7fa8b00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:31.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.274+0000 7fa8c7e00640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8b00a2c00 0x7fa8b00a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009900 tx=0x7fa8b40058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:31.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.277+0000 7fa8c5600640 1 -- 172.21.15.62:0/3454704515 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8bc009de0 con 0x7fa8c81019d0 2024-09-12T01:56:31.368 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:31 smithi107 ceph-mon[35463]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:31.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:31 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:31 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:31 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.369 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:31 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:31 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:31 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:56:31.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:31 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] up:boot 2024-09-12T01:56:31.370 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:31 smithi107 ceph-mon[35463]: fsmap 12 up:standby 2024-09-12T01:56:31.371 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:31 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:56:31.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:31 smithi077 ceph-mon[35095]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:31.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:31 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:31 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:31 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:31 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:31 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:31 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:56:31.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:31 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] up:boot 2024-09-12T01:56:31.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:31 smithi077 ceph-mon[35095]: fsmap 12 up:standby 2024-09-12T01:56:31.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:31 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:56:31.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.523+0000 7fa8ce400640 1 -- 172.21.15.62:0/3454704515 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8c81a7240 con 0x7fa8c81019d0 2024-09-12T01:56:31.525 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:31 smithi062 ceph-mon[30666]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:31.525 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:31 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.525 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:31 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.526 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:31 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.526 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:31 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.526 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:31 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:31.526 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:31 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:56:31.526 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:31 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] up:boot 2024-09-12T01:56:31.526 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:31 smithi062 ceph-mon[30666]: fsmap 12 up:standby 2024-09-12T01:56:31.526 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:31 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:56:31.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.524+0000 7fa8c5600640 1 -- 172.21.15.62:0/3454704515 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10524 (secure 0 0 0) 0x7fa8bc09b430 con 0x7fa8c81019d0 2024-09-12T01:56:31.527 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:31.527 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 13 2024-09-12T01:56:31.527 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":13,"btime":"2024-09-12T01:56:30:918902+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24530,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T01:56:31.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 -- 172.21.15.62:0/3454704515 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8b00a2c00 msgr2=0x7fa8b00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8b00a2c00 0x7fa8b00a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009900 tx=0x7fa8b40058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 -- 172.21.15.62:0/3454704515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8c81019d0 msgr2=0x7fa8c819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8c81019d0 0x7fa8c819a4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00d950 tx=0x7fa8bc00de10 comp rx=0 tx=0).stop 2024-09-12T01:56:31.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 -- 172.21.15.62:0/3454704515 shutdown_connections 2024-09-12T01:56:31.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8b00a2c00 0x7fa8b00a50c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c81079d0 0x7fa8c819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8c8102370 0x7fa8c819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 --2- 172.21.15.62:0/3454704515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8c81019d0 0x7fa8c819a4f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 -- 172.21.15.62:0/3454704515 >> 172.21.15.62:0/3454704515 conn(0x7fa8c80fd710 msgr2=0x7fa8c810d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:31.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 -- 172.21.15.62:0/3454704515 shutdown_connections 2024-09-12T01:56:31.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:31.527+0000 7fa8ce400640 1 -- 172.21.15.62:0/3454704515 wait complete. 2024-09-12T01:56:32.570 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:32 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.570 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:32 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3454704515' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:32.570 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:32 smithi062 ceph-mon[30666]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:32.570 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:32 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.570 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:32 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.571 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:32 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.571 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:32 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.797 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:32 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.797 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:32 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3454704515' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:32.797 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:32 smithi077 ceph-mon[35095]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:32.797 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:32 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.797 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:32 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.797 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:32 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.798 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:32 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:32 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:32 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3454704515' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:32.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:32 smithi107 ceph-mon[35463]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:32.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:32 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:32 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:32 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:32 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:32.977 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T01:56:33.376 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.002+0000 7f7a59e00640 1 -- 172.21.15.62:0/1566577836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54103ff0 msgr2=0x7f7a541043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.002+0000 7f7a59e00640 1 --2- 172.21.15.62:0/1566577836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54103ff0 0x7f7a541043d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009900 tx=0x7f7a4402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.003+0000 7f7a59e00640 1 -- 172.21.15.62:0/1566577836 shutdown_connections 2024-09-12T01:56:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.003+0000 7f7a59e00640 1 --2- 172.21.15.62:0/1566577836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54109120 0x7f7a54110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.003+0000 7f7a59e00640 1 --2- 172.21.15.62:0/1566577836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a541049a0 0x7f7a541089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.003+0000 7f7a59e00640 1 --2- 172.21.15.62:0/1566577836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54103ff0 0x7f7a541043d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.003+0000 7f7a59e00640 1 -- 172.21.15.62:0/1566577836 >> 172.21.15.62:0/1566577836 conn(0x7f7a540ffa90 msgr2=0x7f7a54101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.003+0000 7f7a59e00640 1 -- 172.21.15.62:0/1566577836 shutdown_connections 2024-09-12T01:56:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.003+0000 7f7a59e00640 1 -- 172.21.15.62:0/1566577836 wait complete. 2024-09-12T01:56:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.004+0000 7f7a59e00640 1 Processor -- start 2024-09-12T01:56:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.004+0000 7f7a59e00640 1 -- start start 2024-09-12T01:56:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.004+0000 7f7a59e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54103ff0 0x7f7a5419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.004+0000 7f7a59e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a541049a0 0x7f7a5419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.004+0000 7f7a59e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54109120 0x7f7a5419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.004+0000 7f7a59e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54114170 con 0x7f7a54109120 2024-09-12T01:56:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.004+0000 7f7a59e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54113ff0 con 0x7f7a54103ff0 2024-09-12T01:56:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.004+0000 7f7a59e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7a541142f0 con 0x7f7a541049a0 2024-09-12T01:56:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a52a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54103ff0 0x7f7a5419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a52a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54103ff0 0x7f7a5419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:40094/0 (socket says 172.21.15.62:40094) 2024-09-12T01:56:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a52a00640 1 -- 172.21.15.62:0/2679118915 learned_addr learned my addr 172.21.15.62:0/2679118915 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a4be00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a541049a0 0x7f7a5419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a53400640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54109120 0x7f7a5419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a4be00640 1 -- 172.21.15.62:0/2679118915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54103ff0 msgr2=0x7f7a5419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a4be00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54103ff0 0x7f7a5419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a4be00640 1 -- 172.21.15.62:0/2679118915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54109120 msgr2=0x7f7a5419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a4be00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54109120 0x7f7a5419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a4be00640 1 -- 172.21.15.62:0/2679118915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5419f620 con 0x7f7a541049a0 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.005+0000 7f7a52a00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54103ff0 0x7f7a5419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.006+0000 7f7a4be00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a541049a0 0x7f7a5419abb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00e9f0 tx=0x7f7a3c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.006+0000 7f7a58a00640 1 -- 172.21.15.62:0/2679118915 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00ccc0 con 0x7f7a541049a0 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.006+0000 7f7a58a00640 1 -- 172.21.15.62:0/2679118915 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a3c010910 con 0x7f7a541049a0 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.006+0000 7f7a59e00640 1 -- 172.21.15.62:0/2679118915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a5419f910 con 0x7f7a541049a0 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.006+0000 7f7a58a00640 1 -- 172.21.15.62:0/2679118915 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c018960 con 0x7f7a541049a0 2024-09-12T01:56:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.006+0000 7f7a59e00640 1 -- 172.21.15.62:0/2679118915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a541a71f0 con 0x7f7a541049a0 2024-09-12T01:56:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.007+0000 7f7a59e00640 1 -- 172.21.15.62:0/2679118915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a541043d0 con 0x7f7a541049a0 2024-09-12T01:56:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.009+0000 7f7a58a00640 1 -- 172.21.15.62:0/2679118915 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7a3c010ac0 con 0x7f7a541049a0 2024-09-12T01:56:34.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.010+0000 7f7a58a00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7a380a2b80 0x7f7a380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.010+0000 7f7a58a00640 1 -- 172.21.15.62:0/2679118915 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f7a3c0cefd0 con 0x7f7a541049a0 2024-09-12T01:56:34.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.010+0000 7f7a52a00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7a380a2b80 0x7f7a380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.011+0000 7f7a52a00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7a380a2b80 0x7f7a380a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a440096c0 tx=0x7f7a440046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:34.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.014+0000 7f7a58a00640 1 -- 172.21.15.62:0/2679118915 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a3c09bce0 con 0x7f7a541049a0 2024-09-12T01:56:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.234+0000 7f7a59e00640 1 -- 172.21.15.62:0/2679118915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7a5410bd70 con 0x7f7a541049a0 2024-09-12T01:56:34.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.235+0000 7f7a58a00640 1 -- 172.21.15.62:0/2679118915 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7f7a3c09ffe0 con 0x7f7a541049a0 2024-09-12T01:56:34.236 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2024-09-12T01:56:34.236 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:56:34.236 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2024-09-12T01:56:34.236 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2024-09-12T01:56:34.236 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T01:56:34.236 INFO:teuthology.orchestra.run.smithi062.stdout:] 2024-09-12T01:56:34.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.237+0000 7f7a59e00640 1 -- 172.21.15.62:0/2679118915 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7a380a2b80 msgr2=0x7f7a380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.237+0000 7f7a59e00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7a380a2b80 0x7f7a380a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a440096c0 tx=0x7f7a440046c0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.237+0000 7f7a59e00640 1 -- 172.21.15.62:0/2679118915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a541049a0 msgr2=0x7f7a5419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.237+0000 7f7a59e00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a541049a0 0x7f7a5419abb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00e9f0 tx=0x7f7a3c00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.238+0000 7f7a59e00640 1 -- 172.21.15.62:0/2679118915 shutdown_connections 2024-09-12T01:56:34.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.238+0000 7f7a59e00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7a380a2b80 0x7f7a380a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.238+0000 7f7a59e00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a54109120 0x7f7a5419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.238+0000 7f7a59e00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a541049a0 0x7f7a5419abb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.238+0000 7f7a59e00640 1 --2- 172.21.15.62:0/2679118915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a54103ff0 0x7f7a5419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.238+0000 7f7a59e00640 1 -- 172.21.15.62:0/2679118915 >> 172.21.15.62:0/2679118915 conn(0x7f7a540ffa90 msgr2=0x7f7a54100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:34.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.238+0000 7f7a59e00640 1 -- 172.21.15.62:0/2679118915 shutdown_connections 2024-09-12T01:56:34.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:34.238+0000 7f7a59e00640 1 -- 172.21.15.62:0/2679118915 wait complete. 2024-09-12T01:56:34.958 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:56:34.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:56:35.346 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:35.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:35 smithi107 ceph-mon[35463]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:35.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:35 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:35.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:35 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:35.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:35 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2679118915' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:56:35.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:35 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:35.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:35 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:56:35.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:35 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:35.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:35 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:56:35.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:35 smithi077 ceph-mon[35095]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:35.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:35 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:35.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:35 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:35.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:35 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2679118915' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:56:35.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:35 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:35.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:35 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:56:35.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:35 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:35.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:35 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:56:35.501 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:35 smithi062 ceph-mon[30666]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:35.501 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:35 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:35.501 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:35 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:35.501 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:35 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2679118915' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:56:35.501 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:35 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:35.501 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:35 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:56:35.501 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:35 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:35.502 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:35 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:56:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.942+0000 7f4fda000640 1 -- 172.21.15.62:0/2456782115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd4109120 msgr2=0x7f4fd4110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.942+0000 7f4fda000640 1 --2- 172.21.15.62:0/2456782115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd4109120 0x7f4fd4110ca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009ca0 tx=0x7f4fcc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.942+0000 7f4fda000640 1 -- 172.21.15.62:0/2456782115 shutdown_connections 2024-09-12T01:56:35.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.942+0000 7f4fda000640 1 --2- 172.21.15.62:0/2456782115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd4109120 0x7f4fd4110ca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.942+0000 7f4fda000640 1 --2- 172.21.15.62:0/2456782115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd41049a0 0x7f4fd41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.942+0000 7f4fda000640 1 --2- 172.21.15.62:0/2456782115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fd4103ff0 0x7f4fd41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.942+0000 7f4fda000640 1 -- 172.21.15.62:0/2456782115 >> 172.21.15.62:0/2456782115 conn(0x7f4fd40ffa90 msgr2=0x7f4fd4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.942+0000 7f4fda000640 1 -- 172.21.15.62:0/2456782115 shutdown_connections 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.942+0000 7f4fda000640 1 -- 172.21.15.62:0/2456782115 wait complete. 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.943+0000 7f4fda000640 1 Processor -- start 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.943+0000 7f4fda000640 1 -- start start 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fda000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fd4103ff0 0x7f4fd419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fda000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd41049a0 0x7f4fd419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fda000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd4109120 0x7f4fd419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fda000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd41141a0 con 0x7f4fd41049a0 2024-09-12T01:56:35.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fda000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4114020 con 0x7f4fd4103ff0 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fda000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4114320 con 0x7f4fd4109120 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fd3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fd4103ff0 0x7f4fd419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fd3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fd4103ff0 0x7f4fd419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:40110/0 (socket says 172.21.15.62:40110) 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fd2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd41049a0 0x7f4fd419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fd3400640 1 -- 172.21.15.62:0/2220365471 learned_addr learned my addr 172.21.15.62:0/2220365471 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fd3e00640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd4109120 0x7f4fd419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fd3400640 1 -- 172.21.15.62:0/2220365471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd4109120 msgr2=0x7f4fd419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fd3400640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd4109120 0x7f4fd419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fd3400640 1 -- 172.21.15.62:0/2220365471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd41049a0 msgr2=0x7f4fd419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fd3400640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd41049a0 0x7f4fd419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.944+0000 7f4fd3400640 1 -- 172.21.15.62:0/2220365471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd419f590 con 0x7f4fd4103ff0 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.945+0000 7f4fd3400640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fd4103ff0 0x7f4fd419a5e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400e9f0 tx=0x7f4fc400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.945+0000 7f4fcbe00640 1 -- 172.21.15.62:0/2220365471 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400cd80 con 0x7f4fd4103ff0 2024-09-12T01:56:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.945+0000 7f4fda000640 1 -- 172.21.15.62:0/2220365471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd419f880 con 0x7f4fd4103ff0 2024-09-12T01:56:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.945+0000 7f4fcbe00640 1 -- 172.21.15.62:0/2220365471 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc4005500 con 0x7f4fd4103ff0 2024-09-12T01:56:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.945+0000 7f4fcbe00640 1 -- 172.21.15.62:0/2220365471 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4010690 con 0x7f4fd4103ff0 2024-09-12T01:56:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.945+0000 7f4fda000640 1 -- 172.21.15.62:0/2220365471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd41a7160 con 0x7f4fd4103ff0 2024-09-12T01:56:35.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.946+0000 7f4fda000640 1 -- 172.21.15.62:0/2220365471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd41043d0 con 0x7f4fd4103ff0 2024-09-12T01:56:35.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.948+0000 7f4fcbe00640 1 -- 172.21.15.62:0/2220365471 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4fc40046c0 con 0x7f4fd4103ff0 2024-09-12T01:56:35.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.950+0000 7f4fcbe00640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fb80a2b80 0x7f4fb80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.950+0000 7f4fcbe00640 1 -- 172.21.15.62:0/2220365471 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f4fc40cf060 con 0x7f4fd4103ff0 2024-09-12T01:56:35.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.950+0000 7f4fd2a00640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fb80a2b80 0x7f4fb80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.951+0000 7f4fd2a00640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fb80a2b80 0x7f4fb80a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4108a30 tx=0x7f4fc0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:35.952+0000 7f4fcbe00640 1 -- 172.21.15.62:0/2220365471 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fc409c3c0 con 0x7f4fd4103ff0 2024-09-12T01:56:36.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.151+0000 7f4fda000640 1 -- 172.21.15.62:0/2220365471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4fd41a7440 con 0x7f4fd4103ff0 2024-09-12T01:56:36.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.738+0000 7f4fcbe00640 1 -- 172.21.15.62:0/2220365471 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f4fc409bcc0 con 0x7f4fd4103ff0 2024-09-12T01:56:36.740 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2024-09-12T01:56:36.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.744+0000 7f4fda000640 1 -- 172.21.15.62:0/2220365471 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fb80a2b80 msgr2=0x7f4fb80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.744+0000 7f4fda000640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fb80a2b80 0x7f4fb80a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4108a30 tx=0x7f4fc0005f90 comp rx=0 tx=0).stop 2024-09-12T01:56:36.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.744+0000 7f4fda000640 1 -- 172.21.15.62:0/2220365471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fd4103ff0 msgr2=0x7f4fd419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.744+0000 7f4fda000640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fd4103ff0 0x7f4fd419a5e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400e9f0 tx=0x7f4fc400edf0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.745+0000 7f4fda000640 1 -- 172.21.15.62:0/2220365471 shutdown_connections 2024-09-12T01:56:36.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.745+0000 7f4fda000640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fb80a2b80 0x7f4fb80a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.745+0000 7f4fda000640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fd4109120 0x7f4fd419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.745+0000 7f4fda000640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fd41049a0 0x7f4fd419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.745+0000 7f4fda000640 1 --2- 172.21.15.62:0/2220365471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fd4103ff0 0x7f4fd419a5e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.745+0000 7f4fda000640 1 -- 172.21.15.62:0/2220365471 >> 172.21.15.62:0/2220365471 conn(0x7f4fd40ffa90 msgr2=0x7f4fd41004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:36.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.745+0000 7f4fda000640 1 -- 172.21.15.62:0/2220365471 shutdown_connections 2024-09-12T01:56:36.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:36.746+0000 7f4fda000640 1 -- 172.21.15.62:0/2220365471 wait complete. 2024-09-12T01:56:37.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:36 smithi062 ceph-mon[30666]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:37.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:36 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2220365471' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:56:37.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:36 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:56:37.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:36 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:36 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:36 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:36 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:36 smithi077 ceph-mon[35095]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:37.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:36 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2220365471' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:56:37.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:36 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:56:37.116 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:36 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.117 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:36 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.117 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:36 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.117 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:36 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:36 smithi107 ceph-mon[35463]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:37.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:36 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2220365471' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:56:37.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:36 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:56:37.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:36 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:36 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:36 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:36 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:37.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T01:56:38.059 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:38.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:37 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:56:38.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:37 smithi062 ceph-mon[30666]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:56:38.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:37 smithi062 ceph-mon[30666]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:56:38.127 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:37 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:56:38.127 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:37 smithi077 ceph-mon[35095]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:56:38.127 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:37 smithi077 ceph-mon[35095]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:56:38.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:37 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:56:38.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:37 smithi107 ceph-mon[35463]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:56:38.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:37 smithi107 ceph-mon[35463]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:56:38.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.631+0000 7f9973e00640 1 -- 172.21.15.62:0/2411184049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c101de0 msgr2=0x7f996c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:38.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.631+0000 7f9973e00640 1 --2- 172.21.15.62:0/2411184049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c101de0 0x7f996c1021c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9960009900 tx=0x7f996002a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.631+0000 7f9973e00640 1 -- 172.21.15.62:0/2411184049 shutdown_connections 2024-09-12T01:56:38.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.631+0000 7f9973e00640 1 --2- 172.21.15.62:0/2411184049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f996c106f10 0x7f996c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.631+0000 7f9973e00640 1 --2- 172.21.15.62:0/2411184049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f996c102790 0x7f996c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.631+0000 7f9973e00640 1 --2- 172.21.15.62:0/2411184049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c101de0 0x7f996c1021c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.631+0000 7f9973e00640 1 -- 172.21.15.62:0/2411184049 >> 172.21.15.62:0/2411184049 conn(0x7f996c0fd8c0 msgr2=0x7f996c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:38.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.631+0000 7f9973e00640 1 -- 172.21.15.62:0/2411184049 shutdown_connections 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.631+0000 7f9973e00640 1 -- 172.21.15.62:0/2411184049 wait complete. 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.632+0000 7f9973e00640 1 Processor -- start 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.632+0000 7f9973e00640 1 -- start start 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.632+0000 7f9973e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f996c101de0 0x7f996c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.632+0000 7f9973e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102790 0x7f996c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.632+0000 7f9973e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f996c106f10 0x7f996c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.632+0000 7f9973e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f996c111f80 con 0x7f996c101de0 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.632+0000 7f9973e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f996c111e00 con 0x7f996c106f10 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.632+0000 7f9973e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f996c112100 con 0x7f996c102790 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9971400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f996c101de0 0x7f996c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:38.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9971400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f996c101de0 0x7f996c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46980/0 (socket says 172.21.15.62:46980) 2024-09-12T01:56:38.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9971400640 1 -- 172.21.15.62:0/1942423104 learned_addr learned my addr 172.21.15.62:0/1942423104 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:38.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9970a00640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102790 0x7f996c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:38.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9971e00640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f996c106f10 0x7f996c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:38.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9971400640 1 -- 172.21.15.62:0/1942423104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102790 msgr2=0x7f996c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:38.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9971400640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102790 0x7f996c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9971400640 1 -- 172.21.15.62:0/1942423104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f996c106f10 msgr2=0x7f996c19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:38.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9971400640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f996c106f10 0x7f996c19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:38.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9971400640 1 -- 172.21.15.62:0/1942423104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c19f610 con 0x7f996c101de0 2024-09-12T01:56:38.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.633+0000 7f9971400640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f996c101de0 0x7f996c19a660 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9960004770 tx=0x7f9960003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:38.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.634+0000 7f996a000640 1 -- 172.21.15.62:0/1942423104 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996003f070 con 0x7f996c101de0 2024-09-12T01:56:38.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.634+0000 7f9973e00640 1 -- 172.21.15.62:0/1942423104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996c19f8a0 con 0x7f996c101de0 2024-09-12T01:56:38.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.634+0000 7f996a000640 1 -- 172.21.15.62:0/1942423104 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9960031ca0 con 0x7f996c101de0 2024-09-12T01:56:38.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.634+0000 7f996a000640 1 -- 172.21.15.62:0/1942423104 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960035030 con 0x7f996c101de0 2024-09-12T01:56:38.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.634+0000 7f9973e00640 1 -- 172.21.15.62:0/1942423104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996c1a71e0 con 0x7f996c101de0 2024-09-12T01:56:38.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.635+0000 7f9973e00640 1 -- 172.21.15.62:0/1942423104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f996c1032c0 con 0x7f996c101de0 2024-09-12T01:56:38.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.637+0000 7f996a000640 1 -- 172.21.15.62:0/1942423104 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9960042070 con 0x7f996c101de0 2024-09-12T01:56:38.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.639+0000 7f996a000640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f99540a2b80 0x7f99540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:38.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.639+0000 7f996a000640 1 -- 172.21.15.62:0/1942423104 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7f99600efa10 con 0x7f996c101de0 2024-09-12T01:56:38.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.640+0000 7f9970a00640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f99540a2b80 0x7f99540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:38.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.640+0000 7f9970a00640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f99540a2b80 0x7f99540a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f996c10eee0 tx=0x7f9958005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:38.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.642+0000 7f996a000640 1 -- 172.21.15.62:0/1942423104 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f99600bc5b0 con 0x7f996c101de0 2024-09-12T01:56:38.763 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:38 smithi062 ceph-mon[30666]: pgmap v286: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:38.763 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:38 smithi062 ceph-mon[30666]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:56:38.763 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:38.763 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:38 smithi062 ceph-mon[30666]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:56:38.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:38.838+0000 7f9973e00640 1 -- 172.21.15.62:0/1942423104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f996c1021c0 con 0x7f996c101de0 2024-09-12T01:56:39.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:39.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:39.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:56:39.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:38 smithi107 ceph-mon[35463]: pgmap v286: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:39.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:38 smithi107 ceph-mon[35463]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:56:39.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:39.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:38 smithi107 ceph-mon[35463]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:56:39.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:39.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:39.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:56:39.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:38 smithi077 ceph-mon[35095]: pgmap v286: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:39.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:38 smithi077 ceph-mon[35095]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:56:39.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:39.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:38 smithi077 ceph-mon[35095]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:56:39.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:39.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:39.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:56:39.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.769+0000 7f996a000640 1 -- 172.21.15.62:0/1942423104 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v81) ==== 171+0+0 (secure 0 0 0) 0x7f99600c08b0 con 0x7f996c101de0 2024-09-12T01:56:39.769 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2024-09-12T01:56:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.772+0000 7f9973e00640 1 -- 172.21.15.62:0/1942423104 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f99540a2b80 msgr2=0x7f99540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.772+0000 7f9973e00640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f99540a2b80 0x7f99540a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f996c10eee0 tx=0x7f9958005f90 comp rx=0 tx=0).stop 2024-09-12T01:56:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.772+0000 7f9973e00640 1 -- 172.21.15.62:0/1942423104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f996c101de0 msgr2=0x7f996c19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:39.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.772+0000 7f9973e00640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f996c101de0 0x7f996c19a660 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9960004770 tx=0x7f9960003c10 comp rx=0 tx=0).stop 2024-09-12T01:56:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.772+0000 7f9973e00640 1 -- 172.21.15.62:0/1942423104 shutdown_connections 2024-09-12T01:56:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.772+0000 7f9973e00640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f99540a2b80 0x7f99540a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.772+0000 7f9973e00640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f996c106f10 0x7f996c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.772+0000 7f9973e00640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f996c102790 0x7f996c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.772+0000 7f9973e00640 1 --2- 172.21.15.62:0/1942423104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f996c101de0 0x7f996c19a660 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.772+0000 7f9973e00640 1 -- 172.21.15.62:0/1942423104 >> 172.21.15.62:0/1942423104 conn(0x7f996c0fd8c0 msgr2=0x7f996c0ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:39.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.773+0000 7f9973e00640 1 -- 172.21.15.62:0/1942423104 shutdown_connections 2024-09-12T01:56:39.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:39.773+0000 7f9973e00640 1 -- 172.21.15.62:0/1942423104 wait complete. 2024-09-12T01:56:40.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:39 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:40.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:39 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1942423104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T01:56:40.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:39 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:40.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:39 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1942423104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T01:56:40.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:39 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:56:40.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:39 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1942423104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T01:56:40.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:56:40.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:40 smithi062 ceph-mon[30666]: pgmap v289: 33 pgs: 1 creating+activating, 4 creating+peering, 14 unknown, 14 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:40.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:40 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1942423104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T01:56:40.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:40 smithi062 ceph-mon[30666]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:56:40.980 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:41.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:40 smithi107 ceph-mon[35463]: pgmap v289: 33 pgs: 1 creating+activating, 4 creating+peering, 14 unknown, 14 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:41.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:40 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1942423104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T01:56:41.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:40 smithi107 ceph-mon[35463]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:56:41.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:40 smithi077 ceph-mon[35095]: pgmap v289: 33 pgs: 1 creating+activating, 4 creating+peering, 14 unknown, 14 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:41.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:40 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1942423104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T01:56:41.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:40 smithi077 ceph-mon[35095]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:56:41.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.613+0000 7f8e35200640 1 -- 172.21.15.62:0/2759743764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e30109140 msgr2=0x7f8e30110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.613+0000 7f8e35200640 1 --2- 172.21.15.62:0/2759743764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e30109140 0x7f8e30110cc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009900 tx=0x7f8e2802a410 comp rx=0 tx=0).stop 2024-09-12T01:56:41.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.613+0000 7f8e35200640 1 -- 172.21.15.62:0/2759743764 shutdown_connections 2024-09-12T01:56:41.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.613+0000 7f8e35200640 1 --2- 172.21.15.62:0/2759743764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e30109140 0x7f8e30110cc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.613+0000 7f8e35200640 1 --2- 172.21.15.62:0/2759743764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e301049c0 0x7f8e30108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.613+0000 7f8e35200640 1 --2- 172.21.15.62:0/2759743764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e30104010 0x7f8e301043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.613+0000 7f8e35200640 1 -- 172.21.15.62:0/2759743764 >> 172.21.15.62:0/2759743764 conn(0x7f8e300ffa50 msgr2=0x7f8e30101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.613+0000 7f8e35200640 1 -- 172.21.15.62:0/2759743764 shutdown_connections 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.613+0000 7f8e35200640 1 -- 172.21.15.62:0/2759743764 wait complete. 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.614+0000 7f8e35200640 1 Processor -- start 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.614+0000 7f8e35200640 1 -- start start 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e35200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e30104010 0x7f8e3019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e35200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e301049c0 0x7f8e3019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e35200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e30109140 0x7f8e3019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e35200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301141a0 con 0x7f8e30104010 2024-09-12T01:56:41.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e35200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30114020 con 0x7f8e301049c0 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e35200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30114320 con 0x7f8e30109140 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e30104010 0x7f8e3019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e2de00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e30104010 0x7f8e3019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47002/0 (socket says 172.21.15.62:47002) 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e2de00640 1 -- 172.21.15.62:0/943436400 learned_addr learned my addr 172.21.15.62:0/943436400 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e2e800640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e30109140 0x7f8e3019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.615+0000 7f8e25400640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e301049c0 0x7f8e3019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e2de00640 1 -- 172.21.15.62:0/943436400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e30109140 msgr2=0x7f8e3019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e2de00640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e30109140 0x7f8e3019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e2de00640 1 -- 172.21.15.62:0/943436400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e301049c0 msgr2=0x7f8e3019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e2de00640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e301049c0 0x7f8e3019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e2de00640 1 -- 172.21.15.62:0/943436400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3019f650 con 0x7f8e30104010 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e2de00640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e30104010 0x7f8e3019a6a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000db80 tx=0x7f8e2000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:41.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e27400640 1 -- 172.21.15.62:0/943436400 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20017070 con 0x7f8e30104010 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e27400640 1 -- 172.21.15.62:0/943436400 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e20003b70 con 0x7f8e30104010 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e27400640 1 -- 172.21.15.62:0/943436400 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e200106c0 con 0x7f8e30104010 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e35200640 1 -- 172.21.15.62:0/943436400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3019f940 con 0x7f8e30104010 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.616+0000 7f8e35200640 1 -- 172.21.15.62:0/943436400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e301a7220 con 0x7f8e30104010 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.617+0000 7f8e35200640 1 -- 172.21.15.62:0/943436400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e301043f0 con 0x7f8e30104010 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.619+0000 7f8e27400640 1 -- 172.21.15.62:0/943436400 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8e20004020 con 0x7f8e30104010 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.621+0000 7f8e27400640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e140a2c00 0x7f8e140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.621+0000 7f8e27400640 1 -- 172.21.15.62:0/943436400 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7879+0+0 (secure 0 0 0) 0x7f8e200cef40 con 0x7f8e30104010 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.621+0000 7f8e25400640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e140a2c00 0x7f8e140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.622+0000 7f8e25400640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e140a2c00 0x7f8e140a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e3010ab10 tx=0x7f8e1800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.624+0000 7f8e27400640 1 -- 172.21.15.62:0/943436400 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e20020070 con 0x7f8e30104010 2024-09-12T01:56:41.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:41.853+0000 7f8e35200640 1 -- 172.21.15.62:0/943436400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8e3019ba00 con 0x7f8e30104010 2024-09-12T01:56:42.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:41 smithi062 ceph-mon[30666]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:56:42.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:41 smithi107 ceph-mon[35463]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:56:42.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:41 smithi077 ceph-mon[35095]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:56:42.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.787+0000 7f8e27400640 1 -- 172.21.15.62:0/943436400 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f8e2009c030 con 0x7f8e30104010 2024-09-12T01:56:42.788 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T01:56:42.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.790+0000 7f8e35200640 1 -- 172.21.15.62:0/943436400 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e140a2c00 msgr2=0x7f8e140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.790+0000 7f8e35200640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e140a2c00 0x7f8e140a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e3010ab10 tx=0x7f8e1800b410 comp rx=0 tx=0).stop 2024-09-12T01:56:42.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.790+0000 7f8e35200640 1 -- 172.21.15.62:0/943436400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e30104010 msgr2=0x7f8e3019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.790+0000 7f8e35200640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e30104010 0x7f8e3019a6a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000db80 tx=0x7f8e2000b630 comp rx=0 tx=0).stop 2024-09-12T01:56:42.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.791+0000 7f8e35200640 1 -- 172.21.15.62:0/943436400 shutdown_connections 2024-09-12T01:56:42.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.791+0000 7f8e35200640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8e140a2c00 0x7f8e140a50c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.791+0000 7f8e35200640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e30109140 0x7f8e3019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.791+0000 7f8e35200640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e301049c0 0x7f8e3019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.791+0000 7f8e35200640 1 --2- 172.21.15.62:0/943436400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e30104010 0x7f8e3019a6a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.791+0000 7f8e35200640 1 -- 172.21.15.62:0/943436400 >> 172.21.15.62:0/943436400 conn(0x7f8e300ffa50 msgr2=0x7f8e30100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:42.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.791+0000 7f8e35200640 1 -- 172.21.15.62:0/943436400 shutdown_connections 2024-09-12T01:56:42.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:42.792+0000 7f8e35200640 1 -- 172.21.15.62:0/943436400 wait complete. 2024-09-12T01:56:43.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:42 smithi062 ceph-mon[30666]: pgmap v292: 97 pgs: 1 creating+activating, 15 creating+peering, 53 unknown, 28 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:43.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:42 smithi062 ceph-mon[30666]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T01:56:43.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:42 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/943436400' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:56:43.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:42 smithi062 ceph-mon[30666]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:56:43.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:42 smithi107 ceph-mon[35463]: pgmap v292: 97 pgs: 1 creating+activating, 15 creating+peering, 53 unknown, 28 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:43.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:42 smithi107 ceph-mon[35463]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T01:56:43.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:42 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/943436400' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:56:43.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:42 smithi107 ceph-mon[35463]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:56:43.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:42 smithi077 ceph-mon[35095]: pgmap v292: 97 pgs: 1 creating+activating, 15 creating+peering, 53 unknown, 28 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:43.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:42 smithi077 ceph-mon[35095]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T01:56:43.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:42 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/943436400' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:56:43.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:42 smithi077 ceph-mon[35095]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:56:43.629 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T01:56:43.630 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T01:56:43.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:43 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/943436400' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:56:43.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:43 smithi062 ceph-mon[30666]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T01:56:43.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:43 smithi062 ceph-mon[30666]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:56:43.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:43 smithi062 ceph-mon[30666]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:56:44.010 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:44.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:43 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/943436400' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:56:44.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:43 smithi107 ceph-mon[35463]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T01:56:44.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:43 smithi107 ceph-mon[35463]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:56:44.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:43 smithi107 ceph-mon[35463]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:56:44.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:43 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/943436400' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:56:44.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:43 smithi077 ceph-mon[35095]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T01:56:44.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:43 smithi077 ceph-mon[35095]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:56:44.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:43 smithi077 ceph-mon[35095]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:56:44.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.557+0000 7f7323200640 1 -- 172.21.15.62:0/3161350482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7324102370 msgr2=0x7f732410e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.557+0000 7f7323200640 1 --2- 172.21.15.62:0/3161350482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7324102370 0x7f732410e8a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f731c009930 tx=0x7f731c02a440 comp rx=0 tx=0).stop 2024-09-12T01:56:44.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.557+0000 7f7323200640 1 -- 172.21.15.62:0/3161350482 shutdown_connections 2024-09-12T01:56:44.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.557+0000 7f7323200640 1 --2- 172.21.15.62:0/3161350482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7324102370 0x7f732410e8a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.557+0000 7f7323200640 1 --2- 172.21.15.62:0/3161350482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73241019d0 0x7f7324101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.557+0000 7f7323200640 1 --2- 172.21.15.62:0/3161350482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73241079d0 0x7f7324107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.557+0000 7f7323200640 1 -- 172.21.15.62:0/3161350482 >> 172.21.15.62:0/3161350482 conn(0x7f73240fd710 msgr2=0x7f73240ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:44.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.557+0000 7f7323200640 1 -- 172.21.15.62:0/3161350482 shutdown_connections 2024-09-12T01:56:44.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.557+0000 7f7323200640 1 -- 172.21.15.62:0/3161350482 wait complete. 2024-09-12T01:56:44.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7323200640 1 Processor -- start 2024-09-12T01:56:44.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7323200640 1 -- start start 2024-09-12T01:56:44.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7323200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73241019d0 0x7f732419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7323200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7324102370 0x7f732419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7323200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73241079d0 0x7f732419ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7323200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7324111e20 con 0x7f73241019d0 2024-09-12T01:56:44.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7323200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7324111ca0 con 0x7f73241079d0 2024-09-12T01:56:44.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7323200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7324111fa0 con 0x7f7324102370 2024-09-12T01:56:44.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7321e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73241019d0 0x7f732419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7319400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7324102370 0x7f732419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7319400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7324102370 0x7f732419a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:40740/0 (socket says 172.21.15.62:40740) 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.559+0000 7f7319400640 1 -- 172.21.15.62:0/4175908836 learned_addr learned my addr 172.21.15.62:0/4175908836 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.560+0000 7f7322800640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73241079d0 0x7f732419ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.560+0000 7f7319400640 1 -- 172.21.15.62:0/4175908836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73241079d0 msgr2=0x7f732419ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.560+0000 7f7319400640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73241079d0 0x7f732419ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.560+0000 7f7319400640 1 -- 172.21.15.62:0/4175908836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73241019d0 msgr2=0x7f732419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.560+0000 7f7319400640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73241019d0 0x7f732419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.560+0000 7f7319400640 1 -- 172.21.15.62:0/4175908836 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732419f360 con 0x7f7324102370 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.560+0000 7f7321e00640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73241019d0 0x7f732419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.560+0000 7f7319400640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7324102370 0x7f732419a8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f730c00d770 tx=0x7f730c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.561+0000 7f731b400640 1 -- 172.21.15.62:0/4175908836 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c017070 con 0x7f7324102370 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.561+0000 7f7323200640 1 -- 172.21.15.62:0/4175908836 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732419f650 con 0x7f7324102370 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.561+0000 7f731b400640 1 -- 172.21.15.62:0/4175908836 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f730c005500 con 0x7f7324102370 2024-09-12T01:56:44.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.561+0000 7f731b400640 1 -- 172.21.15.62:0/4175908836 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c004e00 con 0x7f7324102370 2024-09-12T01:56:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.561+0000 7f7323200640 1 -- 172.21.15.62:0/4175908836 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73241a6f30 con 0x7f7324102370 2024-09-12T01:56:44.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.562+0000 7f7323200640 1 -- 172.21.15.62:0/4175908836 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7324101e30 con 0x7f7324102370 2024-09-12T01:56:44.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.564+0000 7f731b400640 1 -- 172.21.15.62:0/4175908836 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f730c004fa0 con 0x7f7324102370 2024-09-12T01:56:44.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.565+0000 7f731b400640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f73080a2c00 0x7f73080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.565+0000 7f731b400640 1 -- 172.21.15.62:0/4175908836 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f730c0ce8e0 con 0x7f7324102370 2024-09-12T01:56:44.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.565+0000 7f7321e00640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f73080a2c00 0x7f73080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.566+0000 7f7321e00640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f73080a2c00 0x7f73080a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f731400f5d0 tx=0x7f73140075b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.567+0000 7f731b400640 1 -- 172.21.15.62:0/4175908836 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f730c09b320 con 0x7f7324102370 2024-09-12T01:56:44.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.761+0000 7f7323200640 1 -- 172.21.15.62:0/4175908836 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f732419b710 con 0x7f7324102370 2024-09-12T01:56:44.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.814+0000 7f731b400640 1 -- 172.21.15.62:0/4175908836 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7f732419b710 con 0x7f7324102370 2024-09-12T01:56:44.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 -- 172.21.15.62:0/4175908836 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f73080a2c00 msgr2=0x7f73080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f73080a2c00 0x7f73080a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f731400f5d0 tx=0x7f73140075b0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 -- 172.21.15.62:0/4175908836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7324102370 msgr2=0x7f732419a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7324102370 0x7f732419a8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f730c00d770 tx=0x7f730c00dc30 comp rx=0 tx=0).stop 2024-09-12T01:56:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 -- 172.21.15.62:0/4175908836 shutdown_connections 2024-09-12T01:56:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f73080a2c00 0x7f73080a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73241079d0 0x7f732419ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7324102370 0x7f732419a8f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 --2- 172.21.15.62:0/4175908836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73241019d0 0x7f732419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 -- 172.21.15.62:0/4175908836 >> 172.21.15.62:0/4175908836 conn(0x7f73240fd710 msgr2=0x7f732410d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 -- 172.21.15.62:0/4175908836 shutdown_connections 2024-09-12T01:56:44.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:44.817+0000 7f7323200640 1 -- 172.21.15.62:0/4175908836 wait complete. 2024-09-12T01:56:45.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:44 smithi062 ceph-mon[30666]: pgmap v295: 97 pgs: 11 creating+peering, 20 unknown, 66 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:45.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:44 smithi062 ceph-mon[30666]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:56:45.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:44 smithi062 ceph-mon[30666]: Cluster is now healthy 2024-09-12T01:56:45.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:44 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] up:active 2024-09-12T01:56:45.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:44 smithi062 ceph-mon[30666]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:56:45.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:44 smithi062 ceph-mon[30666]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:56:45.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:44 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4175908836' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T01:56:45.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:44 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T01:56:45.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:44 smithi107 ceph-mon[35463]: pgmap v295: 97 pgs: 11 creating+peering, 20 unknown, 66 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:45.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:44 smithi107 ceph-mon[35463]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:56:45.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:44 smithi107 ceph-mon[35463]: Cluster is now healthy 2024-09-12T01:56:45.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:44 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] up:active 2024-09-12T01:56:45.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:44 smithi107 ceph-mon[35463]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:56:45.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:44 smithi107 ceph-mon[35463]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:56:45.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:44 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4175908836' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T01:56:45.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:44 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T01:56:45.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:44 smithi077 ceph-mon[35095]: pgmap v295: 97 pgs: 11 creating+peering, 20 unknown, 66 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:45.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:44 smithi077 ceph-mon[35095]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:56:45.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:44 smithi077 ceph-mon[35095]: Cluster is now healthy 2024-09-12T01:56:45.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:44 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] up:active 2024-09-12T01:56:45.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:44 smithi077 ceph-mon[35095]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:56:45.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:44 smithi077 ceph-mon[35095]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:56:45.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:44 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4175908836' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T01:56:45.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:44 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T01:56:45.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:56:46.072 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:46.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:45 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T01:56:46.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:45 smithi062 ceph-mon[30666]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:56:46.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:45 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T01:56:46.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:45 smithi107 ceph-mon[35463]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:56:46.214 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 01:56:45 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b[65305]: 2024-09-12T01:56:45.927+0000 7f5d20ff7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:56:46.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:45 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T01:56:46.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:45 smithi077 ceph-mon[35095]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:56:46.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.746+0000 7f44eda00640 1 -- 172.21.15.62:0/60135004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44e8102790 msgr2=0x7f44e81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.746+0000 7f44eda00640 1 --2- 172.21.15.62:0/60135004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44e8102790 0x7f44e81067e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009900 tx=0x7f44d402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.746+0000 7f44eda00640 1 -- 172.21.15.62:0/60135004 shutdown_connections 2024-09-12T01:56:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.746+0000 7f44eda00640 1 --2- 172.21.15.62:0/60135004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44e8106f10 0x7f44e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.746+0000 7f44eda00640 1 --2- 172.21.15.62:0/60135004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44e8102790 0x7f44e81067e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.746+0000 7f44eda00640 1 --2- 172.21.15.62:0/60135004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e8101de0 0x7f44e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.746+0000 7f44eda00640 1 -- 172.21.15.62:0/60135004 >> 172.21.15.62:0/60135004 conn(0x7f44e80fd8e0 msgr2=0x7f44e80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.746+0000 7f44eda00640 1 -- 172.21.15.62:0/60135004 shutdown_connections 2024-09-12T01:56:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.746+0000 7f44eda00640 1 -- 172.21.15.62:0/60135004 wait complete. 2024-09-12T01:56:46.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.747+0000 7f44eda00640 1 Processor -- start 2024-09-12T01:56:46.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.747+0000 7f44eda00640 1 -- start start 2024-09-12T01:56:46.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44eda00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e8101de0 0x7f44e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44eda00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44e8102790 0x7f44e8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44eda00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44e8106f10 0x7f44e8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44eda00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8111f30 con 0x7f44e8106f10 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44eda00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f44e8111db0 con 0x7f44e8101de0 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44eda00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f44e81120b0 con 0x7f44e8102790 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44e6a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e8101de0 0x7f44e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44e6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44e8102790 0x7f44e8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44e6000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44e8102790 0x7f44e8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:40750/0 (socket says 172.21.15.62:40750) 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44e6000640 1 -- 172.21.15.62:0/584484315 learned_addr learned my addr 172.21.15.62:0/584484315 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44e6a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e8101de0 0x7f44e80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:48412/0 (socket says 172.21.15.62:48412) 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.748+0000 7f44e7400640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44e8106f10 0x7f44e8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:46.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.749+0000 7f44e6a00640 1 -- 172.21.15.62:0/584484315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44e8102790 msgr2=0x7f44e8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:46.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.749+0000 7f44e6a00640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44e8102790 0x7f44e8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:46.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.749+0000 7f44e6a00640 1 -- 172.21.15.62:0/584484315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44e8106f10 msgr2=0x7f44e8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:46.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.749+0000 7f44e6a00640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44e8106f10 0x7f44e8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:46.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.749+0000 7f44e6a00640 1 -- 172.21.15.62:0/584484315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e81a6930 con 0x7f44e8101de0 2024-09-12T01:56:46.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.749+0000 7f44e6a00640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e8101de0 0x7f44e80744f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f44d800e9f0 tx=0x7f44d800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:46.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.749+0000 7f44df400640 1 -- 172.21.15.62:0/584484315 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d800cd80 con 0x7f44e8101de0 2024-09-12T01:56:46.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.749+0000 7f44df400640 1 -- 172.21.15.62:0/584484315 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44d80035f0 con 0x7f44e8101de0 2024-09-12T01:56:46.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.749+0000 7f44df400640 1 -- 172.21.15.62:0/584484315 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8010690 con 0x7f44e8101de0 2024-09-12T01:56:46.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.749+0000 7f44eda00640 1 -- 172.21.15.62:0/584484315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e81a6c20 con 0x7f44e8101de0 2024-09-12T01:56:46.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.750+0000 7f44eda00640 1 -- 172.21.15.62:0/584484315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e81a7160 con 0x7f44e8101de0 2024-09-12T01:56:46.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.751+0000 7f44eda00640 1 -- 172.21.15.62:0/584484315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e81021c0 con 0x7f44e8101de0 2024-09-12T01:56:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.753+0000 7f44df400640 1 -- 172.21.15.62:0/584484315 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f44d8003b30 con 0x7f44e8101de0 2024-09-12T01:56:46.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.754+0000 7f44df400640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f44cc0a2b80 0x7f44cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:46.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.754+0000 7f44df400640 1 -- 172.21.15.62:0/584484315 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f44d80cf3b0 con 0x7f44e8101de0 2024-09-12T01:56:46.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.754+0000 7f44e6000640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f44cc0a2b80 0x7f44cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:46.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.755+0000 7f44e6000640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f44cc0a2b80 0x7f44cc0a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44d4031550 tx=0x7f44d4005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:46.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.758+0000 7f44df400640 1 -- 172.21.15.62:0/584484315 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44d809c280 con 0x7f44e8101de0 2024-09-12T01:56:46.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:46.974+0000 7f44eda00640 1 -- 172.21.15.62:0/584484315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f44e810a120 con 0x7f44e8101de0 2024-09-12T01:56:46.975 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:46 smithi062 ceph-mon[30666]: pgmap v297: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-09-12T01:56:47.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:46 smithi107 ceph-mon[35463]: pgmap v297: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-09-12T01:56:47.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:46 smithi077 ceph-mon[35095]: pgmap v297: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-09-12T01:56:48.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:47 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/584484315' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:56:48.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:47 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:56:48.168 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:47 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/584484315' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:56:48.168 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:47 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:56:48.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:47 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/584484315' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:56:48.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:47 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:56:48.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.839+0000 7f44df400640 1 -- 172.21.15.62:0/584484315 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7f44d809bb80 con 0x7f44e8101de0 2024-09-12T01:56:48.842 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data_ec' created 2024-09-12T01:56:48.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.845+0000 7f44eda00640 1 -- 172.21.15.62:0/584484315 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f44cc0a2b80 msgr2=0x7f44cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:48.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.845+0000 7f44eda00640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f44cc0a2b80 0x7f44cc0a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44d4031550 tx=0x7f44d4005a20 comp rx=0 tx=0).stop 2024-09-12T01:56:48.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.845+0000 7f44eda00640 1 -- 172.21.15.62:0/584484315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e8101de0 msgr2=0x7f44e80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:48.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.845+0000 7f44eda00640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e8101de0 0x7f44e80744f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f44d800e9f0 tx=0x7f44d800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.845+0000 7f44eda00640 1 -- 172.21.15.62:0/584484315 shutdown_connections 2024-09-12T01:56:48.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.845+0000 7f44eda00640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f44cc0a2b80 0x7f44cc0a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.845+0000 7f44eda00640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44e8106f10 0x7f44e8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.845+0000 7f44eda00640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44e8102790 0x7f44e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.845+0000 7f44eda00640 1 --2- 172.21.15.62:0/584484315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44e8101de0 0x7f44e80744f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:48.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.845+0000 7f44eda00640 1 -- 172.21.15.62:0/584484315 >> 172.21.15.62:0/584484315 conn(0x7f44e80fd8e0 msgr2=0x7f44e80fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:48.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.846+0000 7f44eda00640 1 -- 172.21.15.62:0/584484315 shutdown_connections 2024-09-12T01:56:48.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:48.846+0000 7f44eda00640 1 -- 172.21.15.62:0/584484315 wait complete. 2024-09-12T01:56:49.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:48 smithi062 ceph-mon[30666]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T01:56:49.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:48 smithi062 ceph-mon[30666]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:56:49.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:48 smithi107 ceph-mon[35463]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T01:56:49.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:48 smithi107 ceph-mon[35463]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:56:49.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:48 smithi077 ceph-mon[35095]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T01:56:49.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:48 smithi077 ceph-mon[35095]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:56:49.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T01:56:50.010 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:50.149 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:49 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:56:50.150 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:49 smithi062 ceph-mon[30666]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T01:56:50.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:49 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:56:50.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:49 smithi107 ceph-mon[35463]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T01:56:50.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:49 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:56:50.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:49 smithi077 ceph-mon[35095]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T01:56:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.551+0000 7f958a400640 1 -- 172.21.15.62:0/3941641856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584108f60 msgr2=0x7f9584110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.551+0000 7f958a400640 1 --2- 172.21.15.62:0/3941641856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584108f60 0x7f9584110ae0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f957c009ca0 tx=0x7f957c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.551+0000 7f958a400640 1 -- 172.21.15.62:0/3941641856 shutdown_connections 2024-09-12T01:56:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.551+0000 7f958a400640 1 --2- 172.21.15.62:0/3941641856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584108f60 0x7f9584110ae0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.551+0000 7f958a400640 1 --2- 172.21.15.62:0/3941641856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95841047e0 0x7f9584108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.551+0000 7f958a400640 1 --2- 172.21.15.62:0/3941641856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9584103e30 0x7f9584104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.551+0000 7f958a400640 1 -- 172.21.15.62:0/3941641856 >> 172.21.15.62:0/3941641856 conn(0x7f95840ff8d0 msgr2=0x7f9584101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.551+0000 7f958a400640 1 -- 172.21.15.62:0/3941641856 shutdown_connections 2024-09-12T01:56:50.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.551+0000 7f958a400640 1 -- 172.21.15.62:0/3941641856 wait complete. 2024-09-12T01:56:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.552+0000 7f958a400640 1 Processor -- start 2024-09-12T01:56:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.552+0000 7f958a400640 1 -- start start 2024-09-12T01:56:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f958a400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584103e30 0x7f958419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f958a400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95841047e0 0x7f958419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f958a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9584108f60 0x7f958419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f958a400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9584113fc0 con 0x7f9584103e30 2024-09-12T01:56:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f958a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9584113e40 con 0x7f9584108f60 2024-09-12T01:56:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f958a400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9584114140 con 0x7f95841047e0 2024-09-12T01:56:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f9589000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584103e30 0x7f958419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f9589000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584103e30 0x7f958419a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37636/0 (socket says 172.21.15.62:37636) 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f9589000640 1 -- 172.21.15.62:0/2724405611 learned_addr learned my addr 172.21.15.62:0/2724405611 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f957be00640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95841047e0 0x7f958419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.553+0000 7f9589a00640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9584108f60 0x7f958419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f9589000640 1 -- 172.21.15.62:0/2724405611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95841047e0 msgr2=0x7f958419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f9589000640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95841047e0 0x7f958419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f9589000640 1 -- 172.21.15.62:0/2724405611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9584108f60 msgr2=0x7f958419ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f9589000640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9584108f60 0x7f958419ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f9589000640 1 -- 172.21.15.62:0/2724405611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958419f3b0 con 0x7f9584103e30 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f957be00640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95841047e0 0x7f958419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f9589000640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584103e30 0x7f958419a400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f957400e9f0 tx=0x7f957400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f9582000640 1 -- 172.21.15.62:0/2724405611 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957400cd80 con 0x7f9584103e30 2024-09-12T01:56:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f9582000640 1 -- 172.21.15.62:0/2724405611 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9574005500 con 0x7f9584103e30 2024-09-12T01:56:50.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f9582000640 1 -- 172.21.15.62:0/2724405611 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574010690 con 0x7f9584103e30 2024-09-12T01:56:50.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f958a400640 1 -- 172.21.15.62:0/2724405611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958419f6a0 con 0x7f9584103e30 2024-09-12T01:56:50.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.554+0000 7f958a400640 1 -- 172.21.15.62:0/2724405611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95841a6f80 con 0x7f9584103e30 2024-09-12T01:56:50.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.556+0000 7f958a400640 1 -- 172.21.15.62:0/2724405611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9584104210 con 0x7f9584103e30 2024-09-12T01:56:50.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.558+0000 7f9582000640 1 -- 172.21.15.62:0/2724405611 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f95740046c0 con 0x7f9584103e30 2024-09-12T01:56:50.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.559+0000 7f9582000640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95680a2c00 0x7f95680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.559+0000 7f9582000640 1 -- 172.21.15.62:0/2724405611 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7f95740cf820 con 0x7f9584103e30 2024-09-12T01:56:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.559+0000 7f957be00640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95680a2c00 0x7f95680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.560+0000 7f957be00640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95680a2c00 0x7f95680a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f958410a930 tx=0x7f956c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:50.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.562+0000 7f9582000640 1 -- 172.21.15.62:0/2724405611 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95740541b0 con 0x7f9584103e30 2024-09-12T01:56:50.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.749+0000 7f958a400640 1 -- 172.21.15.62:0/2724405611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f958419b760 con 0x7f9584103e30 2024-09-12T01:56:50.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.850+0000 7f9582000640 1 -- 172.21.15.62:0/2724405611 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v89) ==== 169+0+0 (secure 0 0 0) 0x7f957409c500 con 0x7f9584103e30 2024-09-12T01:56:50.852 INFO:teuthology.orchestra.run.smithi062.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T01:56:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.854+0000 7f958a400640 1 -- 172.21.15.62:0/2724405611 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95680a2c00 msgr2=0x7f95680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.854+0000 7f958a400640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95680a2c00 0x7f95680a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f958410a930 tx=0x7f956c005f90 comp rx=0 tx=0).stop 2024-09-12T01:56:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.854+0000 7f958a400640 1 -- 172.21.15.62:0/2724405611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584103e30 msgr2=0x7f958419a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.854+0000 7f958a400640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584103e30 0x7f958419a400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f957400e9f0 tx=0x7f957400edf0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.854+0000 7f958a400640 1 -- 172.21.15.62:0/2724405611 shutdown_connections 2024-09-12T01:56:50.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.854+0000 7f958a400640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95680a2c00 0x7f95680a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.854+0000 7f958a400640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9584108f60 0x7f958419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.854+0000 7f958a400640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95841047e0 0x7f958419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.854+0000 7f958a400640 1 --2- 172.21.15.62:0/2724405611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9584103e30 0x7f958419a400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.854+0000 7f958a400640 1 -- 172.21.15.62:0/2724405611 >> 172.21.15.62:0/2724405611 conn(0x7f95840ff8d0 msgr2=0x7f9584100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:50.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.855+0000 7f958a400640 1 -- 172.21.15.62:0/2724405611 shutdown_connections 2024-09-12T01:56:50.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:50.855+0000 7f958a400640 1 -- 172.21.15.62:0/2724405611 wait complete. 2024-09-12T01:56:51.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:50 smithi062 ceph-mon[30666]: pgmap v301: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T01:56:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:50 smithi062 ceph-mon[30666]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:56:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:50 smithi062 ceph-mon[30666]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T01:56:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:50 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2724405611' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T01:56:51.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:50 smithi107 ceph-mon[35463]: pgmap v301: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T01:56:51.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:50 smithi107 ceph-mon[35463]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:56:51.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:50 smithi107 ceph-mon[35463]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T01:56:51.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:50 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2724405611' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T01:56:51.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:50 smithi077 ceph-mon[35095]: pgmap v301: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T01:56:51.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:50 smithi077 ceph-mon[35095]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:56:51.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:50 smithi077 ceph-mon[35095]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T01:56:51.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:50 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2724405611' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T01:56:51.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T01:56:52.007 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:52.145 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:51 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2724405611' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T01:56:52.145 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:51 smithi062 ceph-mon[30666]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T01:56:52.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:51 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2724405611' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T01:56:52.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:51 smithi107 ceph-mon[35463]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T01:56:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:51 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2724405611' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T01:56:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:51 smithi077 ceph-mon[35095]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T01:56:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.530+0000 7ff235a00640 1 -- 172.21.15.62:0/2645415575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2301049a0 msgr2=0x7ff2301089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.530+0000 7ff235a00640 1 --2- 172.21.15.62:0/2645415575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2301049a0 0x7ff2301089f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009900 tx=0x7ff21c02a410 comp rx=0 tx=0).stop 2024-09-12T01:56:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.530+0000 7ff235a00640 1 -- 172.21.15.62:0/2645415575 shutdown_connections 2024-09-12T01:56:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.530+0000 7ff235a00640 1 --2- 172.21.15.62:0/2645415575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230109120 0x7ff230110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.530+0000 7ff235a00640 1 --2- 172.21.15.62:0/2645415575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2301049a0 0x7ff2301089f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.530+0000 7ff235a00640 1 --2- 172.21.15.62:0/2645415575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff230103ff0 0x7ff2301043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.530+0000 7ff235a00640 1 -- 172.21.15.62:0/2645415575 >> 172.21.15.62:0/2645415575 conn(0x7ff2300ffa90 msgr2=0x7ff230101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.530+0000 7ff235a00640 1 -- 172.21.15.62:0/2645415575 shutdown_connections 2024-09-12T01:56:52.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.530+0000 7ff235a00640 1 -- 172.21.15.62:0/2645415575 wait complete. 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.531+0000 7ff235a00640 1 Processor -- start 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.531+0000 7ff235a00640 1 -- start start 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff235a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff230103ff0 0x7ff23019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff235a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2301049a0 0x7ff23019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff235a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230109120 0x7ff23019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff235a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff230114190 con 0x7ff230103ff0 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff235a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff230114010 con 0x7ff2301049a0 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff235a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff230114310 con 0x7ff230109120 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff22ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff230103ff0 0x7ff23019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff22ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff230103ff0 0x7ff23019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57588/0 (socket says 172.21.15.62:57588) 2024-09-12T01:56:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff22ea00640 1 -- 172.21.15.62:0/1333196771 learned_addr learned my addr 172.21.15.62:0/1333196771 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff22e000640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2301049a0 0x7ff23019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff22f400640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230109120 0x7ff23019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff22ea00640 1 -- 172.21.15.62:0/1333196771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230109120 msgr2=0x7ff23019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.532+0000 7ff22ea00640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230109120 0x7ff23019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff22ea00640 1 -- 172.21.15.62:0/1333196771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2301049a0 msgr2=0x7ff23019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff22ea00640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2301049a0 0x7ff23019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff22ea00640 1 -- 172.21.15.62:0/1333196771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23019f5a0 con 0x7ff230103ff0 2024-09-12T01:56:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff22f400640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230109120 0x7ff23019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:52.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff22e000640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2301049a0 0x7ff23019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:52.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff22ea00640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff230103ff0 0x7ff23019a5f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff22000e9f0 tx=0x7ff22000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff227400640 1 -- 172.21.15.62:0/1333196771 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22000cd80 con 0x7ff230103ff0 2024-09-12T01:56:52.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff227400640 1 -- 172.21.15.62:0/1333196771 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff220010910 con 0x7ff230103ff0 2024-09-12T01:56:52.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff227400640 1 -- 172.21.15.62:0/1333196771 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220018990 con 0x7ff230103ff0 2024-09-12T01:56:52.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff235a00640 1 -- 172.21.15.62:0/1333196771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23019f890 con 0x7ff230103ff0 2024-09-12T01:56:52.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.533+0000 7ff235a00640 1 -- 172.21.15.62:0/1333196771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2301a7170 con 0x7ff230103ff0 2024-09-12T01:56:52.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.534+0000 7ff235a00640 1 -- 172.21.15.62:0/1333196771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2301043d0 con 0x7ff230103ff0 2024-09-12T01:56:52.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.536+0000 7ff227400640 1 -- 172.21.15.62:0/1333196771 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff220010ac0 con 0x7ff230103ff0 2024-09-12T01:56:52.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.538+0000 7ff227400640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff2140a2c00 0x7ff2140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:52.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.538+0000 7ff227400640 1 -- 172.21.15.62:0/1333196771 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8770+0+0 (secure 0 0 0) 0x7ff2200cfa00 con 0x7ff230103ff0 2024-09-12T01:56:52.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.538+0000 7ff22e000640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff2140a2c00 0x7ff2140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:52.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.539+0000 7ff22e000640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff2140a2c00 0x7ff2140a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff21c000c00 tx=0x7ff21c031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:52.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.540+0000 7ff227400640 1 -- 172.21.15.62:0/1333196771 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff22009c6e0 con 0x7ff230103ff0 2024-09-12T01:56:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.767+0000 7ff235a00640 1 -- 172.21.15.62:0/1333196771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ff2301a7370 con 0x7ff230103ff0 2024-09-12T01:56:52.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.868+0000 7ff227400640 1 -- 172.21.15.62:0/1333196771 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7ff22009bfe0 con 0x7ff230103ff0 2024-09-12T01:56:52.869 INFO:teuthology.orchestra.run.smithi062.stderr:added data pool 4 to fsmap 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 -- 172.21.15.62:0/1333196771 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff2140a2c00 msgr2=0x7ff2140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff2140a2c00 0x7ff2140a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff21c000c00 tx=0x7ff21c031510 comp rx=0 tx=0).stop 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 -- 172.21.15.62:0/1333196771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff230103ff0 msgr2=0x7ff23019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff230103ff0 0x7ff23019a5f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff22000e9f0 tx=0x7ff22000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 -- 172.21.15.62:0/1333196771 shutdown_connections 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff2140a2c00 0x7ff2140a50c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff230109120 0x7ff23019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2301049a0 0x7ff23019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 --2- 172.21.15.62:0/1333196771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff230103ff0 0x7ff23019a5f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 -- 172.21.15.62:0/1333196771 >> 172.21.15.62:0/1333196771 conn(0x7ff2300ffa90 msgr2=0x7ff230101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 -- 172.21.15.62:0/1333196771 shutdown_connections 2024-09-12T01:56:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:52.871+0000 7ff235a00640 1 -- 172.21.15.62:0/1333196771 wait complete. 2024-09-12T01:56:53.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:52 smithi062 ceph-mon[30666]: pgmap v304: 129 pgs: 15 creating+peering, 12 unknown, 102 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T01:56:53.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:52 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1333196771' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T01:56:53.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:52 smithi107 ceph-mon[35463]: pgmap v304: 129 pgs: 15 creating+peering, 12 unknown, 102 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T01:56:53.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:52 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1333196771' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T01:56:53.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:52 smithi077 ceph-mon[35095]: pgmap v304: 129 pgs: 15 creating+peering, 12 unknown, 102 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T01:56:53.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:52 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1333196771' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T01:56:53.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:54.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:53 smithi062 ceph-mon[30666]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T01:56:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:53 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1333196771' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T01:56:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:53 smithi062 ceph-mon[30666]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:56:54.132 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:54.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:53 smithi107 ceph-mon[35463]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T01:56:54.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:53 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1333196771' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T01:56:54.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:53 smithi107 ceph-mon[35463]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:56:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:53 smithi077 ceph-mon[35095]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T01:56:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:53 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1333196771' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T01:56:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:53 smithi077 ceph-mon[35095]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:56:54.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.656+0000 7f623aa00640 1 -- 172.21.15.62:0/559095508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6234103ff0 msgr2=0x7f62341043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.656+0000 7f623aa00640 1 --2- 172.21.15.62:0/559095508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6234103ff0 0x7f62341043d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6224009900 tx=0x7f622402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.656+0000 7f623aa00640 1 -- 172.21.15.62:0/559095508 shutdown_connections 2024-09-12T01:56:54.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.656+0000 7f623aa00640 1 --2- 172.21.15.62:0/559095508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6234109120 0x7f6234110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.656+0000 7f623aa00640 1 --2- 172.21.15.62:0/559095508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62341049a0 0x7f62341089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.656+0000 7f623aa00640 1 --2- 172.21.15.62:0/559095508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6234103ff0 0x7f62341043d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.656+0000 7f623aa00640 1 -- 172.21.15.62:0/559095508 >> 172.21.15.62:0/559095508 conn(0x7f62340ffa90 msgr2=0x7f6234101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:54.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.657+0000 7f623aa00640 1 -- 172.21.15.62:0/559095508 shutdown_connections 2024-09-12T01:56:54.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.657+0000 7f623aa00640 1 -- 172.21.15.62:0/559095508 wait complete. 2024-09-12T01:56:54.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.657+0000 7f623aa00640 1 Processor -- start 2024-09-12T01:56:54.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f623aa00640 1 -- start start 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f623aa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6234103ff0 0x7f623419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f623aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62341049a0 0x7f623419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f623aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6234109120 0x7f623419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f623aa00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6234114190 con 0x7f6234109120 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f623aa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6234114010 con 0x7f62341049a0 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f623aa00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6234114310 con 0x7f6234103ff0 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f6233e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6234103ff0 0x7f623419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f6233e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6234103ff0 0x7f623419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:38240/0 (socket says 172.21.15.62:38240) 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f6233e00640 1 -- 172.21.15.62:0/4185284860 learned_addr learned my addr 172.21.15.62:0/4185284860 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f6238a00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6234109120 0x7f623419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.658+0000 7f6233400640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62341049a0 0x7f623419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.659+0000 7f6233e00640 1 -- 172.21.15.62:0/4185284860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62341049a0 msgr2=0x7f623419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.659+0000 7f6233e00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62341049a0 0x7f623419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.659+0000 7f6233e00640 1 -- 172.21.15.62:0/4185284860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6234109120 msgr2=0x7f623419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.659+0000 7f6233e00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6234109120 0x7f623419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.659+0000 7f6233e00640 1 -- 172.21.15.62:0/4185284860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623419f640 con 0x7f6234103ff0 2024-09-12T01:56:54.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.659+0000 7f6233e00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6234103ff0 0x7f623419a690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6224004770 tx=0x7f6224003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:54.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.659+0000 7f6230c00640 1 -- 172.21.15.62:0/4185284860 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622403f070 con 0x7f6234103ff0 2024-09-12T01:56:54.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.659+0000 7f6230c00640 1 -- 172.21.15.62:0/4185284860 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6224031ca0 con 0x7f6234103ff0 2024-09-12T01:56:54.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.659+0000 7f623aa00640 1 -- 172.21.15.62:0/4185284860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623419f8d0 con 0x7f6234103ff0 2024-09-12T01:56:54.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.660+0000 7f6230c00640 1 -- 172.21.15.62:0/4185284860 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224035030 con 0x7f6234103ff0 2024-09-12T01:56:54.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.660+0000 7f623aa00640 1 -- 172.21.15.62:0/4185284860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62341a7210 con 0x7f6234103ff0 2024-09-12T01:56:54.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.661+0000 7f623aa00640 1 -- 172.21.15.62:0/4185284860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62341054d0 con 0x7f6234103ff0 2024-09-12T01:56:54.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.663+0000 7f6230c00640 1 -- 172.21.15.62:0/4185284860 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6224042070 con 0x7f6234103ff0 2024-09-12T01:56:54.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.664+0000 7f6230c00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f62180a2b80 0x7f62180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.664+0000 7f6230c00640 1 -- 172.21.15.62:0/4185284860 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f62240efe60 con 0x7f6234103ff0 2024-09-12T01:56:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.664+0000 7f6233400640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f62180a2b80 0x7f62180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.665+0000 7f6233400640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f62180a2b80 0x7f62180a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f62340fffb0 tx=0x7f6220005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:54.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.666+0000 7f6230c00640 1 -- 172.21.15.62:0/4185284860 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62240bc590 con 0x7f6234103ff0 2024-09-12T01:56:54.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.887+0000 7f623aa00640 1 -- 172.21.15.62:0/4185284860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f623410c300 con 0x7f6234103ff0 2024-09-12T01:56:54.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.888+0000 7f6230c00640 1 -- 172.21.15.62:0/4185284860 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11842 (secure 0 0 0) 0x7f62240c0890 con 0x7f6234103ff0 2024-09-12T01:56:54.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:54.889 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":17,"btime":"2024-09-12T01:56:52:858403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:41.854823+0000","modified":"2024-09-12T01:56:52.769348+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24530,"qdb_cluster":[24530]},"id":1}]} 2024-09-12T01:56:54.890 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 17 2024-09-12T01:56:54.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 -- 172.21.15.62:0/4185284860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f62180a2b80 msgr2=0x7f62180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f62180a2b80 0x7f62180a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f62340fffb0 tx=0x7f6220005f90 comp rx=0 tx=0).stop 2024-09-12T01:56:54.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 -- 172.21.15.62:0/4185284860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6234103ff0 msgr2=0x7f623419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6234103ff0 0x7f623419a690 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6224004770 tx=0x7f6224003c10 comp rx=0 tx=0).stop 2024-09-12T01:56:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 -- 172.21.15.62:0/4185284860 shutdown_connections 2024-09-12T01:56:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f62180a2b80 0x7f62180a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6234109120 0x7f623419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62341049a0 0x7f623419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 --2- 172.21.15.62:0/4185284860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6234103ff0 0x7f623419a690 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 -- 172.21.15.62:0/4185284860 >> 172.21.15.62:0/4185284860 conn(0x7f62340ffa90 msgr2=0x7f6234100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 -- 172.21.15.62:0/4185284860 shutdown_connections 2024-09-12T01:56:54.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:54.891+0000 7f623aa00640 1 -- 172.21.15.62:0/4185284860 wait complete. 2024-09-12T01:56:55.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:54 smithi107 ceph-mon[35463]: pgmap v306: 129 pgs: 15 creating+peering, 4 unknown, 110 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T01:56:55.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:54 smithi107 ceph-mon[35463]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T01:56:55.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:54 smithi107 ceph-mon[35463]: Cluster is now healthy 2024-09-12T01:56:55.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:54 smithi077 ceph-mon[35095]: pgmap v306: 129 pgs: 15 creating+peering, 4 unknown, 110 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T01:56:55.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:54 smithi077 ceph-mon[35095]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T01:56:55.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:54 smithi077 ceph-mon[35095]: Cluster is now healthy 2024-09-12T01:56:55.288 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:54 smithi062 ceph-mon[30666]: pgmap v306: 129 pgs: 15 creating+peering, 4 unknown, 110 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T01:56:55.288 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:54 smithi062 ceph-mon[30666]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T01:56:55.288 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:54 smithi062 ceph-mon[30666]: Cluster is now healthy 2024-09-12T01:56:55.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:56:56.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:55 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4185284860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:56.125 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:56.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:55 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4185284860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:56.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:55 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4185284860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.657+0000 7fd458a00640 1 -- 172.21.15.62:0/2248710824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4541047e0 msgr2=0x7fd454108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.657+0000 7fd458a00640 1 --2- 172.21.15.62:0/2248710824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4541047e0 0x7fd454108830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009900 tx=0x7fd43c02a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.658+0000 7fd458a00640 1 -- 172.21.15.62:0/2248710824 shutdown_connections 2024-09-12T01:56:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.658+0000 7fd458a00640 1 --2- 172.21.15.62:0/2248710824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd454108f60 0x7fd454110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.658+0000 7fd458a00640 1 --2- 172.21.15.62:0/2248710824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4541047e0 0x7fd454108830 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.658+0000 7fd458a00640 1 --2- 172.21.15.62:0/2248710824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd454103e30 0x7fd454104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.658+0000 7fd458a00640 1 -- 172.21.15.62:0/2248710824 >> 172.21.15.62:0/2248710824 conn(0x7fd4540ff8d0 msgr2=0x7fd454101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.658+0000 7fd458a00640 1 -- 172.21.15.62:0/2248710824 shutdown_connections 2024-09-12T01:56:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.658+0000 7fd458a00640 1 -- 172.21.15.62:0/2248710824 wait complete. 2024-09-12T01:56:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd458a00640 1 Processor -- start 2024-09-12T01:56:56.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd458a00640 1 -- start start 2024-09-12T01:56:56.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd458a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd454103e30 0x7fd45419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd458a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4541047e0 0x7fd45419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd458a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd454108f60 0x7fd45419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd458a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd454113f80 con 0x7fd4541047e0 2024-09-12T01:56:56.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd458a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd454113e00 con 0x7fd454108f60 2024-09-12T01:56:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd458a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd454114100 con 0x7fd454103e30 2024-09-12T01:56:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd449e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4541047e0 0x7fd45419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd449e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4541047e0 0x7fd45419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57618/0 (socket says 172.21.15.62:57618) 2024-09-12T01:56:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd449e00640 1 -- 172.21.15.62:0/2624213626 learned_addr learned my addr 172.21.15.62:0/2624213626 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.659+0000 7fd452800640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd454103e30 0x7fd45419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.660+0000 7fd453200640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd454108f60 0x7fd45419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.660+0000 7fd449e00640 1 -- 172.21.15.62:0/2624213626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd454103e30 msgr2=0x7fd45419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.660+0000 7fd449e00640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd454103e30 0x7fd45419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.660+0000 7fd449e00640 1 -- 172.21.15.62:0/2624213626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd454108f60 msgr2=0x7fd45419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.660+0000 7fd449e00640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd454108f60 0x7fd45419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.660+0000 7fd449e00640 1 -- 172.21.15.62:0/2624213626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45419f410 con 0x7fd4541047e0 2024-09-12T01:56:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.660+0000 7fd453200640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd454108f60 0x7fd45419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.660+0000 7fd449e00640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4541047e0 0x7fd45419a9a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd43c006010 tx=0x7fd43c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.660+0000 7fd44be00640 1 -- 172.21.15.62:0/2624213626 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c03f030 con 0x7fd4541047e0 2024-09-12T01:56:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.661+0000 7fd44be00640 1 -- 172.21.15.62:0/2624213626 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd43c004440 con 0x7fd4541047e0 2024-09-12T01:56:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.661+0000 7fd44be00640 1 -- 172.21.15.62:0/2624213626 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c035070 con 0x7fd4541047e0 2024-09-12T01:56:56.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.661+0000 7fd458a00640 1 -- 172.21.15.62:0/2624213626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45419f6a0 con 0x7fd4541047e0 2024-09-12T01:56:56.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.661+0000 7fd458a00640 1 -- 172.21.15.62:0/2624213626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4541a6fe0 con 0x7fd4541047e0 2024-09-12T01:56:56.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.662+0000 7fd458a00640 1 -- 172.21.15.62:0/2624213626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd454104210 con 0x7fd4541047e0 2024-09-12T01:56:56.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.664+0000 7fd44be00640 1 -- 172.21.15.62:0/2624213626 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd43c042030 con 0x7fd4541047e0 2024-09-12T01:56:56.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.665+0000 7fd44be00640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4380a2c00 0x7fd4380a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.665+0000 7fd44be00640 1 -- 172.21.15.62:0/2624213626 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fd43c0ef660 con 0x7fd4541047e0 2024-09-12T01:56:56.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.665+0000 7fd452800640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4380a2c00 0x7fd4380a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.666+0000 7fd452800640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4380a2c00 0x7fd4380a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd4440095f0 tx=0x7fd444005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:56.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.669+0000 7fd44be00640 1 -- 172.21.15.62:0/2624213626 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd43c0bc320 con 0x7fd4541047e0 2024-09-12T01:56:56.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.860+0000 7fd458a00640 1 -- 172.21.15.62:0/2624213626 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd45410c1a0 con 0x7fd4541047e0 2024-09-12T01:56:56.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.862+0000 7fd44be00640 1 -- 172.21.15.62:0/2624213626 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24198 (secure 0 0 0) 0x7fd43c0bbc20 con 0x7fd4541047e0 2024-09-12T01:56:56.863 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:56.863 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":90,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:56:52.769187+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:56.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.864+0000 7fd458a00640 1 -- 172.21.15.62:0/2624213626 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4380a2c00 msgr2=0x7fd4380a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.864+0000 7fd458a00640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4380a2c00 0x7fd4380a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd4440095f0 tx=0x7fd444005f90 comp rx=0 tx=0).stop 2024-09-12T01:56:56.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.864+0000 7fd458a00640 1 -- 172.21.15.62:0/2624213626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4541047e0 msgr2=0x7fd45419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.864+0000 7fd458a00640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4541047e0 0x7fd45419a9a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd43c006010 tx=0x7fd43c004040 comp rx=0 tx=0).stop 2024-09-12T01:56:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.864+0000 7fd458a00640 1 -- 172.21.15.62:0/2624213626 shutdown_connections 2024-09-12T01:56:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.864+0000 7fd458a00640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4380a2c00 0x7fd4380a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.864+0000 7fd458a00640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd454108f60 0x7fd45419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.864+0000 7fd458a00640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4541047e0 0x7fd45419a9a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.864+0000 7fd458a00640 1 --2- 172.21.15.62:0/2624213626 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd454103e30 0x7fd45419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.864+0000 7fd458a00640 1 -- 172.21.15.62:0/2624213626 >> 172.21.15.62:0/2624213626 conn(0x7fd4540ff8d0 msgr2=0x7fd454100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.865+0000 7fd458a00640 1 -- 172.21.15.62:0/2624213626 shutdown_connections 2024-09-12T01:56:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:56.865+0000 7fd458a00640 1 -- 172.21.15.62:0/2624213626 wait complete. 2024-09-12T01:56:57.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:56 smithi107 ceph-mon[35463]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T01:56:57.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:56 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2624213626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:57.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:56 smithi077 ceph-mon[35095]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T01:56:57.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:56 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2624213626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:57.248 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:56 smithi062 ceph-mon[30666]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-12T01:56:57.248 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:56 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2624213626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:57.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:56:58.054 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.636+0000 7fd9f5200640 1 -- 172.21.15.62:0/3255925534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f0074e30 msgr2=0x7fd9f010dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.636+0000 7fd9f5200640 1 --2- 172.21.15.62:0/3255925534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f0074e30 0x7fd9f010dd40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009900 tx=0x7fd9d802a480 comp rx=0 tx=0).stop 2024-09-12T01:56:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.636+0000 7fd9f5200640 1 -- 172.21.15.62:0/3255925534 shutdown_connections 2024-09-12T01:56:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.636+0000 7fd9f5200640 1 --2- 172.21.15.62:0/3255925534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f010e280 0x7fd9f0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.636+0000 7fd9f5200640 1 --2- 172.21.15.62:0/3255925534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f0074e30 0x7fd9f010dd40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.636+0000 7fd9f5200640 1 --2- 172.21.15.62:0/3255925534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0074510 0x7fd9f00748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.636+0000 7fd9f5200640 1 -- 172.21.15.62:0/3255925534 >> 172.21.15.62:0/3255925534 conn(0x7fd9f00fd6e0 msgr2=0x7fd9f00ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.636+0000 7fd9f5200640 1 -- 172.21.15.62:0/3255925534 shutdown_connections 2024-09-12T01:56:58.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.636+0000 7fd9f5200640 1 -- 172.21.15.62:0/3255925534 wait complete. 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.637+0000 7fd9f5200640 1 Processor -- start 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.637+0000 7fd9f5200640 1 -- start start 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.637+0000 7fd9f5200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f0074510 0x7fd9f019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.637+0000 7fd9f5200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0074e30 0x7fd9f019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.637+0000 7fd9f5200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f010e280 0x7fd9f019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.637+0000 7fd9f5200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f0113fb0 con 0x7fd9f010e280 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.637+0000 7fd9f5200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f0113e30 con 0x7fd9f0074510 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.637+0000 7fd9f5200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f0114130 con 0x7fd9f0074e30 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9ef400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f0074510 0x7fd9f019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9e6a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0074e30 0x7fd9f019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9ef400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f0074510 0x7fd9f019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:56862/0 (socket says 172.21.15.62:56862) 2024-09-12T01:56:58.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9ef400640 1 -- 172.21.15.62:0/1347489467 learned_addr learned my addr 172.21.15.62:0/1347489467 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:56:58.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9efe00640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f010e280 0x7fd9f019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9ef400640 1 -- 172.21.15.62:0/1347489467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0074e30 msgr2=0x7fd9f019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9ef400640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0074e30 0x7fd9f019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9ef400640 1 -- 172.21.15.62:0/1347489467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f010e280 msgr2=0x7fd9f019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9ef400640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f010e280 0x7fd9f019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9ef400640 1 -- 172.21.15.62:0/1347489467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f019f440 con 0x7fd9f0074510 2024-09-12T01:56:58.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.638+0000 7fd9ef400640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f0074510 0x7fd9f019a490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000d950 tx=0x7fd9e000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.639+0000 7fd9ecc00640 1 -- 172.21.15.62:0/1347489467 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0017030 con 0x7fd9f0074510 2024-09-12T01:56:58.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.639+0000 7fd9f5200640 1 -- 172.21.15.62:0/1347489467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f019f730 con 0x7fd9f0074510 2024-09-12T01:56:58.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.639+0000 7fd9ecc00640 1 -- 172.21.15.62:0/1347489467 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9e0004020 con 0x7fd9f0074510 2024-09-12T01:56:58.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.639+0000 7fd9ecc00640 1 -- 172.21.15.62:0/1347489467 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00047a0 con 0x7fd9f0074510 2024-09-12T01:56:58.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.639+0000 7fd9f5200640 1 -- 172.21.15.62:0/1347489467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f01a7010 con 0x7fd9f0074510 2024-09-12T01:56:58.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.640+0000 7fd9f5200640 1 -- 172.21.15.62:0/1347489467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f00748f0 con 0x7fd9f0074510 2024-09-12T01:56:58.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.642+0000 7fd9ecc00640 1 -- 172.21.15.62:0/1347489467 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd9e00041d0 con 0x7fd9f0074510 2024-09-12T01:56:58.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.643+0000 7fd9ecc00640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd9d40a2b80 0x7fd9d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.643+0000 7fd9ecc00640 1 -- 172.21.15.62:0/1347489467 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fd9e00ceee0 con 0x7fd9f0074510 2024-09-12T01:56:58.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.643+0000 7fd9e6a00640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd9d40a2b80 0x7fd9d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.644+0000 7fd9e6a00640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd9d40a2b80 0x7fd9d40a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009230 tx=0x7fd9d80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.646+0000 7fd9ecc00640 1 -- 172.21.15.62:0/1347489467 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd9e009bba0 con 0x7fd9f0074510 2024-09-12T01:56:58.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.832+0000 7fd9f5200640 1 -- 172.21.15.62:0/1347489467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9f019b7f0 con 0x7fd9f0074510 2024-09-12T01:56:58.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.834+0000 7fd9ecc00640 1 -- 172.21.15.62:0/1347489467 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24198 (secure 0 0 0) 0x7fd9e009b4a0 con 0x7fd9f0074510 2024-09-12T01:56:58.835 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:56:58.835 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":90,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:56:52.769187+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:58.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.836+0000 7fd9f5200640 1 -- 172.21.15.62:0/1347489467 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd9d40a2b80 msgr2=0x7fd9d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.836+0000 7fd9f5200640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd9d40a2b80 0x7fd9d40a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009230 tx=0x7fd9d80058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.837+0000 7fd9f5200640 1 -- 172.21.15.62:0/1347489467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f0074510 msgr2=0x7fd9f019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.837+0000 7fd9f5200640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f0074510 0x7fd9f019a490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000d950 tx=0x7fd9e000de10 comp rx=0 tx=0).stop 2024-09-12T01:56:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.837+0000 7fd9f5200640 1 -- 172.21.15.62:0/1347489467 shutdown_connections 2024-09-12T01:56:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.837+0000 7fd9f5200640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd9d40a2b80 0x7fd9d40a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.837+0000 7fd9f5200640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f010e280 0x7fd9f019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.837+0000 7fd9f5200640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9f0074e30 0x7fd9f019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.837+0000 7fd9f5200640 1 --2- 172.21.15.62:0/1347489467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f0074510 0x7fd9f019a490 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.837+0000 7fd9f5200640 1 -- 172.21.15.62:0/1347489467 >> 172.21.15.62:0/1347489467 conn(0x7fd9f00fd6e0 msgr2=0x7fd9f00fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.837+0000 7fd9f5200640 1 -- 172.21.15.62:0/1347489467 shutdown_connections 2024-09-12T01:56:58.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:56:58.837+0000 7fd9f5200640 1 -- 172.21.15.62:0/1347489467 wait complete. 2024-09-12T01:56:59.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:58 smithi062 ceph-mon[30666]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:59.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:56:58 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1347489467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:59.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:58 smithi107 ceph-mon[35463]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:59.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:56:58 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1347489467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:58 smithi077 ceph-mon[35095]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:59.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:56:58 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1347489467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:59.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:57:00.073 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:00.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.626+0000 7f547c600640 1 -- 172.21.15.62:0/3602110128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5474109120 msgr2=0x7f5474110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.626+0000 7f547c600640 1 --2- 172.21.15.62:0/3602110128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5474109120 0x7f5474110ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f546c009900 tx=0x7f546c02a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.626+0000 7f547c600640 1 -- 172.21.15.62:0/3602110128 shutdown_connections 2024-09-12T01:57:00.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.626+0000 7f547c600640 1 --2- 172.21.15.62:0/3602110128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5474109120 0x7f5474110ca0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.626+0000 7f547c600640 1 --2- 172.21.15.62:0/3602110128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54741049a0 0x7f54741089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.626+0000 7f547c600640 1 --2- 172.21.15.62:0/3602110128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5474103ff0 0x7f54741043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.626+0000 7f547c600640 1 -- 172.21.15.62:0/3602110128 >> 172.21.15.62:0/3602110128 conn(0x7f54740ffa90 msgr2=0x7f5474101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:00.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.626+0000 7f547c600640 1 -- 172.21.15.62:0/3602110128 shutdown_connections 2024-09-12T01:57:00.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.626+0000 7f547c600640 1 -- 172.21.15.62:0/3602110128 wait complete. 2024-09-12T01:57:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.627+0000 7f547c600640 1 Processor -- start 2024-09-12T01:57:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.627+0000 7f547c600640 1 -- start start 2024-09-12T01:57:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f547c600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5474103ff0 0x7f547419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f547c600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54741049a0 0x7f547419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f547c600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5474109120 0x7f547419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f547c600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f54741141a0 con 0x7f5474103ff0 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f547c600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5474114020 con 0x7f54741049a0 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f547c600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5474114320 con 0x7f5474109120 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f5479c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5474103ff0 0x7f547419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f5479c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5474103ff0 0x7f547419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57666/0 (socket says 172.21.15.62:57666) 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f5479c00640 1 -- 172.21.15.62:0/1154860521 learned_addr learned my addr 172.21.15.62:0/1154860521 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f5479200640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54741049a0 0x7f547419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.628+0000 7f547a600640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5474109120 0x7f547419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f5479c00640 1 -- 172.21.15.62:0/1154860521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5474109120 msgr2=0x7f547419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f5479c00640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5474109120 0x7f547419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f5479c00640 1 -- 172.21.15.62:0/1154860521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54741049a0 msgr2=0x7f547419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f5479c00640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54741049a0 0x7f547419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f5479c00640 1 -- 172.21.15.62:0/1154860521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547419f570 con 0x7f5474103ff0 2024-09-12T01:57:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f5479c00640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5474103ff0 0x7f547419a5c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f546800ea80 tx=0x7f546800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f5472000640 1 -- 172.21.15.62:0/1154860521 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546800ce40 con 0x7f5474103ff0 2024-09-12T01:57:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f5472000640 1 -- 172.21.15.62:0/1154860521 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5468005020 con 0x7f5474103ff0 2024-09-12T01:57:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f547c600640 1 -- 172.21.15.62:0/1154860521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547419f860 con 0x7f5474103ff0 2024-09-12T01:57:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f5472000640 1 -- 172.21.15.62:0/1154860521 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468011760 con 0x7f5474103ff0 2024-09-12T01:57:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.629+0000 7f547c600640 1 -- 172.21.15.62:0/1154860521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54741a7140 con 0x7f5474103ff0 2024-09-12T01:57:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.631+0000 7f547c600640 1 -- 172.21.15.62:0/1154860521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54741043d0 con 0x7f5474103ff0 2024-09-12T01:57:00.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.632+0000 7f5472000640 1 -- 172.21.15.62:0/1154860521 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f54680051d0 con 0x7f5474103ff0 2024-09-12T01:57:00.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.634+0000 7f5472000640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f545c0a2c00 0x7f545c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:00.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.635+0000 7f5472000640 1 -- 172.21.15.62:0/1154860521 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f54680cf830 con 0x7f5474103ff0 2024-09-12T01:57:00.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.635+0000 7f5479200640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f545c0a2c00 0x7f545c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:00.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.635+0000 7f5479200640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f545c0a2c00 0x7f545c0a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f547410aaf0 tx=0x7f546000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:00.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.639+0000 7f5472000640 1 -- 172.21.15.62:0/1154860521 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5468016030 con 0x7f5474103ff0 2024-09-12T01:57:00.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.863+0000 7f547c600640 1 -- 172.21.15.62:0/1154860521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f547419b920 con 0x7f5474103ff0 2024-09-12T01:57:00.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.864+0000 7f5472000640 1 -- 172.21.15.62:0/1154860521 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11842 (secure 0 0 0) 0x7f546809bea0 con 0x7f5474103ff0 2024-09-12T01:57:00.865 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:00.865 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":17,"btime":"2024-09-12T01:56:52:858403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:56:41.854823+0000","modified":"2024-09-12T01:56:52.769348+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24530,"qdb_cluster":[24530]},"id":1}]} 2024-09-12T01:57:00.865 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 17 2024-09-12T01:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 -- 172.21.15.62:0/1154860521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f545c0a2c00 msgr2=0x7f545c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f545c0a2c00 0x7f545c0a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f547410aaf0 tx=0x7f546000b410 comp rx=0 tx=0).stop 2024-09-12T01:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 -- 172.21.15.62:0/1154860521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5474103ff0 msgr2=0x7f547419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5474103ff0 0x7f547419a5c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f546800ea80 tx=0x7f546800ef40 comp rx=0 tx=0).stop 2024-09-12T01:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 -- 172.21.15.62:0/1154860521 shutdown_connections 2024-09-12T01:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f545c0a2c00 0x7f545c0a50c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5474109120 0x7f547419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54741049a0 0x7f547419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 --2- 172.21.15.62:0/1154860521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5474103ff0 0x7f547419a5c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 -- 172.21.15.62:0/1154860521 >> 172.21.15.62:0/1154860521 conn(0x7f54740ffa90 msgr2=0x7f54741005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 -- 172.21.15.62:0/1154860521 shutdown_connections 2024-09-12T01:57:00.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:00.867+0000 7f547c600640 1 -- 172.21.15.62:0/1154860521 wait complete. 2024-09-12T01:57:01.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:00 smithi107 ceph-mon[35463]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:01.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:00 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1154860521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:01.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:00 smithi077 ceph-mon[35095]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:01.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:00 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1154860521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:01.251 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:00 smithi062 ceph-mon[30666]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:01.251 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:00 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1154860521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:01.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:57:01.971 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:02.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.545+0000 7f0033200640 1 -- 172.21.15.62:0/4095909288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f002c1027a0 msgr2=0x7f002c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.545+0000 7f0033200640 1 --2- 172.21.15.62:0/4095909288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f002c1027a0 0x7f002c1067f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0014009900 tx=0x7f001402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.546+0000 7f0033200640 1 -- 172.21.15.62:0/4095909288 shutdown_connections 2024-09-12T01:57:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.546+0000 7f0033200640 1 --2- 172.21.15.62:0/4095909288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f002c106f20 0x7f002c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.546+0000 7f0033200640 1 --2- 172.21.15.62:0/4095909288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f002c1027a0 0x7f002c1067f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.546+0000 7f0033200640 1 --2- 172.21.15.62:0/4095909288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002c101df0 0x7f002c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.546+0000 7f0033200640 1 -- 172.21.15.62:0/4095909288 >> 172.21.15.62:0/4095909288 conn(0x7f002c0fd8b0 msgr2=0x7f002c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.546+0000 7f0033200640 1 -- 172.21.15.62:0/4095909288 shutdown_connections 2024-09-12T01:57:02.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.546+0000 7f0033200640 1 -- 172.21.15.62:0/4095909288 wait complete. 2024-09-12T01:57:02.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f0033200640 1 Processor -- start 2024-09-12T01:57:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f0033200640 1 -- start start 2024-09-12T01:57:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f0033200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f002c101df0 0x7f002c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f0033200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f002c1027a0 0x7f002c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f0033200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002c106f20 0x7f002c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f0033200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f002c111f80 con 0x7f002c1027a0 2024-09-12T01:57:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f0033200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f002c111e00 con 0x7f002c106f20 2024-09-12T01:57:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f0033200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f002c112100 con 0x7f002c101df0 2024-09-12T01:57:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f002be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f002c101df0 0x7f002c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f002be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f002c101df0 0x7f002c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:44418/0 (socket says 172.21.15.62:44418) 2024-09-12T01:57:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f002be00640 1 -- 172.21.15.62:0/4239246918 learned_addr learned my addr 172.21.15.62:0/4239246918 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:02.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.547+0000 7f0023400640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f002c1027a0 0x7f002c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:02.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f0031200640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002c106f20 0x7f002c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f002be00640 1 -- 172.21.15.62:0/4239246918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002c106f20 msgr2=0x7f002c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f002be00640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002c106f20 0x7f002c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f002be00640 1 -- 172.21.15.62:0/4239246918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f002c1027a0 msgr2=0x7f002c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f002be00640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f002c1027a0 0x7f002c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f002be00640 1 -- 172.21.15.62:0/4239246918 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c19f5f0 con 0x7f002c101df0 2024-09-12T01:57:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f002be00640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f002c101df0 0x7f002c19a640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f001c00e9f0 tx=0x7f001c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f0029600640 1 -- 172.21.15.62:0/4239246918 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c00cd80 con 0x7f002c101df0 2024-09-12T01:57:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f0033200640 1 -- 172.21.15.62:0/4239246918 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002c19f8e0 con 0x7f002c101df0 2024-09-12T01:57:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f0029600640 1 -- 172.21.15.62:0/4239246918 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f001c010910 con 0x7f002c101df0 2024-09-12T01:57:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.548+0000 7f0029600640 1 -- 172.21.15.62:0/4239246918 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c0188f0 con 0x7f002c101df0 2024-09-12T01:57:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.549+0000 7f0033200640 1 -- 172.21.15.62:0/4239246918 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f002c1a71c0 con 0x7f002c101df0 2024-09-12T01:57:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.550+0000 7f0033200640 1 -- 172.21.15.62:0/4239246918 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002c1021d0 con 0x7f002c101df0 2024-09-12T01:57:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.552+0000 7f0029600640 1 -- 172.21.15.62:0/4239246918 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f001c010ac0 con 0x7f002c101df0 2024-09-12T01:57:02.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.553+0000 7f0029600640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f00100a2b80 0x7f00100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.553+0000 7f0029600640 1 -- 172.21.15.62:0/4239246918 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f001c0cfa70 con 0x7f002c101df0 2024-09-12T01:57:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.553+0000 7f0023400640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f00100a2b80 0x7f00100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.554+0000 7f0023400640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f00100a2b80 0x7f00100a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0014009230 tx=0x7f00140058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.555+0000 7f0029600640 1 -- 172.21.15.62:0/4239246918 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f001c09c0e0 con 0x7f002c101df0 2024-09-12T01:57:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.739+0000 7f0033200640 1 -- 172.21.15.62:0/4239246918 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f002c1a73c0 con 0x7f002c101df0 2024-09-12T01:57:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.740+0000 7f0029600640 1 -- 172.21.15.62:0/4239246918 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24198 (secure 0 0 0) 0x7f001c0a03e0 con 0x7f002c101df0 2024-09-12T01:57:02.740 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:02.741 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":90,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:56:52.769187+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 -- 172.21.15.62:0/4239246918 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f00100a2b80 msgr2=0x7f00100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f00100a2b80 0x7f00100a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0014009230 tx=0x7f00140058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 -- 172.21.15.62:0/4239246918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f002c101df0 msgr2=0x7f002c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f002c101df0 0x7f002c19a640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f001c00e9f0 tx=0x7f001c00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 -- 172.21.15.62:0/4239246918 shutdown_connections 2024-09-12T01:57:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f00100a2b80 0x7f00100a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002c106f20 0x7f002c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f002c1027a0 0x7f002c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 --2- 172.21.15.62:0/4239246918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f002c101df0 0x7f002c19a640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 -- 172.21.15.62:0/4239246918 >> 172.21.15.62:0/4239246918 conn(0x7f002c0fd8b0 msgr2=0x7f002c0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 -- 172.21.15.62:0/4239246918 shutdown_connections 2024-09-12T01:57:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:02.744+0000 7f0033200640 1 -- 172.21.15.62:0/4239246918 wait complete. 2024-09-12T01:57:03.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:02 smithi062 ceph-mon[30666]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:03.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:02 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4239246918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:03.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:02 smithi107 ceph-mon[35463]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:03.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:02 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4239246918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:03.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:02 smithi077 ceph-mon[35095]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:03.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:02 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4239246918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:03.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:56:41.854823+0000', 'modified': '2024-09-12T01:56:52.769348+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24530}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24530': {'gid': 24530, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.77:6839/1365701824', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6838', 'nonce': 1365701824}, {'type': 'v1', 'addr': '172.21.15.77:6839', 'nonce': 1365701824}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24530, 'qdb_cluster': [24530]} 2024-09-12T01:57:03.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:57:03.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:57:04.001 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.555+0000 7f9a57200640 1 -- 172.21.15.62:0/2366453096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a500745c0 msgr2=0x7f9a500749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.555+0000 7f9a57200640 1 --2- 172.21.15.62:0/2366453096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a500745c0 0x7f9a500749a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a44009900 tx=0x7f9a4402a480 comp rx=0 tx=0).stop 2024-09-12T01:57:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.555+0000 7f9a57200640 1 -- 172.21.15.62:0/2366453096 shutdown_connections 2024-09-12T01:57:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.555+0000 7f9a57200640 1 --2- 172.21.15.62:0/2366453096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a5010e260 0x7f9a50110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.555+0000 7f9a57200640 1 --2- 172.21.15.62:0/2366453096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a50074ee0 0x7f9a5010dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.555+0000 7f9a57200640 1 --2- 172.21.15.62:0/2366453096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a500745c0 0x7f9a500749a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.555+0000 7f9a57200640 1 -- 172.21.15.62:0/2366453096 >> 172.21.15.62:0/2366453096 conn(0x7f9a500fd740 msgr2=0x7f9a500ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.555+0000 7f9a57200640 1 -- 172.21.15.62:0/2366453096 shutdown_connections 2024-09-12T01:57:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.555+0000 7f9a57200640 1 -- 172.21.15.62:0/2366453096 wait complete. 2024-09-12T01:57:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.556+0000 7f9a57200640 1 Processor -- start 2024-09-12T01:57:04.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.556+0000 7f9a57200640 1 -- start start 2024-09-12T01:57:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a57200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a500745c0 0x7f9a5019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a57200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a50074ee0 0x7f9a5019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a57200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a5010e260 0x7f9a5019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a57200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50113fb0 con 0x7f9a50074ee0 2024-09-12T01:57:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a57200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50113e30 con 0x7f9a500745c0 2024-09-12T01:57:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a57200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50114130 con 0x7f9a5010e260 2024-09-12T01:57:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a55400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a50074ee0 0x7f9a5019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a55400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a50074ee0 0x7f9a5019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33990/0 (socket says 172.21.15.62:33990) 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a55400640 1 -- 172.21.15.62:0/1612449593 learned_addr learned my addr 172.21.15.62:0/1612449593 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a56800640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a5010e260 0x7f9a5019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.557+0000 7f9a55e00640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a500745c0 0x7f9a5019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a55400640 1 -- 172.21.15.62:0/1612449593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a5010e260 msgr2=0x7f9a5019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a55400640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a5010e260 0x7f9a5019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a55400640 1 -- 172.21.15.62:0/1612449593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a500745c0 msgr2=0x7f9a5019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a55400640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a500745c0 0x7f9a5019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a55400640 1 -- 172.21.15.62:0/1612449593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5019f460 con 0x7f9a50074ee0 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a55400640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a50074ee0 0x7f9a5019a9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000e9f0 tx=0x7f9a4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a4aa00640 1 -- 172.21.15.62:0/1612449593 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000cd80 con 0x7f9a50074ee0 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a4aa00640 1 -- 172.21.15.62:0/1612449593 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a40005500 con 0x7f9a50074ee0 2024-09-12T01:57:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a57200640 1 -- 172.21.15.62:0/1612449593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5019f750 con 0x7f9a50074ee0 2024-09-12T01:57:04.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a4aa00640 1 -- 172.21.15.62:0/1612449593 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40010690 con 0x7f9a50074ee0 2024-09-12T01:57:04.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.558+0000 7f9a57200640 1 -- 172.21.15.62:0/1612449593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a501a7030 con 0x7f9a50074ee0 2024-09-12T01:57:04.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.561+0000 7f9a5b438740 1 Processor -- start 2024-09-12T01:57:04.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.561+0000 7f9a4aa00640 1 -- 172.21.15.62:0/1612449593 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9a400046c0 con 0x7f9a50074ee0 2024-09-12T01:57:04.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.562+0000 7f9a5b438740 1 -- start start 2024-09-12T01:57:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.562+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a6694a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.562+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66955180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.562+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a669556c0 0x560a66957ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.562+0000 7f9a5b438740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560a668b00b0 con 0x560a6694ae00 2024-09-12T01:57:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.562+0000 7f9a5b438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560a66857ab0 con 0x560a6694a4e0 2024-09-12T01:57:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.562+0000 7f9a5b438740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560a668ac070 con 0x560a669556c0 2024-09-12T01:57:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.562+0000 7f9a55e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66955180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a56800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a6694a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a55e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66955180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34002/0 (socket says 172.21.15.62:34002) 2024-09-12T01:57:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a55e00640 1 -- 172.21.15.62:0/3038749947 learned_addr learned my addr 172.21.15.62:0/3038749947 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a55400640 1 --2- 172.21.15.62:0/3038749947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a669556c0 0x560a66957ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a56800640 1 -- 172.21.15.62:0/3038749947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a669556c0 msgr2=0x560a66957ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a56800640 1 --2- 172.21.15.62:0/3038749947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a669556c0 0x560a66957ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a56800640 1 -- 172.21.15.62:0/3038749947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 msgr2=0x560a66955180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a56800640 1 --2- 172.21.15.62:0/3038749947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66955180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a56800640 1 -- 172.21.15.62:0/3038749947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a668644a0 con 0x560a6694a4e0 2024-09-12T01:57:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a56800640 1 --2- 172.21.15.62:0/3038749947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a6694a8c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c005fd0 tx=0x7f9a4c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a64a5e021fb37b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.563+0000 7f9a4aa00640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9a380a2c00 0x7f9a380a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.564+0000 7f9a4aa00640 1 -- 172.21.15.62:0/1612449593 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f9a400cf660 con 0x7f9a50074ee0 2024-09-12T01:57:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.564+0000 7f9a3f000640 1 -- 172.21.15.62:0/3038749947 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c004d20 con 0x560a6694a4e0 2024-09-12T01:57:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.564+0000 7f9a3f000640 1 -- 172.21.15.62:0/3038749947 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a4c004050 con 0x560a6694a4e0 2024-09-12T01:57:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.564+0000 7f9a3f000640 1 -- 172.21.15.62:0/3038749947 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c005280 con 0x560a6694a4e0 2024-09-12T01:57:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.564+0000 7f9a55e00640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9a380a2c00 0x7f9a380a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.564+0000 7f9a5b438740 1 -- 172.21.15.62:0/3038749947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 msgr2=0x560a6694a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.564+0000 7f9a55e00640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9a380a2c00 0x7f9a380a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9a440096c0 tx=0x7f9a440058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.564+0000 7f9a5b438740 1 --2- 172.21.15.62:0/3038749947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a6694a8c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c005fd0 tx=0x7f9a4c011810 comp rx=0 tx=0).stop 2024-09-12T01:57:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.565+0000 7f9a5b438740 1 -- 172.21.15.62:0/3038749947 shutdown_connections 2024-09-12T01:57:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.565+0000 7f9a5b438740 1 --2- 172.21.15.62:0/3038749947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a669556c0 0x560a66957ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.565+0000 7f9a5b438740 1 --2- 172.21.15.62:0/3038749947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66955180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.565+0000 7f9a5b438740 1 --2- 172.21.15.62:0/3038749947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a6694a8c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.565+0000 7f9a5b438740 1 -- 172.21.15.62:0/3038749947 >> 172.21.15.62:0/3038749947 conn(0x560a66946a70 msgr2=0x560a66946e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.565+0000 7f9a5b438740 1 -- 172.21.15.62:0/3038749947 shutdown_connections 2024-09-12T01:57:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.565+0000 7f9a5b438740 1 -- 172.21.15.62:0/3038749947 wait complete. 2024-09-12T01:57:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.565+0000 7f9a5b438740 1 -- start start 2024-09-12T01:57:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a5b438740 1 Processor -- start 2024-09-12T01:57:04.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a66952630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a6694ae00 0x560a66952b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a669556c0 0x560a669530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a5b438740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560a66958330 con 0x560a669556c0 2024-09-12T01:57:04.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a5b438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560a66838920 con 0x560a6694a4e0 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a5b438740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560a669584b0 con 0x560a6694ae00 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a5b438740 10 client.0 _ll_register_callbacks cb 0x560a6685c8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a55e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a66952630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a55400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a6694ae00 0x560a66952b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a55e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a66952630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:41880/0 (socket says 172.21.15.62:41880) 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.566+0000 7f9a55e00640 1 -- 172.21.15.62:0/2661684031 learned_addr learned my addr 172.21.15.62:0/2661684031 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.567+0000 7f9a56800640 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a669556c0 0x560a669530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.567+0000 7f9a55e00640 1 -- 172.21.15.62:0/2661684031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a6694ae00 msgr2=0x560a66952b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.567+0000 7f9a55e00640 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a6694ae00 0x560a66952b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.567+0000 7f9a55e00640 1 -- 172.21.15.62:0/2661684031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a669556c0 msgr2=0x560a669530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.567+0000 7f9a55e00640 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a669556c0 0x560a669530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.567+0000 7f9a55e00640 1 -- 172.21.15.62:0/2661684031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a666212b0 con 0x560a6694a4e0 2024-09-12T01:57:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.567+0000 7f9a55e00640 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a66952630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a44006010 tx=0x7f9a44009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd5ed33ac3841616 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.567+0000 7f9a33400640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.567+0000 7f9a33400640 1 -- 172.21.15.62:0/2661684031 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4404e070 con 0x560a6694a4e0 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.568+0000 7f9a5b438740 1 -- 172.21.15.62:0/2661684031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a4c004050 con 0x560a6694a4e0 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.568+0000 7f9a33400640 1 -- 172.21.15.62:0/2661684031 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f9a44003b80 con 0x560a6694a4e0 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.568+0000 7f9a33400640 1 -- 172.21.15.62:0/2661684031 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9a4405a050 con 0x560a6694a4e0 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.568+0000 7f9a5b438740 10 client.24623 fetch_fsmap learned FSMap version 17 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.568+0000 7f9a5b438740 1 -- 172.21.15.62:0/2661684031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560a669640b0 con 0x560a6694a4e0 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.568+0000 7f9a33400640 1 -- 172.21.15.62:0/2661684031 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a4c004050 con 0x560a6694a4e0 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.568+0000 7f9a33400640 1 -- 172.21.15.62:0/2661684031 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f9a4403d450 con 0x560a6694a4e0 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.568+0000 7f9a5b438740 10 client.24623 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.569+0000 7f9a5b438740 10 client.24623 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.569+0000 7f9a5b438740 20 client.24623 populate_metadata read hostname 'smithi062' 2024-09-12T01:57:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.569+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x560a66966650 0x560a66967ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.569+0000 7f9a5b438740 4 client.24623 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.569+0000 7f9a5b438740 1 -- 172.21.15.62:0/2661684031 --> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a668bd620 con 0x560a66966650 2024-09-12T01:57:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.569+0000 7f9a55400640 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x560a66966650 0x560a66967ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.569+0000 7f9a55400640 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x560a66966650 0x560a66967ac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99e24b8d4815a8cb server_cookie=7a5c10f07b49bcc6 in_seq=0 out_seq=0 2024-09-12T01:57:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.569+0000 7f9a33400640 10 client.24623 ms_handle_connect on v2:172.21.15.77:6838/1365701824 2024-09-12T01:57:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.570+0000 7f9a33400640 1 -- 172.21.15.62:0/2661684031 <== mds.0 v2:172.21.15.77:6838/1365701824 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a668bd620 con 0x560a66966650 2024-09-12T01:57:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.570+0000 7f9a33400640 10 client.24623 handle_command_reply: tid=0 2024-09-12T01:57:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.570+0000 7f9a5b438740 1 client.24623 shutdown 2024-09-12T01:57:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 1 -- 172.21.15.62:0/2661684031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 msgr2=0x560a66952630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a66952630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a44006010 tx=0x7f9a44009260 comp rx=0 tx=0).stop 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 1 -- 172.21.15.62:0/2661684031 shutdown_connections 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x560a66966650 0x560a66967ac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a669556c0 0x560a669530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a6694ae00 0x560a66952b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2661684031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694a4e0 0x560a66952630 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a33400640 0 client.24623 ms_handle_reset on v2:172.21.15.77:6838/1365701824 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 1 -- 172.21.15.62:0/2661684031 >> 172.21.15.62:0/2661684031 conn(0x560a66946a70 msgr2=0x560a66945bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 1 -- 172.21.15.62:0/2661684031 shutdown_connections 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 1 -- 172.21.15.62:0/2661684031 wait complete. 2024-09-12T01:57:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.571+0000 7f9a5b438740 20 client.24623 trim_cache size 0 max 16384 2024-09-12T01:57:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.589+0000 7f9a5b438740 1 Processor -- start 2024-09-12T01:57:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a5b438740 1 -- start start 2024-09-12T01:57:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a6694a4e0 0x560a6694cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66952b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a669556c0 0x560a669530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a5b438740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560a66965e00 con 0x560a6694ae00 2024-09-12T01:57:04.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a5b438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560a669664d0 con 0x560a669556c0 2024-09-12T01:57:04.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a5b438740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560a66966ba0 con 0x560a6694a4e0 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a55400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66952b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a55400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66952b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34022/0 (socket says 172.21.15.62:34022) 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a55400640 1 -- 172.21.15.62:0/3298304151 learned_addr learned my addr 172.21.15.62:0/3298304151 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a56800640 1 --2- 172.21.15.62:0/3298304151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a669556c0 0x560a669530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.590+0000 7f9a55e00640 1 --2- 172.21.15.62:0/3298304151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a6694a4e0 0x560a6694cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.591+0000 7f9a55400640 1 -- 172.21.15.62:0/3298304151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a6694a4e0 msgr2=0x560a6694cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.591+0000 7f9a55400640 1 --2- 172.21.15.62:0/3298304151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a6694a4e0 0x560a6694cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.591+0000 7f9a55400640 1 -- 172.21.15.62:0/3298304151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a669556c0 msgr2=0x560a669530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.591+0000 7f9a55400640 1 --2- 172.21.15.62:0/3298304151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a669556c0 0x560a669530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.591+0000 7f9a55400640 1 -- 172.21.15.62:0/3298304151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6694a310 con 0x560a6694ae00 2024-09-12T01:57:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.591+0000 7f9a55400640 1 --2- 172.21.15.62:0/3298304151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66952b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9a40098080 tx=0x7f9a400ccd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5b7881ed1bb844 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:04.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.591+0000 7f9a3e600640 1 -- 172.21.15.62:0/3298304151 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4009b9f0 con 0x560a6694ae00 2024-09-12T01:57:04.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.591+0000 7f9a3e600640 1 -- 172.21.15.62:0/3298304151 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a4009c320 con 0x560a6694ae00 2024-09-12T01:57:04.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.591+0000 7f9a3e600640 1 -- 172.21.15.62:0/3298304151 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4009b580 con 0x560a6694ae00 2024-09-12T01:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.592+0000 7f9a5b438740 1 -- 172.21.15.62:0/3298304151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 msgr2=0x560a66952b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.592+0000 7f9a5b438740 1 --2- 172.21.15.62:0/3298304151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66952b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9a40098080 tx=0x7f9a400ccd90 comp rx=0 tx=0).stop 2024-09-12T01:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.592+0000 7f9a5b438740 1 -- 172.21.15.62:0/3298304151 shutdown_connections 2024-09-12T01:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.592+0000 7f9a5b438740 1 --2- 172.21.15.62:0/3298304151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a669556c0 0x560a669530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.592+0000 7f9a5b438740 1 --2- 172.21.15.62:0/3298304151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694ae00 0x560a66952b80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.592+0000 7f9a5b438740 1 --2- 172.21.15.62:0/3298304151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a6694a4e0 0x560a6694cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.592+0000 7f9a5b438740 1 -- 172.21.15.62:0/3298304151 >> 172.21.15.62:0/3298304151 conn(0x560a66946a70 msgr2=0x560a6694d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.592+0000 7f9a5b438740 1 -- 172.21.15.62:0/3298304151 shutdown_connections 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.592+0000 7f9a5b438740 1 -- 172.21.15.62:0/3298304151 wait complete. 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.592+0000 7f9a5b438740 1 -- start start 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a5b438740 1 Processor -- start 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694a4e0 0x560a6696a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694ae00 0x560a6696a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a5b438740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a669556c0 0x560a6696e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a5b438740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560a66967940 con 0x560a6694a4e0 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a5b438740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560a66967270 con 0x560a6694ae00 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a5b438740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560a66968010 con 0x560a669556c0 2024-09-12T01:57:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a5b438740 10 client.0 _ll_register_callbacks cb 0x7f9a44031850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a55e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694a4e0 0x560a6696a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a55400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694ae00 0x560a6696a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a55400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694ae00 0x560a6696a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:41894/0 (socket says 172.21.15.62:41894) 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a55e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694a4e0 0x560a6696a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34034/0 (socket says 172.21.15.62:34034) 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.593+0000 7f9a55400640 1 -- 172.21.15.62:0/2485749494 learned_addr learned my addr 172.21.15.62:0/2485749494 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.594+0000 7f9a56800640 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a669556c0 0x560a6696e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.594+0000 7f9a55400640 1 -- 172.21.15.62:0/2485749494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a669556c0 msgr2=0x560a6696e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.594+0000 7f9a55400640 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a669556c0 0x560a6696e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.594+0000 7f9a55400640 1 -- 172.21.15.62:0/2485749494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694a4e0 msgr2=0x560a6696a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.594+0000 7f9a55400640 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694a4e0 0x560a6696a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.594+0000 7f9a55400640 1 -- 172.21.15.62:0/2485749494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a6696eed0 con 0x560a6694ae00 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.594+0000 7f9a55e00640 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694a4e0 0x560a6696a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.594+0000 7f9a55400640 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694ae00 0x560a6696a7c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c6a0 tx=0x7f9a40005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ae9b2a45df934e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.594+0000 7f9a33400640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-12T01:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.594+0000 7f9a33400640 1 -- 172.21.15.62:0/2485749494 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4009b760 con 0x560a6694ae00 2024-09-12T01:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a33400640 1 -- 172.21.15.62:0/2485749494 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f9a40098290 con 0x560a6694ae00 2024-09-12T01:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a5b438740 1 -- 172.21.15.62:0/2485749494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a4009c320 con 0x560a6694ae00 2024-09-12T01:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a33400640 1 -- 172.21.15.62:0/2485749494 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9a4009b9f0 con 0x560a6694ae00 2024-09-12T01:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a5b438740 10 client.24629 fetch_fsmap learned FSMap version 17 2024-09-12T01:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a5b438740 1 -- 172.21.15.62:0/2485749494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560a669d1620 con 0x560a6694ae00 2024-09-12T01:57:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a33400640 1 -- 172.21.15.62:0/2485749494 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a4009c320 con 0x560a6694ae00 2024-09-12T01:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a33400640 1 -- 172.21.15.62:0/2485749494 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f9a4009b070 con 0x560a6694ae00 2024-09-12T01:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a5b438740 10 client.24629 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T01:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a5b438740 10 client.24629 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a5b438740 20 client.24629 populate_metadata read hostname 'smithi062' 2024-09-12T01:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x560a669d5c60 0x560a669d4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a5b438740 4 client.24629 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.595+0000 7f9a5b438740 1 -- 172.21.15.62:0/2485749494 --> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] -- command(tid 0: {"prefix": "status"}) -- 0x560a668b7b30 con 0x560a669d5c60 2024-09-12T01:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.596+0000 7f9a55e00640 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x560a669d5c60 0x560a669d4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.596+0000 7f9a55e00640 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x560a669d5c60 0x560a669d4970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15f0b6e4052be210 server_cookie=be91c00c2b6ab9c8 in_seq=0 out_seq=0 2024-09-12T01:57:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.596+0000 7f9a33400640 10 client.24629 ms_handle_connect on v2:172.21.15.77:6838/1365701824 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.596+0000 7f9a33400640 1 -- 172.21.15.62:0/2485749494 <== mds.0 v2:172.21.15.77:6838/1365701824 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560a668b7b30 con 0x560a669d5c60 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.596+0000 7f9a33400640 10 client.24629 handle_command_reply: tid=0 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.596+0000 7f9a5b438740 1 client.24629 shutdown 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.596+0000 7f9a5b438740 1 -- 172.21.15.62:0/2485749494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694ae00 msgr2=0x560a6696a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.596+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694ae00 0x560a6696a7c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c6a0 tx=0x7f9a40005c70 comp rx=0 tx=0).stop 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a5b438740 1 -- 172.21.15.62:0/2485749494 shutdown_connections 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x560a669d5c60 0x560a669d4970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a669556c0 0x560a6696e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a6694ae00 0x560a6696a7c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a5b438740 1 --2- 172.21.15.62:0/2485749494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560a6694a4e0 0x560a6696a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a33400640 0 client.24629 ms_handle_reset on v2:172.21.15.77:6838/1365701824 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a5b438740 1 -- 172.21.15.62:0/2485749494 >> 172.21.15.62:0/2485749494 conn(0x560a66946a70 msgr2=0x560a66953e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a5b438740 1 -- 172.21.15.62:0/2485749494 shutdown_connections 2024-09-12T01:57:04.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a5b438740 1 -- 172.21.15.62:0/2485749494 wait complete. 2024-09-12T01:57:04.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a5b438740 20 client.24629 trim_cache size 0 max 16384 2024-09-12T01:57:04.601 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:57:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "f18ee350-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:57:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2024-09-12T01:57:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 24530, 2024-09-12T01:57:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2024-09-12T01:57:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2024-09-12T01:57:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2024-09-12T01:57:04.601 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 21.804757649999999, 2024-09-12T01:57:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 17, 2024-09-12T01:57:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 90, 2024-09-12T01:57:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 90, 2024-09-12T01:57:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 34.387271065999997 2024-09-12T01:57:04.602 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:57:04.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a57200640 1 -- 172.21.15.62:0/1612449593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9a380a2c00 msgr2=0x7f9a380a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a57200640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9a380a2c00 0x7f9a380a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9a440096c0 tx=0x7f9a440058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a57200640 1 -- 172.21.15.62:0/1612449593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a50074ee0 msgr2=0x7f9a5019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.597+0000 7f9a57200640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a50074ee0 0x7f9a5019a9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000e9f0 tx=0x7f9a4000edf0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.598+0000 7f9a57200640 1 -- 172.21.15.62:0/1612449593 shutdown_connections 2024-09-12T01:57:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.598+0000 7f9a57200640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9a380a2c00 0x7f9a380a50c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.598+0000 7f9a57200640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a5010e260 0x7f9a5019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.598+0000 7f9a57200640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a50074ee0 0x7f9a5019a9f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.598+0000 7f9a57200640 1 --2- 172.21.15.62:0/1612449593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a500745c0 0x7f9a5019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.598+0000 7f9a57200640 1 -- 172.21.15.62:0/1612449593 >> 172.21.15.62:0/1612449593 conn(0x7f9a500fd740 msgr2=0x7f9a500fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.598+0000 7f9a57200640 1 -- 172.21.15.62:0/1612449593 shutdown_connections 2024-09-12T01:57:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:04.598+0000 7f9a57200640 1 -- 172.21.15.62:0/1612449593 wait complete. 2024-09-12T01:57:05.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:04 smithi107 ceph-mon[35463]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:05.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:04 smithi077 ceph-mon[35095]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:05.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:04 smithi062 ceph-mon[30666]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:05.470 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:57:05.470 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:57:05.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T01:57:05.848 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:06.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.389+0000 7fea74200640 1 -- 172.21.15.62:0/2139551130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c103ff0 msgr2=0x7fea6c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.389+0000 7fea74200640 1 --2- 172.21.15.62:0/2139551130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c103ff0 0x7fea6c1043d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fea60009900 tx=0x7fea6002a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.389+0000 7fea74200640 1 -- 172.21.15.62:0/2139551130 shutdown_connections 2024-09-12T01:57:06.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.389+0000 7fea74200640 1 --2- 172.21.15.62:0/2139551130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea6c109120 0x7fea6c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.389+0000 7fea74200640 1 --2- 172.21.15.62:0/2139551130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea6c1049a0 0x7fea6c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.389+0000 7fea74200640 1 --2- 172.21.15.62:0/2139551130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c103ff0 0x7fea6c1043d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.389+0000 7fea74200640 1 -- 172.21.15.62:0/2139551130 >> 172.21.15.62:0/2139551130 conn(0x7fea6c0ffa90 msgr2=0x7fea6c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.389+0000 7fea74200640 1 -- 172.21.15.62:0/2139551130 shutdown_connections 2024-09-12T01:57:06.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.389+0000 7fea74200640 1 -- 172.21.15.62:0/2139551130 wait complete. 2024-09-12T01:57:06.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.390+0000 7fea74200640 1 Processor -- start 2024-09-12T01:57:06.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.390+0000 7fea74200640 1 -- start start 2024-09-12T01:57:06.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea74200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c103ff0 0x7fea6c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea74200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea6c1049a0 0x7fea6c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea74200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea6c109120 0x7fea6c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea74200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c114190 con 0x7fea6c103ff0 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea74200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c114010 con 0x7fea6c109120 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea74200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c114310 con 0x7fea6c1049a0 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea71800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c103ff0 0x7fea6c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea71800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c103ff0 0x7fea6c19a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34050/0 (socket says 172.21.15.62:34050) 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea71800640 1 -- 172.21.15.62:0/3012415962 learned_addr learned my addr 172.21.15.62:0/3012415962 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea70e00640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea6c1049a0 0x7fea6c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.391+0000 7fea72200640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea6c109120 0x7fea6c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea71800640 1 -- 172.21.15.62:0/3012415962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea6c1049a0 msgr2=0x7fea6c19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea71800640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea6c1049a0 0x7fea6c19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea71800640 1 -- 172.21.15.62:0/3012415962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea6c109120 msgr2=0x7fea6c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea71800640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea6c109120 0x7fea6c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea71800640 1 -- 172.21.15.62:0/3012415962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c19f640 con 0x7fea6c103ff0 2024-09-12T01:57:06.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea72200640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea6c109120 0x7fea6c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:06.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea71800640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c103ff0 0x7fea6c19a690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea60004770 tx=0x7fea60003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea6a000640 1 -- 172.21.15.62:0/3012415962 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6003f070 con 0x7fea6c103ff0 2024-09-12T01:57:06.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea6a000640 1 -- 172.21.15.62:0/3012415962 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea60031ca0 con 0x7fea6c103ff0 2024-09-12T01:57:06.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea6a000640 1 -- 172.21.15.62:0/3012415962 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60035030 con 0x7fea6c103ff0 2024-09-12T01:57:06.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea74200640 1 -- 172.21.15.62:0/3012415962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6c19f8d0 con 0x7fea6c103ff0 2024-09-12T01:57:06.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.392+0000 7fea74200640 1 -- 172.21.15.62:0/3012415962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea6c1a7210 con 0x7fea6c103ff0 2024-09-12T01:57:06.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.394+0000 7fea74200640 1 -- 172.21.15.62:0/3012415962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea6c1054d0 con 0x7fea6c103ff0 2024-09-12T01:57:06.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.395+0000 7fea6a000640 1 -- 172.21.15.62:0/3012415962 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fea60042070 con 0x7fea6c103ff0 2024-09-12T01:57:06.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.397+0000 7fea6a000640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fea540a2b80 0x7fea540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.397+0000 7fea6a000640 1 -- 172.21.15.62:0/3012415962 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fea600efa30 con 0x7fea6c103ff0 2024-09-12T01:57:06.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.397+0000 7fea70e00640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fea540a2b80 0x7fea540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.398+0000 7fea70e00640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fea540a2b80 0x7fea540a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0fffb0 tx=0x7fea58005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.402+0000 7fea6a000640 1 -- 172.21.15.62:0/3012415962 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea600bc6f0 con 0x7fea6c103ff0 2024-09-12T01:57:06.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.622+0000 7fea74200640 1 -- 172.21.15.62:0/3012415962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fea6c10c300 con 0x7fea6c103ff0 2024-09-12T01:57:06.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.623+0000 7fea6a000640 1 -- 172.21.15.62:0/3012415962 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fea600bbff0 con 0x7fea6c103ff0 2024-09-12T01:57:06.625 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T01:57:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 -- 172.21.15.62:0/3012415962 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fea540a2b80 msgr2=0x7fea540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fea540a2b80 0x7fea540a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0fffb0 tx=0x7fea58005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 -- 172.21.15.62:0/3012415962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c103ff0 msgr2=0x7fea6c19a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c103ff0 0x7fea6c19a690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea60004770 tx=0x7fea60003c10 comp rx=0 tx=0).stop 2024-09-12T01:57:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 -- 172.21.15.62:0/3012415962 shutdown_connections 2024-09-12T01:57:06.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fea540a2b80 0x7fea540a5040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea6c109120 0x7fea6c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea6c1049a0 0x7fea6c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 --2- 172.21.15.62:0/3012415962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6c103ff0 0x7fea6c19a690 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 -- 172.21.15.62:0/3012415962 >> 172.21.15.62:0/3012415962 conn(0x7fea6c0ffa90 msgr2=0x7fea6c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 -- 172.21.15.62:0/3012415962 shutdown_connections 2024-09-12T01:57:06.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:06.625+0000 7fea74200640 1 -- 172.21.15.62:0/3012415962 wait complete. 2024-09-12T01:57:07.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:06 smithi107 ceph-mon[35463]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:07.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:06 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3012415962' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:57:07.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:06 smithi077 ceph-mon[35095]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:07.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:06 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3012415962' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:57:07.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:06 smithi062 ceph-mon[30666]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:06 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3012415962' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:57:07.515 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:57:07.515 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:57:07.515 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2024-09-12T01:57:07.515 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T01:57:07.515 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:57:07.515 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:57:07.515 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:57:07.515 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:57:07.515 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T01:57:07.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:07.516 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2024-09-12T01:57:07.552 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:57:07.552 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:07.553 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:57:07.554 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:57:07.554 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:57:07.554 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42202sec preferred_lft 42202sec 2024-09-12T01:57:07.554 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link noprefixroute 2024-09-12T01:57:07.554 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:57:07.554 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:57:07.555 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:57:07.555 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-09-12T01:57:07.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:57:07.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2024-09-12T01:57:07.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2024-09-12T01:57:07.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:57:07.555 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-09-12T01:57:07.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:57:07.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:07.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:07.980 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:57:08.037 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-09-12T01:57:08.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:08.042 DEBUG:teuthology.orchestra.run.smithi062:> route 2024-09-12T01:57:08.091 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2024-09-12T01:57:08.091 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:57:08.091 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:57:08.091 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:57:08.092 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:57:08.092 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:57:08.092 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-09-12T01:57:08.092 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:57:08.092 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:57:08.092 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:57:08.092 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-09-12T01:57:08.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:57:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:08.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:08.680 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-09-12T01:57:08.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:08.716 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2024-09-12T01:57:08.792 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:57:08.792 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-09-12T01:57:08.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:57:08.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T01:57:08.793 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-09-12T01:57:08.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:57:08.929 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:08 smithi062 ceph-mon[30666]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:08.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:08.974 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T01:57:08.974 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:57:08.974 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-09-12T01:57:08.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T01:57:08.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:57:08.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T01:57:08.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T01:57:08.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T01:57:08.974 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-09-12T01:57:09.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:57:09.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:08 smithi107 ceph-mon[35463]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:09.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:09.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:08 smithi077 ceph-mon[35095]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:09.217 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:57:09.217 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-09-12T01:57:09.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2024-09-12T01:57:09.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:57:09.218 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-09-12T01:57:09.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:57:09.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:09.387 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T01:57:09.387 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:57:09.387 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:57:09.422 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T01:57:09.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:57:09.423 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:57:09.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2024-09-12T01:57:09.595 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T01:57:09.632 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2024-09-12T01:57:09.632 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2024-09-12T01:57:09.633 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2024-09-12T01:57:09.634 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/ce6ff69f9e2b9cc38825bff1d8372079f52fe04440fe5d468b7233a5666d4ec7/merged 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/032ebc818b3a51461b92e7bb8cace27ba1e0b3f12ea5f4eb83229b84253ca8ad/merged 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/0 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/d64cd37c81ec3a349125856438bebfe53e178852926c5d845ac7c9d56ea7be31/merged 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/ffb92293146db37a3bafd88d0df5f2f98ea817ea73f3a9039f10f8363f7f73d4/merged 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/954b96235497f5c0d7a71dc829b1afb10a1a2d6b3638b868cbc68e885a3ed890/merged 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/dfbf5515463ef747c9b044e1a101b491ffb3c8c5aadb6ec16130fdb8947cadaf/merged 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/cfced5dfbe75e298b0ffbb2090be4741ee8b8888249942d8d50ac1ff1fc23edf/merged 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/c232a18243a6e51b1265af0d22ae50b072cbfa6fceb4bc00f06f61ffe409915a/merged 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/57e3666b3ce81a88d8b2e5f4fb7e749e31ffeb57a222c390ee61320fdd5c2d68/merged 2024-09-12T01:57:09.635 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/90a6717368221dc9488bf38cf5d692b5f39e0cfdc15b44797fa3d68721de45a6/merged 2024-09-12T01:57:09.636 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2024-09-12T01:57:09.636 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:57:09.636 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:57:09.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:09.637 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2024-09-12T01:57:09.715 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T01:57:09.716 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T01:57:09.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2024-09-12T01:57:09.816 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T01:57:09.854 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2024-09-12T01:57:09.854 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2024-09-12T01:57:09.854 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2024-09-12T01:57:09.854 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2024-09-12T01:57:09.855 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay 2024-09-12T01:57:09.856 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/ce6ff69f9e2b9cc38825bff1d8372079f52fe04440fe5d468b7233a5666d4ec7/merged 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/032ebc818b3a51461b92e7bb8cace27ba1e0b3f12ea5f4eb83229b84253ca8ad/merged 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/0 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/d64cd37c81ec3a349125856438bebfe53e178852926c5d845ac7c9d56ea7be31/merged 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/ffb92293146db37a3bafd88d0df5f2f98ea817ea73f3a9039f10f8363f7f73d4/merged 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/954b96235497f5c0d7a71dc829b1afb10a1a2d6b3638b868cbc68e885a3ed890/merged 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/dfbf5515463ef747c9b044e1a101b491ffb3c8c5aadb6ec16130fdb8947cadaf/merged 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/cfced5dfbe75e298b0ffbb2090be4741ee8b8888249942d8d50ac1ff1fc23edf/merged 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/c232a18243a6e51b1265af0d22ae50b072cbfa6fceb4bc00f06f61ffe409915a/merged 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/57e3666b3ce81a88d8b2e5f4fb7e749e31ffeb57a222c390ee61320fdd5c2d68/merged 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/90a6717368221dc9488bf38cf5d692b5f39e0cfdc15b44797fa3d68721de45a6/merged 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2024-09-12T01:57:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:57:09.858 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:57:09.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:09.858 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2024-09-12T01:57:09.952 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:2024-09-12T01:57:09.952+0000 7f0b3283d480 -1 init, newargv = 0x56343608e400 newargc=15 2024-09-12T01:57:09.952 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[75279]: starting ceph client 2024-09-12T01:57:09.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[75279]: starting fuse 2024-09-12T01:57:11.034 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2024-09-12T01:57:11.099 DEBUG:teuthology.orchestra.run.smithi062:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T01:57:11.138 INFO:teuthology.orchestra.run.smithi062.stdout:/proc 2024-09-12T01:57:11.138 INFO:teuthology.orchestra.run.smithi062.stdout:/sys 2024-09-12T01:57:11.139 INFO:teuthology.orchestra.run.smithi062.stdout:/dev 2024-09-12T01:57:11.139 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/security 2024-09-12T01:57:11.140 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/shm 2024-09-12T01:57:11.140 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/pts 2024-09-12T01:57:11.141 INFO:teuthology.orchestra.run.smithi062.stdout:/run 2024-09-12T01:57:11.141 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/cgroup 2024-09-12T01:57:11.141 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/pstore 2024-09-12T01:57:11.142 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/bpf 2024-09-12T01:57:11.142 INFO:teuthology.orchestra.run.smithi062.stdout:/ 2024-09-12T01:57:11.142 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/selinux 2024-09-12T01:57:11.142 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/mqueue 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/dev/hugepages 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/debug 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/tracing 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/fs/fuse/connections 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/sys/kernel/config 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/1000 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/ceph 2024-09-12T01:57:11.143 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/ce6ff69f9e2b9cc38825bff1d8372079f52fe04440fe5d468b7233a5666d4ec7/merged 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/032ebc818b3a51461b92e7bb8cace27ba1e0b3f12ea5f4eb83229b84253ca8ad/merged 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/run/user/0 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/d64cd37c81ec3a349125856438bebfe53e178852926c5d845ac7c9d56ea7be31/merged 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/ffb92293146db37a3bafd88d0df5f2f98ea817ea73f3a9039f10f8363f7f73d4/merged 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/954b96235497f5c0d7a71dc829b1afb10a1a2d6b3638b868cbc68e885a3ed890/merged 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/dfbf5515463ef747c9b044e1a101b491ffb3c8c5aadb6ec16130fdb8947cadaf/merged 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/cfced5dfbe75e298b0ffbb2090be4741ee8b8888249942d8d50ac1ff1fc23edf/merged 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/c232a18243a6e51b1265af0d22ae50b072cbfa6fceb4bc00f06f61ffe409915a/merged 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/57e3666b3ce81a88d8b2e5f4fb7e749e31ffeb57a222c390ee61320fdd5c2d68/merged 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/var/lib/containers/storage/overlay/90a6717368221dc9488bf38cf5d692b5f39e0cfdc15b44797fa3d68721de45a6/merged 2024-09-12T01:57:11.144 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns 2024-09-12T01:57:11.145 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:57:11.145 INFO:teuthology.orchestra.run.smithi062.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:57:11.145 INFO:teuthology.orchestra.run.smithi062.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-12T01:57:11.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:11.146 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2024-09-12T01:57:11.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:10 smithi107 ceph-mon[35463]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:11.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:10 smithi077 ceph-mon[35095]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:11.223 INFO:teuthology.orchestra.run.smithi062.stdout:108 2024-09-12T01:57:11.224 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [108] 2024-09-12T01:57:11.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo stdin-killer -- python3 -c ' 2024-09-12T01:57:11.224 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2024-09-12T01:57:11.224 DEBUG:teuthology.orchestra.run.smithi062:> import re 2024-09-12T01:57:11.225 DEBUG:teuthology.orchestra.run.smithi062:> import os 2024-09-12T01:57:11.225 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2024-09-12T01:57:11.225 DEBUG:teuthology.orchestra.run.smithi062:> 2024-09-12T01:57:11.225 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2024-09-12T01:57:11.225 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T01:57:11.226 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2024-09-12T01:57:11.226 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T01:57:11.226 DEBUG:teuthology.orchestra.run.smithi062:> 2024-09-12T01:57:11.226 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2024-09-12T01:57:11.226 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2024-09-12T01:57:11.226 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2024-09-12T01:57:11.227 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2024-09-12T01:57:11.227 DEBUG:teuthology.orchestra.run.smithi062:> 2024-09-12T01:57:11.227 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2024-09-12T01:57:11.227 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T01:57:11.227 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T01:57:11.227 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T01:57:11.227 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2024-09-12T01:57:11.227 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2024-09-12T01:57:11.228 DEBUG:teuthology.orchestra.run.smithi062:> return f 2024-09-12T01:57:11.228 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T01:57:11.228 DEBUG:teuthology.orchestra.run.smithi062:> 2024-09-12T01:57:11.228 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.admin")) 2024-09-12T01:57:11.228 DEBUG:teuthology.orchestra.run.smithi062:> ' 2024-09-12T01:57:11.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:10 smithi062 ceph-mon[30666]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:11.389 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.admin.75279.asok 2024-09-12T01:57:11.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:11.403 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75279.asok 2024-09-12T01:57:11.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:11.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75279.asok status 2024-09-12T01:57:11.588 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:57:11.588 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": { 2024-09-12T01:57:11.588 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T01:57:11.588 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:57:11.588 INFO:teuthology.orchestra.run.smithi062.stdout: "entity_id": "admin", 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": "smithi062", 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "pid": "75279", 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "root": "/" 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_count": 0, 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_pinned_count": 0, 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 24641, 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2024-09-12T01:57:11.589 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 24641 2024-09-12T01:57:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:57:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2024-09-12T01:57:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T01:57:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:0", 2024-09-12T01:57:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 986390705 2024-09-12T01:57:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T01:57:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:57:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2024-09-12T01:57:11.590 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:0", 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 986390705 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.24641 172.21.15.62:0/986390705", 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "172.21.15.62:0/986390705", 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "inode_count": 1, 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_epoch": 17, 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch": 90, 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch_barrier": 0, 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklisted": false, 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs" 2024-09-12T01:57:11.591 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:57:11.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:11.601 DEBUG:teuthology.orchestra.run.smithi062:> stat --file-system '--printf=%T 2024-09-12T01:57:11.601 DEBUG:teuthology.orchestra.run.smithi062:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:57:11.638 INFO:teuthology.orchestra.run.smithi062.stdout:fuseblk 2024-09-12T01:57:11.638 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:57:11.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:11.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:57:11.735 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T01:57:11.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:57:11.839 INFO:teuthology.orchestra.run.smithi062.stdout:# file: . 2024-09-12T01:57:11.839 INFO:teuthology.orchestra.run.smithi062.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T01:57:11.839 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:11.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:57:11.848 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:57:11.848 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:11.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T01:57:12.304 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:12.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.893+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2804126599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa60102360 msgr2=0x7ffa6010e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:12.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.893+0000 7ffa5fe00640 1 --2- 172.21.15.62:0/2804126599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa60102360 0x7ffa6010e890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009cd0 tx=0x7ffa5802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.893+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2804126599 shutdown_connections 2024-09-12T01:57:12.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.893+0000 7ffa5fe00640 1 --2- 172.21.15.62:0/2804126599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa60102360 0x7ffa6010e890 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.893+0000 7ffa5fe00640 1 --2- 172.21.15.62:0/2804126599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa601019c0 0x7ffa60101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.893+0000 7ffa5fe00640 1 --2- 172.21.15.62:0/2804126599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa601079c0 0x7ffa60107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.893+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2804126599 >> 172.21.15.62:0/2804126599 conn(0x7ffa600fd740 msgr2=0x7ffa600ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:12.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.893+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2804126599 shutdown_connections 2024-09-12T01:57:12.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.893+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2804126599 wait complete. 2024-09-12T01:57:12.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.894+0000 7ffa5fe00640 1 Processor -- start 2024-09-12T01:57:12.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa5fe00640 1 -- start start 2024-09-12T01:57:12.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa5fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa601019c0 0x7ffa6019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:12.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa5fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa60102360 0x7ffa6019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:12.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa5fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa601079c0 0x7ffa6019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:12.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa5fe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffa60111e10 con 0x7ffa60102360 2024-09-12T01:57:12.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa5fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffa60111c90 con 0x7ffa601079c0 2024-09-12T01:57:12.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa5fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffa60111f90 con 0x7ffa601019c0 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa57e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa60102360 0x7ffa6019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa57e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa60102360 0x7ffa6019a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38512/0 (socket says 172.21.15.62:38512) 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa57e00640 1 -- 172.21.15.62:0/2102339057 learned_addr learned my addr 172.21.15.62:0/2102339057 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa5ea00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa601019c0 0x7ffa6019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.895+0000 7ffa5f400640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa601079c0 0x7ffa6019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.896+0000 7ffa57e00640 1 -- 172.21.15.62:0/2102339057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa601019c0 msgr2=0x7ffa6019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.896+0000 7ffa57e00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa601019c0 0x7ffa6019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.896+0000 7ffa57e00640 1 -- 172.21.15.62:0/2102339057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa601079c0 msgr2=0x7ffa6019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.896+0000 7ffa57e00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa601079c0 0x7ffa6019ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.896+0000 7ffa57e00640 1 -- 172.21.15.62:0/2102339057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6019f400 con 0x7ffa60102360 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.896+0000 7ffa57e00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa60102360 0x7ffa6019a990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800d950 tx=0x7ffa4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:12.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.896+0000 7ffa57400640 1 -- 172.21.15.62:0/2102339057 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48017070 con 0x7ffa60102360 2024-09-12T01:57:12.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.896+0000 7ffa57400640 1 -- 172.21.15.62:0/2102339057 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa48009c30 con 0x7ffa60102360 2024-09-12T01:57:12.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.896+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2102339057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6019f6f0 con 0x7ffa60102360 2024-09-12T01:57:12.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.896+0000 7ffa57400640 1 -- 172.21.15.62:0/2102339057 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800f6b0 con 0x7ffa60102360 2024-09-12T01:57:12.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.897+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2102339057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa601a6fd0 con 0x7ffa60102360 2024-09-12T01:57:12.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.898+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2102339057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa60101e20 con 0x7ffa60102360 2024-09-12T01:57:12.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.900+0000 7ffa57400640 1 -- 172.21.15.62:0/2102339057 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ffa480109d0 con 0x7ffa60102360 2024-09-12T01:57:12.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.901+0000 7ffa57400640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa440a2b80 0x7ffa440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:12.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.901+0000 7ffa57400640 1 -- 172.21.15.62:0/2102339057 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7ffa480ceec0 con 0x7ffa60102360 2024-09-12T01:57:12.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.902+0000 7ffa5ea00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa440a2b80 0x7ffa440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:12.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.902+0000 7ffa5ea00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa440a2b80 0x7ffa440a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000bb60 tx=0x7ffa5000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:12.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:12.905+0000 7ffa57400640 1 -- 172.21.15.62:0/2102339057 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa48009de0 con 0x7ffa60102360 2024-09-12T01:57:13.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:12 smithi062 ceph-mon[30666]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:13.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.105+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2102339057 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffa601a7200 con 0x7ffa60102360 2024-09-12T01:57:13.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.105+0000 7ffa57400640 1 -- 172.21.15.62:0/2102339057 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+588 (secure 0 0 0) 0x7ffa4809b530 con 0x7ffa60102360 2024-09-12T01:57:13.106 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/1515578586 2024-09-13T01:49:21.439435+0000 2024-09-12T01:57:13.106 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/4054298843 2024-09-13T01:49:21.439435+0000 2024-09-12T01:57:13.106 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/1515578586 2024-09-13T01:49:21.439435+0000 2024-09-12T01:57:13.106 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/934108526 2024-09-13T01:49:21.439435+0000 2024-09-12T01:57:13.106 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/91320952 2024-09-13T01:49:21.439435+0000 2024-09-12T01:57:13.106 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/2854042842 2024-09-13T01:48:53.659705+0000 2024-09-12T01:57:13.106 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/2854042842 2024-09-13T01:48:53.659705+0000 2024-09-12T01:57:13.106 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1208654241 2024-09-13T01:48:53.659705+0000 2024-09-12T01:57:13.106 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/409574397 2024-09-13T01:48:53.659705+0000 2024-09-12T01:57:13.106 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/3603814798 2024-09-13T01:48:53.659705+0000 2024-09-12T01:57:13.107 INFO:teuthology.orchestra.run.smithi062.stderr:listed 10 entries 2024-09-12T01:57:13.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.107+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2102339057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa440a2b80 msgr2=0x7ffa440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:13.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.107+0000 7ffa5fe00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa440a2b80 0x7ffa440a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000bb60 tx=0x7ffa5000b390 comp rx=0 tx=0).stop 2024-09-12T01:57:13.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.107+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2102339057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa60102360 msgr2=0x7ffa6019a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:13.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.107+0000 7ffa5fe00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa60102360 0x7ffa6019a990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800d950 tx=0x7ffa4800de10 comp rx=0 tx=0).stop 2024-09-12T01:57:13.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.107+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2102339057 shutdown_connections 2024-09-12T01:57:13.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.107+0000 7ffa5fe00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa440a2b80 0x7ffa440a5040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.107+0000 7ffa5fe00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa601079c0 0x7ffa6019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.107+0000 7ffa5fe00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa60102360 0x7ffa6019a990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.107+0000 7ffa5fe00640 1 --2- 172.21.15.62:0/2102339057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa601019c0 0x7ffa6019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.107+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2102339057 >> 172.21.15.62:0/2102339057 conn(0x7ffa600fd740 msgr2=0x7ffa6010cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:13.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.108+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2102339057 shutdown_connections 2024-09-12T01:57:13.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:13.108+0000 7ffa5fe00640 1 -- 172.21.15.62:0/2102339057 wait complete. 2024-09-12T01:57:13.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:12 smithi107 ceph-mon[35463]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:13.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:12 smithi077 ceph-mon[35095]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:57:13.986 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:57:13.986 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:57:14.024 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T01:57:14.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:13 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2102339057' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:57:14.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:13 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2102339057' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:57:14.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:13 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2102339057' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:57:14.442 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.996+0000 7f2a2fe00640 1 -- 172.21.15.62:0/292120607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a281049c0 msgr2=0x7f2a28108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.996+0000 7f2a2fe00640 1 --2- 172.21.15.62:0/292120607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a281049c0 0x7f2a28108a10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009900 tx=0x7f2a1402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:14.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.996+0000 7f2a2fe00640 1 -- 172.21.15.62:0/292120607 shutdown_connections 2024-09-12T01:57:14.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.996+0000 7f2a2fe00640 1 --2- 172.21.15.62:0/292120607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a28109140 0x7f2a28110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:14.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.996+0000 7f2a2fe00640 1 --2- 172.21.15.62:0/292120607 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a281049c0 0x7f2a28108a10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:14.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.996+0000 7f2a2fe00640 1 --2- 172.21.15.62:0/292120607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a28104010 0x7f2a281043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:14.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.996+0000 7f2a2fe00640 1 -- 172.21.15.62:0/292120607 >> 172.21.15.62:0/292120607 conn(0x7f2a280ffa50 msgr2=0x7f2a28101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:14.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.997+0000 7f2a2fe00640 1 -- 172.21.15.62:0/292120607 shutdown_connections 2024-09-12T01:57:14.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.997+0000 7f2a2fe00640 1 -- 172.21.15.62:0/292120607 wait complete. 2024-09-12T01:57:15.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.997+0000 7f2a2fe00640 1 Processor -- start 2024-09-12T01:57:15.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.998+0000 7f2a2fe00640 1 -- start start 2024-09-12T01:57:15.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.998+0000 7f2a2fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28104010 0x7f2a28076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.998+0000 7f2a2fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a281049c0 0x7f2a28076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.998+0000 7f2a2fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a28109140 0x7f2a28077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.998+0000 7f2a2fe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28114190 con 0x7f2a28104010 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.998+0000 7f2a2fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28114010 con 0x7f2a281049c0 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.998+0000 7f2a2fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28114310 con 0x7f2a28109140 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.998+0000 7f2a2d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28104010 0x7f2a28076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.998+0000 7f2a2d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28104010 0x7f2a28076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38522/0 (socket says 172.21.15.62:38522) 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.998+0000 7f2a2d400640 1 -- 172.21.15.62:0/1275641952 learned_addr learned my addr 172.21.15.62:0/1275641952 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.999+0000 7f2a2de00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a28109140 0x7f2a28077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.999+0000 7f2a2ca00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a281049c0 0x7f2a28076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.999+0000 7f2a2d400640 1 -- 172.21.15.62:0/1275641952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a28109140 msgr2=0x7f2a28077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.999+0000 7f2a2d400640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a28109140 0x7f2a28077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.999+0000 7f2a2d400640 1 -- 172.21.15.62:0/1275641952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a281049c0 msgr2=0x7f2a28076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.999+0000 7f2a2d400640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a281049c0 0x7f2a28076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.999+0000 7f2a2d400640 1 -- 172.21.15.62:0/1275641952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a281aace0 con 0x7f2a28104010 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.999+0000 7f2a2ca00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a281049c0 0x7f2a28076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.999+0000 7f2a2d400640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28104010 0x7f2a28076700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00ea20 tx=0x7f2a1c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:14.999+0000 7f2a26000640 1 -- 172.21.15.62:0/1275641952 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00cd80 con 0x7f2a28104010 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.000+0000 7f2a26000640 1 -- 172.21.15.62:0/1275641952 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a1c010910 con 0x7f2a28104010 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.000+0000 7f2a2fe00640 1 -- 172.21.15.62:0/1275641952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a281aafd0 con 0x7f2a28104010 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.000+0000 7f2a26000640 1 -- 172.21.15.62:0/1275641952 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c018920 con 0x7f2a28104010 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.000+0000 7f2a2fe00640 1 -- 172.21.15.62:0/1275641952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a281ab3d0 con 0x7f2a28104010 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.001+0000 7f2a2fe00640 1 -- 172.21.15.62:0/1275641952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a281054f0 con 0x7f2a28104010 2024-09-12T01:57:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.003+0000 7f2a26000640 1 -- 172.21.15.62:0/1275641952 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2a1c010ac0 con 0x7f2a28104010 2024-09-12T01:57:15.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.004+0000 7f2a26000640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2a100a2b80 0x7f2a100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.004+0000 7f2a26000640 1 -- 172.21.15.62:0/1275641952 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f2a1c0cf6c0 con 0x7f2a28104010 2024-09-12T01:57:15.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.004+0000 7f2a2ca00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2a100a2b80 0x7f2a100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.005+0000 7f2a2ca00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2a100a2b80 0x7f2a100a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2a14000c00 tx=0x7f2a14005a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:15.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.008+0000 7f2a26000640 1 -- 172.21.15.62:0/1275641952 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a1c09c380 con 0x7f2a28104010 2024-09-12T01:57:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:14 smithi107 ceph-mon[35463]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T01:57:15.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.204+0000 7f2a2fe00640 1 -- 172.21.15.62:0/1275641952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2a2802d7f0 con 0x7f2a28104010 2024-09-12T01:57:15.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:14 smithi062 ceph-mon[30666]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T01:57:15.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.205+0000 7f2a26000640 1 -- 172.21.15.62:0/1275641952 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+588 (secure 0 0 0) 0x7f2a1c09bc80 con 0x7f2a28104010 2024-09-12T01:57:15.206 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/1515578586 2024-09-13T01:49:21.439435+0000 2024-09-12T01:57:15.206 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/4054298843 2024-09-13T01:49:21.439435+0000 2024-09-12T01:57:15.206 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/1515578586 2024-09-13T01:49:21.439435+0000 2024-09-12T01:57:15.206 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/934108526 2024-09-13T01:49:21.439435+0000 2024-09-12T01:57:15.206 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/91320952 2024-09-13T01:49:21.439435+0000 2024-09-12T01:57:15.206 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/2854042842 2024-09-13T01:48:53.659705+0000 2024-09-12T01:57:15.206 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/2854042842 2024-09-13T01:48:53.659705+0000 2024-09-12T01:57:15.206 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1208654241 2024-09-13T01:48:53.659705+0000 2024-09-12T01:57:15.206 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/409574397 2024-09-13T01:48:53.659705+0000 2024-09-12T01:57:15.206 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/3603814798 2024-09-13T01:48:53.659705+0000 2024-09-12T01:57:15.207 INFO:teuthology.orchestra.run.smithi062.stderr:listed 10 entries 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 -- 172.21.15.62:0/1275641952 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2a100a2b80 msgr2=0x7f2a100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2a100a2b80 0x7f2a100a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2a14000c00 tx=0x7f2a14005a40 comp rx=0 tx=0).stop 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 -- 172.21.15.62:0/1275641952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28104010 msgr2=0x7f2a28076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28104010 0x7f2a28076700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00ea20 tx=0x7f2a1c00eee0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 -- 172.21.15.62:0/1275641952 shutdown_connections 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2a100a2b80 0x7f2a100a5040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a28109140 0x7f2a28077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a281049c0 0x7f2a28076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 --2- 172.21.15.62:0/1275641952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28104010 0x7f2a28076700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 -- 172.21.15.62:0/1275641952 >> 172.21.15.62:0/1275641952 conn(0x7f2a280ffa50 msgr2=0x7f2a28100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 -- 172.21.15.62:0/1275641952 shutdown_connections 2024-09-12T01:57:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:15.208+0000 7f2a2fe00640 1 -- 172.21.15.62:0/1275641952 wait complete. 2024-09-12T01:57:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:14 smithi077 ceph-mon[35095]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T01:57:15.996 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi062.front.sepia.ceph.com... 2024-09-12T01:57:15.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:15.996 DEBUG:teuthology.orchestra.run.smithi062:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T01:57:16.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[75279]: fuse finished with error 0 and tester_r 0 2024-09-12T01:57:16.056 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:57:16.136 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:57:16.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:57:16.137 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T01:57:16.183 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:57:16.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:15 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1275641952' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:57:16.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:15 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1275641952' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:57:16.271 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:15 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1275641952' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:57:16.601 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:17.053 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:16 smithi062 ceph-mon[30666]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T01:57:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.166+0000 7fa880000640 1 -- 172.21.15.62:0/720146150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa878102790 msgr2=0x7fa8781067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.166+0000 7fa880000640 1 --2- 172.21.15.62:0/720146150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa878102790 0x7fa8781067e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa864009900 tx=0x7fa86402a410 comp rx=0 tx=0).stop 2024-09-12T01:57:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.166+0000 7fa880000640 1 -- 172.21.15.62:0/720146150 shutdown_connections 2024-09-12T01:57:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.166+0000 7fa880000640 1 --2- 172.21.15.62:0/720146150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa878106f10 0x7fa87810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.166+0000 7fa880000640 1 --2- 172.21.15.62:0/720146150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa878102790 0x7fa8781067e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.166+0000 7fa880000640 1 --2- 172.21.15.62:0/720146150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa878101de0 0x7fa8781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.166+0000 7fa880000640 1 -- 172.21.15.62:0/720146150 >> 172.21.15.62:0/720146150 conn(0x7fa8780fd8c0 msgr2=0x7fa8780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:17.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.166+0000 7fa880000640 1 -- 172.21.15.62:0/720146150 shutdown_connections 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.166+0000 7fa880000640 1 -- 172.21.15.62:0/720146150 wait complete. 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.167+0000 7fa880000640 1 Processor -- start 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.167+0000 7fa880000640 1 -- start start 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.167+0000 7fa880000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa878101de0 0x7fa87819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa880000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa878102790 0x7fa87819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa880000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa878106f10 0x7fa87819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa880000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa878111fc0 con 0x7fa878102790 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa880000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa878111e40 con 0x7fa878106f10 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa880000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa878112140 con 0x7fa878101de0 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa87cc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa878102790 0x7fa87819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa87cc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa878102790 0x7fa87819abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:38554/0 (socket says 172.21.15.62:38554) 2024-09-12T01:57:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa87cc00640 1 -- 172.21.15.62:0/2977709816 learned_addr learned my addr 172.21.15.62:0/2977709816 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa87d600640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa878101de0 0x7fa87819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa87e000640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa878106f10 0x7fa87819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa87cc00640 1 -- 172.21.15.62:0/2977709816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa878101de0 msgr2=0x7fa87819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa87cc00640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa878101de0 0x7fa87819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa87cc00640 1 -- 172.21.15.62:0/2977709816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa878106f10 msgr2=0x7fa87819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa87cc00640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa878106f10 0x7fa87819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.168+0000 7fa87cc00640 1 -- 172.21.15.62:0/2977709816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87819f630 con 0x7fa878102790 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.169+0000 7fa87cc00640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa878102790 0x7fa87819abc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa864004770 tx=0x7fa864003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.169+0000 7fa876000640 1 -- 172.21.15.62:0/2977709816 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86403f070 con 0x7fa878102790 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.169+0000 7fa876000640 1 -- 172.21.15.62:0/2977709816 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa864031ca0 con 0x7fa878102790 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.169+0000 7fa876000640 1 -- 172.21.15.62:0/2977709816 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864035030 con 0x7fa878102790 2024-09-12T01:57:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.169+0000 7fa880000640 1 -- 172.21.15.62:0/2977709816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87819f8c0 con 0x7fa878102790 2024-09-12T01:57:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.169+0000 7fa880000640 1 -- 172.21.15.62:0/2977709816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87819fd50 con 0x7fa878102790 2024-09-12T01:57:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.170+0000 7fa880000640 1 -- 172.21.15.62:0/2977709816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8781021c0 con 0x7fa878102790 2024-09-12T01:57:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.172+0000 7fa876000640 1 -- 172.21.15.62:0/2977709816 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa864042070 con 0x7fa878102790 2024-09-12T01:57:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.173+0000 7fa876000640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8600a2c00 0x7fa8600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.174+0000 7fa876000640 1 -- 172.21.15.62:0/2977709816 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fa8640ef430 con 0x7fa878102790 2024-09-12T01:57:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.174+0000 7fa87d600640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8600a2c00 0x7fa8600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.174+0000 7fa87d600640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8600a2c00 0x7fa8600a50c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009bd0 tx=0x7fa86c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.178+0000 7fa876000640 1 -- 172.21.15.62:0/2977709816 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8640bc150 con 0x7fa878102790 2024-09-12T01:57:17.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:16 smithi107 ceph-mon[35463]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T01:57:17.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:16 smithi077 ceph-mon[35095]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T01:57:17.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.367+0000 7fa880000640 1 -- 172.21.15.62:0/2977709816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8781a73c0 con 0x7fa878102790 2024-09-12T01:57:17.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.368+0000 7fa876000640 1 -- 172.21.15.62:0/2977709816 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24198 (secure 0 0 0) 0x7fa8640bba50 con 0x7fa878102790 2024-09-12T01:57:17.369 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:17.370 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":90,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:56:52.769187+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 -- 172.21.15.62:0/2977709816 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8600a2c00 msgr2=0x7fa8600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8600a2c00 0x7fa8600a50c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009bd0 tx=0x7fa86c005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 -- 172.21.15.62:0/2977709816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa878102790 msgr2=0x7fa87819abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa878102790 0x7fa87819abc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa864004770 tx=0x7fa864003c10 comp rx=0 tx=0).stop 2024-09-12T01:57:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 -- 172.21.15.62:0/2977709816 shutdown_connections 2024-09-12T01:57:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa8600a2c00 0x7fa8600a50c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa878106f10 0x7fa87819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa878102790 0x7fa87819abc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 --2- 172.21.15.62:0/2977709816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa878101de0 0x7fa87819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 -- 172.21.15.62:0/2977709816 >> 172.21.15.62:0/2977709816 conn(0x7fa8780fd8c0 msgr2=0x7fa8780ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:17.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 -- 172.21.15.62:0/2977709816 shutdown_connections 2024-09-12T01:57:17.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:17.371+0000 7fa880000640 1 -- 172.21.15.62:0/2977709816 wait complete. 2024-09-12T01:57:18.045 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:17 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2977709816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:18.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:57:18.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:17 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2977709816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:17 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2977709816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:18.488 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:19.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.075+0000 7f965be00640 1 -- 172.21.15.62:0/3249862303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f965c103e30 msgr2=0x7f965c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:19.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.075+0000 7f965be00640 1 --2- 172.21.15.62:0/3249862303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f965c103e30 0x7f965c104210 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f964c009900 tx=0x7f964c02a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.075+0000 7f965be00640 1 -- 172.21.15.62:0/3249862303 shutdown_connections 2024-09-12T01:57:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.075+0000 7f965be00640 1 --2- 172.21.15.62:0/3249862303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c108f60 0x7f965c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.075+0000 7f965be00640 1 --2- 172.21.15.62:0/3249862303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f965c1047e0 0x7f965c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.075+0000 7f965be00640 1 --2- 172.21.15.62:0/3249862303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f965c103e30 0x7f965c104210 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.075+0000 7f965be00640 1 -- 172.21.15.62:0/3249862303 >> 172.21.15.62:0/3249862303 conn(0x7f965c0ff8d0 msgr2=0x7f965c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.075+0000 7f965be00640 1 -- 172.21.15.62:0/3249862303 shutdown_connections 2024-09-12T01:57:19.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.075+0000 7f965be00640 1 -- 172.21.15.62:0/3249862303 wait complete. 2024-09-12T01:57:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.076+0000 7f965be00640 1 Processor -- start 2024-09-12T01:57:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.077+0000 7f965be00640 1 -- start start 2024-09-12T01:57:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.077+0000 7f965be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c103e30 0x7f965c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.077+0000 7f965be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f965c1047e0 0x7f965c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.077+0000 7f965be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f965c108f60 0x7f965c19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.077+0000 7f965be00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f965c113fc0 con 0x7f965c108f60 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.077+0000 7f965be00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f965c113e40 con 0x7f965c103e30 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.077+0000 7f965be00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f965c114140 con 0x7f965c1047e0 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f965aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c103e30 0x7f965c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f965aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c103e30 0x7f965c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:34104/0 (socket says 172.21.15.62:34104) 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f965aa00640 1 -- 172.21.15.62:0/603425155 learned_addr learned my addr 172.21.15.62:0/603425155 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f965b400640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f965c108f60 0x7f965c19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f9652000640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f965c1047e0 0x7f965c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f965aa00640 1 -- 172.21.15.62:0/603425155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f965c1047e0 msgr2=0x7f965c19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f965aa00640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f965c1047e0 0x7f965c19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f965aa00640 1 -- 172.21.15.62:0/603425155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f965c108f60 msgr2=0x7f965c19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f965aa00640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f965c108f60 0x7f965c19ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f965aa00640 1 -- 172.21.15.62:0/603425155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c19f430 con 0x7f965c103e30 2024-09-12T01:57:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.078+0000 7f965aa00640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c103e30 0x7f965c19a480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f964c006010 tx=0x7f964c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.079+0000 7f9660a00640 1 -- 172.21.15.62:0/603425155 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c03f030 con 0x7f965c103e30 2024-09-12T01:57:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.079+0000 7f9660a00640 1 -- 172.21.15.62:0/603425155 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f964c004440 con 0x7f965c103e30 2024-09-12T01:57:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.079+0000 7f965be00640 1 -- 172.21.15.62:0/603425155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965c19f6c0 con 0x7f965c103e30 2024-09-12T01:57:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.079+0000 7f9660a00640 1 -- 172.21.15.62:0/603425155 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c035070 con 0x7f965c103e30 2024-09-12T01:57:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.079+0000 7f965be00640 1 -- 172.21.15.62:0/603425155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965c1a7000 con 0x7f965c103e30 2024-09-12T01:57:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.080+0000 7f965be00640 1 -- 172.21.15.62:0/603425155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965c104210 con 0x7f965c103e30 2024-09-12T01:57:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.082+0000 7f9660a00640 1 -- 172.21.15.62:0/603425155 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f964c042030 con 0x7f965c103e30 2024-09-12T01:57:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.083+0000 7f9660a00640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f96400a2c00 0x7f96400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.083+0000 7f9660a00640 1 -- 172.21.15.62:0/603425155 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f964c0ef5b0 con 0x7f965c103e30 2024-09-12T01:57:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.083+0000 7f9652000640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f96400a2c00 0x7f96400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.084+0000 7f9652000640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f96400a2c00 0x7f96400a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f965c0ffcf0 tx=0x7f9644005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.087+0000 7f9660a00640 1 -- 172.21.15.62:0/603425155 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f964c0bbc20 con 0x7f965c103e30 2024-09-12T01:57:19.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:18 smithi107 ceph-mon[35463]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:57:19.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:18 smithi077 ceph-mon[35095]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:57:19.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.272+0000 7f965be00640 1 -- 172.21.15.62:0/603425155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f965c10c140 con 0x7f965c103e30 2024-09-12T01:57:19.273 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:18 smithi062 ceph-mon[30666]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:57:19.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.274+0000 7f9660a00640 1 -- 172.21.15.62:0/603425155 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24198 (secure 0 0 0) 0x7f964c0bff20 con 0x7f965c103e30 2024-09-12T01:57:19.275 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:19.275 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":90,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:56:52.769187+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.276+0000 7f965be00640 1 -- 172.21.15.62:0/603425155 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f96400a2c00 msgr2=0x7f96400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.276+0000 7f965be00640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f96400a2c00 0x7f96400a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f965c0ffcf0 tx=0x7f9644005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.276+0000 7f965be00640 1 -- 172.21.15.62:0/603425155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c103e30 msgr2=0x7f965c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.276+0000 7f965be00640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c103e30 0x7f965c19a480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f964c006010 tx=0x7f964c004040 comp rx=0 tx=0).stop 2024-09-12T01:57:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.276+0000 7f965be00640 1 -- 172.21.15.62:0/603425155 shutdown_connections 2024-09-12T01:57:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.276+0000 7f965be00640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f96400a2c00 0x7f96400a50c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.276+0000 7f965be00640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f965c108f60 0x7f965c19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.276+0000 7f965be00640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f965c1047e0 0x7f965c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.276+0000 7f965be00640 1 --2- 172.21.15.62:0/603425155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c103e30 0x7f965c19a480 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.276+0000 7f965be00640 1 -- 172.21.15.62:0/603425155 >> 172.21.15.62:0/603425155 conn(0x7f965c0ff8d0 msgr2=0x7f965c100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.277+0000 7f965be00640 1 -- 172.21.15.62:0/603425155 shutdown_connections 2024-09-12T01:57:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:19.277+0000 7f965be00640 1 -- 172.21.15.62:0/603425155 wait complete. 2024-09-12T01:57:20.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:57:20.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:19 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/603425155' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:20.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:19 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/603425155' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:20.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:19 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/603425155' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:20.401 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:20.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.975+0000 7f46fb400640 1 -- 172.21.15.62:0/1127165877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46f4074590 msgr2=0x7f46f4074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.975+0000 7f46fb400640 1 --2- 172.21.15.62:0/1127165877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46f4074590 0x7f46f4074970 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009900 tx=0x7f46e402a480 comp rx=0 tx=0).stop 2024-09-12T01:57:20.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.975+0000 7f46fb400640 1 -- 172.21.15.62:0/1127165877 shutdown_connections 2024-09-12T01:57:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.975+0000 7f46fb400640 1 --2- 172.21.15.62:0/1127165877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f4112b90 0x7f46f4114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.975+0000 7f46fb400640 1 --2- 172.21.15.62:0/1127165877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46f4074eb0 0x7f46f4112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.975+0000 7f46fb400640 1 --2- 172.21.15.62:0/1127165877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46f4074590 0x7f46f4074970 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.975+0000 7f46fb400640 1 -- 172.21.15.62:0/1127165877 >> 172.21.15.62:0/1127165877 conn(0x7f46f40fd8c0 msgr2=0x7f46f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.976+0000 7f46fb400640 1 -- 172.21.15.62:0/1127165877 shutdown_connections 2024-09-12T01:57:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.976+0000 7f46fb400640 1 -- 172.21.15.62:0/1127165877 wait complete. 2024-09-12T01:57:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.976+0000 7f46fb400640 1 Processor -- start 2024-09-12T01:57:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46fb400640 1 -- start start 2024-09-12T01:57:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46fb400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46f4074590 0x7f46f41a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46fb400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46f4074eb0 0x7f46f41a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46fb400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f4112b90 0x7f46f419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46fb400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f46f4118550 con 0x7f46f4074eb0 2024-09-12T01:57:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46fb400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46f41183d0 con 0x7f46f4112b90 2024-09-12T01:57:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46fb400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f46f41186d0 con 0x7f46f4074590 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46ebe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46f4074eb0 0x7f46f41a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46f8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46f4074590 0x7f46f41a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46f8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46f4074590 0x7f46f41a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:33804/0 (socket says 172.21.15.62:33804) 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46f8a00640 1 -- 172.21.15.62:0/4191876164 learned_addr learned my addr 172.21.15.62:0/4191876164 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.977+0000 7f46f9400640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f4112b90 0x7f46f419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.978+0000 7f46f8a00640 1 -- 172.21.15.62:0/4191876164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f4112b90 msgr2=0x7f46f419e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.978+0000 7f46f8a00640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f4112b90 0x7f46f419e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.978+0000 7f46f8a00640 1 -- 172.21.15.62:0/4191876164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46f4074eb0 msgr2=0x7f46f41a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.978+0000 7f46f8a00640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46f4074eb0 0x7f46f41a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.978+0000 7f46f8a00640 1 -- 172.21.15.62:0/4191876164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f419f010 con 0x7f46f4074590 2024-09-12T01:57:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.978+0000 7f46ebe00640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46f4074eb0 0x7f46f41a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.978+0000 7f46f8a00640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46f4074590 0x7f46f41a4720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46e4006010 tx=0x7f46e40042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.978+0000 7f46f2000640 1 -- 172.21.15.62:0/4191876164 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e403f030 con 0x7f46f4074590 2024-09-12T01:57:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.978+0000 7f46fb400640 1 -- 172.21.15.62:0/4191876164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f419f2a0 con 0x7f46f4074590 2024-09-12T01:57:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.979+0000 7f46f2000640 1 -- 172.21.15.62:0/4191876164 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46e4003ce0 con 0x7f46f4074590 2024-09-12T01:57:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.979+0000 7f46f2000640 1 -- 172.21.15.62:0/4191876164 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4035070 con 0x7f46f4074590 2024-09-12T01:57:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.979+0000 7f46fb400640 1 -- 172.21.15.62:0/4191876164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f41ab5f0 con 0x7f46f4074590 2024-09-12T01:57:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.980+0000 7f46fb400640 1 -- 172.21.15.62:0/4191876164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f4074970 con 0x7f46f4074590 2024-09-12T01:57:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.981+0000 7f46f2000640 1 -- 172.21.15.62:0/4191876164 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f46e4042030 con 0x7f46f4074590 2024-09-12T01:57:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.983+0000 7f46f2000640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f46d80a2b80 0x7f46d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.983+0000 7f46f2000640 1 -- 172.21.15.62:0/4191876164 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f46e40ef3a0 con 0x7f46f4074590 2024-09-12T01:57:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.983+0000 7f46ebe00640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f46d80a2b80 0x7f46d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.984+0000 7f46ebe00640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f46d80a2b80 0x7f46d80a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f46f40fff30 tx=0x7f46dc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:20.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:20.987+0000 7f46f2000640 1 -- 172.21.15.62:0/4191876164 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46e40bbad0 con 0x7f46f4074590 2024-09-12T01:57:21.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:20 smithi107 ceph-mon[35463]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:57:21.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.209+0000 7f46fb400640 1 -- 172.21.15.62:0/4191876164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f46f4104fd0 con 0x7f46f4074590 2024-09-12T01:57:21.210 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:20 smithi062 ceph-mon[30666]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:57:21.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:20 smithi077 ceph-mon[35095]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:57:21.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.946+0000 7f46f2000640 1 -- 172.21.15.62:0/4191876164 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f46e40bfdd0 con 0x7f46f4074590 2024-09-12T01:57:21.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.951+0000 7f46fb400640 1 -- 172.21.15.62:0/4191876164 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f46d80a2b80 msgr2=0x7f46d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.951+0000 7f46fb400640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f46d80a2b80 0x7f46d80a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f46f40fff30 tx=0x7f46dc00b410 comp rx=0 tx=0).stop 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.951+0000 7f46fb400640 1 -- 172.21.15.62:0/4191876164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46f4074590 msgr2=0x7f46f41a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.951+0000 7f46fb400640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46f4074590 0x7f46f41a4720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46e4006010 tx=0x7f46e40042f0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.951+0000 7f46fb400640 1 -- 172.21.15.62:0/4191876164 shutdown_connections 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.951+0000 7f46fb400640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f46d80a2b80 0x7f46d80a5040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.951+0000 7f46fb400640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46f4112b90 0x7f46f419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.951+0000 7f46fb400640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46f4074eb0 0x7f46f41a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.951+0000 7f46fb400640 1 --2- 172.21.15.62:0/4191876164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46f4074590 0x7f46f41a4720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.951+0000 7f46fb400640 1 -- 172.21.15.62:0/4191876164 >> 172.21.15.62:0/4191876164 conn(0x7f46f40fd8c0 msgr2=0x7f46f40ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.952+0000 7f46fb400640 1 -- 172.21.15.62:0/4191876164 shutdown_connections 2024-09-12T01:57:21.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:21.952+0000 7f46fb400640 1 -- 172.21.15.62:0/4191876164 wait complete. 2024-09-12T01:57:22.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4191876164' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:57:22.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:57:22.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-12T01:57:22.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-12T01:57:22.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-09-12T01:57:22.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-12T01:57:22.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T01:57:22.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-12T01:57:22.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T01:57:22.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-12T01:57:22.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-12T01:57:22.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:21 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-12T01:57:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4191876164' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:57:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:57:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-12T01:57:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-12T01:57:22.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-09-12T01:57:22.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-12T01:57:22.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T01:57:22.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-12T01:57:22.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T01:57:22.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-12T01:57:22.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-12T01:57:22.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:21 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-12T01:57:22.322 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4191876164' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:57:22.322 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:57:22.322 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-12T01:57:22.322 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-12T01:57:22.322 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2024-09-12T01:57:22.322 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-12T01:57:22.322 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T01:57:22.322 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-12T01:57:22.323 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T01:57:22.323 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-12T01:57:22.323 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-12T01:57:22.323 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:21 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-12T01:57:22.694 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-12T01:57:22.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T01:57:23.080 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:23.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: pgmap v320: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:57:23.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:57:23.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-12T01:57:23.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-12T01:57:23.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-12T01:57:23.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-12T01:57:23.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T01:57:23.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-12T01:57:23.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T01:57:23.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-12T01:57:23.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-12T01:57:23.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-12T01:57:23.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T01:57:23.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:22 smithi107 ceph-mon[35463]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:57:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: pgmap v320: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:57:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:57:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-12T01:57:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-12T01:57:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-12T01:57:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-12T01:57:23.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T01:57:23.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-12T01:57:23.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T01:57:23.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-12T01:57:23.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-12T01:57:23.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-12T01:57:23.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T01:57:23.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:22 smithi077 ceph-mon[35095]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:57:23.219 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: pgmap v320: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:57:23.219 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:57:23.219 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T01:57:23.220 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:22 smithi062 ceph-mon[30666]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:57:23.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.653+0000 7fe08ae00640 1 -- 172.21.15.62:0/2589012647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe084103ff0 msgr2=0x7fe0841043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:23.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.653+0000 7fe08ae00640 1 --2- 172.21.15.62:0/2589012647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe084103ff0 0x7fe0841043d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe074009900 tx=0x7fe07402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:23.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.653+0000 7fe08ae00640 1 -- 172.21.15.62:0/2589012647 shutdown_connections 2024-09-12T01:57:23.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.653+0000 7fe08ae00640 1 --2- 172.21.15.62:0/2589012647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe084109120 0x7fe084110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:23.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.653+0000 7fe08ae00640 1 --2- 172.21.15.62:0/2589012647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0841049a0 0x7fe0841089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:23.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.653+0000 7fe08ae00640 1 --2- 172.21.15.62:0/2589012647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe084103ff0 0x7fe0841043d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:23.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.653+0000 7fe08ae00640 1 -- 172.21.15.62:0/2589012647 >> 172.21.15.62:0/2589012647 conn(0x7fe0840ffa90 msgr2=0x7fe084101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:23.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.653+0000 7fe08ae00640 1 -- 172.21.15.62:0/2589012647 shutdown_connections 2024-09-12T01:57:23.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.653+0000 7fe08ae00640 1 -- 172.21.15.62:0/2589012647 wait complete. 2024-09-12T01:57:23.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.654+0000 7fe08ae00640 1 Processor -- start 2024-09-12T01:57:23.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.654+0000 7fe08ae00640 1 -- start start 2024-09-12T01:57:23.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe08ae00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe084103ff0 0x7fe08419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:23.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe08ae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0841049a0 0x7fe08419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:23.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe08ae00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe084109120 0x7fe08419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:23.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe08ae00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe084114190 con 0x7fe084109120 2024-09-12T01:57:23.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe08ae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe084114010 con 0x7fe0841049a0 2024-09-12T01:57:23.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe08ae00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe084114310 con 0x7fe084103ff0 2024-09-12T01:57:23.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe088e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe084109120 0x7fe08419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe083e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe084103ff0 0x7fe08419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe088e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe084109120 0x7fe08419eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56558/0 (socket says 172.21.15.62:56558) 2024-09-12T01:57:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe088e00640 1 -- 172.21.15.62:0/4228515463 learned_addr learned my addr 172.21.15.62:0/4228515463 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe07be00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0841049a0 0x7fe08419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe088e00640 1 -- 172.21.15.62:0/4228515463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe084103ff0 msgr2=0x7fe08419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe088e00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe084103ff0 0x7fe08419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe088e00640 1 -- 172.21.15.62:0/4228515463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0841049a0 msgr2=0x7fe08419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe088e00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0841049a0 0x7fe08419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe088e00640 1 -- 172.21.15.62:0/4228515463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08419f5c0 con 0x7fe084109120 2024-09-12T01:57:23.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.655+0000 7fe083e00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe084103ff0 0x7fe08419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:23.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.656+0000 7fe088e00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe084109120 0x7fe08419eee0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009fd0 tx=0x7fe07c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:23.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.656+0000 7fe081600640 1 -- 172.21.15.62:0/4228515463 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c017070 con 0x7fe084109120 2024-09-12T01:57:23.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.656+0000 7fe081600640 1 -- 172.21.15.62:0/4228515463 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe07c003e50 con 0x7fe084109120 2024-09-12T01:57:23.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.656+0000 7fe081600640 1 -- 172.21.15.62:0/4228515463 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0106c0 con 0x7fe084109120 2024-09-12T01:57:23.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.656+0000 7fe08ae00640 1 -- 172.21.15.62:0/4228515463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08419f8b0 con 0x7fe084109120 2024-09-12T01:57:23.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.656+0000 7fe08ae00640 1 -- 172.21.15.62:0/4228515463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0841a7190 con 0x7fe084109120 2024-09-12T01:57:23.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.657+0000 7fe08ae00640 1 -- 172.21.15.62:0/4228515463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0841043d0 con 0x7fe084109120 2024-09-12T01:57:23.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.659+0000 7fe081600640 1 -- 172.21.15.62:0/4228515463 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe07c003970 con 0x7fe084109120 2024-09-12T01:57:23.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.661+0000 7fe081600640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe0680a2c00 0x7fe0680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:23.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.661+0000 7fe081600640 1 -- 172.21.15.62:0/4228515463 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fe07c0cefb0 con 0x7fe084109120 2024-09-12T01:57:23.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.661+0000 7fe083e00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe0680a2c00 0x7fe0680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:23.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.662+0000 7fe083e00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe0680a2c00 0x7fe0680a50c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe074000c00 tx=0x7fe074031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:23.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.663+0000 7fe081600640 1 -- 172.21.15.62:0/4228515463 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe07c09b580 con 0x7fe084109120 2024-09-12T01:57:23.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.887+0000 7fe08ae00640 1 -- 172.21.15.62:0/4228515463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fe08419b970 con 0x7fe084109120 2024-09-12T01:57:23.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.952+0000 7fe081600640 1 -- 172.21.15.62:0/4228515463 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fe08419b970 con 0x7fe084109120 2024-09-12T01:57:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 -- 172.21.15.62:0/4228515463 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe0680a2c00 msgr2=0x7fe0680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:23.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe0680a2c00 0x7fe0680a50c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe074000c00 tx=0x7fe074031510 comp rx=0 tx=0).stop 2024-09-12T01:57:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 -- 172.21.15.62:0/4228515463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe084109120 msgr2=0x7fe08419eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe084109120 0x7fe08419eee0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009fd0 tx=0x7fe07c00b260 comp rx=0 tx=0).stop 2024-09-12T01:57:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 -- 172.21.15.62:0/4228515463 shutdown_connections 2024-09-12T01:57:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe0680a2c00 0x7fe0680a50c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe084109120 0x7fe08419eee0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0841049a0 0x7fe08419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 --2- 172.21.15.62:0/4228515463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe084103ff0 0x7fe08419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 -- 172.21.15.62:0/4228515463 >> 172.21.15.62:0/4228515463 conn(0x7fe0840ffa90 msgr2=0x7fe084100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 -- 172.21.15.62:0/4228515463 shutdown_connections 2024-09-12T01:57:23.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:23.955+0000 7fe08ae00640 1 -- 172.21.15.62:0/4228515463 wait complete. 2024-09-12T01:57:24.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:23 smithi077 ceph-mon[35095]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T01:57:24.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:23 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4228515463' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:57:24.323 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:23 smithi062 ceph-mon[30666]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T01:57:24.324 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:23 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4228515463' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:57:24.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:23 smithi107 ceph-mon[35463]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T01:57:24.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:23 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4228515463' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:57:24.685 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T01:57:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:25.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:24 smithi077 ceph-mon[35095]: pgmap v323: 129 pgs: 4 peering, 125 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T01:57:25.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:24 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4228515463' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:57:25.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:24 smithi077 ceph-mon[35095]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:57:25.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:24 smithi077 ceph-mon[35095]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-12T01:57:25.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:24 smithi062 ceph-mon[30666]: pgmap v323: 129 pgs: 4 peering, 125 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T01:57:25.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:24 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4228515463' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:57:25.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:24 smithi062 ceph-mon[30666]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:57:25.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:24 smithi062 ceph-mon[30666]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-12T01:57:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:24 smithi107 ceph-mon[35463]: pgmap v323: 129 pgs: 4 peering, 125 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T01:57:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:24 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4228515463' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:57:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:24 smithi107 ceph-mon[35463]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:57:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:24 smithi107 ceph-mon[35463]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-12T01:57:25.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.669+0000 7f0e81200640 1 -- 172.21.15.62:0/3164294502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e7c103ff0 msgr2=0x7f0e7c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:25.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.669+0000 7f0e81200640 1 --2- 172.21.15.62:0/3164294502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e7c103ff0 0x7f0e7c1043d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009900 tx=0x7f0e6c02a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:25.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.669+0000 7f0e81200640 1 -- 172.21.15.62:0/3164294502 shutdown_connections 2024-09-12T01:57:25.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.669+0000 7f0e81200640 1 --2- 172.21.15.62:0/3164294502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e7c109120 0x7f0e7c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:25.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.669+0000 7f0e81200640 1 --2- 172.21.15.62:0/3164294502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7c1049a0 0x7f0e7c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:25.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.669+0000 7f0e81200640 1 --2- 172.21.15.62:0/3164294502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e7c103ff0 0x7f0e7c1043d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:25.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.669+0000 7f0e81200640 1 -- 172.21.15.62:0/3164294502 >> 172.21.15.62:0/3164294502 conn(0x7f0e7c0ffa90 msgr2=0x7f0e7c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:25.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.669+0000 7f0e81200640 1 -- 172.21.15.62:0/3164294502 shutdown_connections 2024-09-12T01:57:25.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.669+0000 7f0e81200640 1 -- 172.21.15.62:0/3164294502 wait complete. 2024-09-12T01:57:25.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.670+0000 7f0e81200640 1 Processor -- start 2024-09-12T01:57:25.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.670+0000 7f0e81200640 1 -- start start 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e81200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e7c103ff0 0x7f0e7c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e81200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7c1049a0 0x7f0e7c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e81200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e7c109120 0x7f0e7c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e81200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c1141a0 con 0x7f0e7c109120 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e81200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c114020 con 0x7f0e7c1049a0 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e81200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c114320 con 0x7f0e7c103ff0 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e71400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7c1049a0 0x7f0e7c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e79e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e7c103ff0 0x7f0e7c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e79e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e7c103ff0 0x7f0e7c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:57364/0 (socket says 172.21.15.62:57364) 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e79e00640 1 -- 172.21.15.62:0/938163121 learned_addr learned my addr 172.21.15.62:0/938163121 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e71400640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7c1049a0 0x7f0e7c19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:44154/0 (socket says 172.21.15.62:44154) 2024-09-12T01:57:25.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e7a800640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e7c109120 0x7f0e7c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:25.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e79e00640 1 -- 172.21.15.62:0/938163121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7c1049a0 msgr2=0x7f0e7c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:25.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e79e00640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7c1049a0 0x7f0e7c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:25.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.671+0000 7f0e79e00640 1 -- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e7c109120 msgr2=0x7f0e7c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:25.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.672+0000 7f0e79e00640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e7c109120 0x7f0e7c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:25.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.672+0000 7f0e79e00640 1 -- 172.21.15.62:0/938163121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7c19f5d0 con 0x7f0e7c103ff0 2024-09-12T01:57:25.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.672+0000 7f0e7a800640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e7c109120 0x7f0e7c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:25.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.672+0000 7f0e79e00640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e7c103ff0 0x7f0e7c19a620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c004770 tx=0x7f0e6c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:25.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.672+0000 7f0e73400640 1 -- 172.21.15.62:0/938163121 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c03f070 con 0x7f0e7c103ff0 2024-09-12T01:57:25.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.672+0000 7f0e73400640 1 -- 172.21.15.62:0/938163121 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e6c031ca0 con 0x7f0e7c103ff0 2024-09-12T01:57:25.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.672+0000 7f0e81200640 1 -- 172.21.15.62:0/938163121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7c19f860 con 0x7f0e7c103ff0 2024-09-12T01:57:25.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.672+0000 7f0e73400640 1 -- 172.21.15.62:0/938163121 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c035030 con 0x7f0e7c103ff0 2024-09-12T01:57:25.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.672+0000 7f0e81200640 1 -- 172.21.15.62:0/938163121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e7c1a71a0 con 0x7f0e7c103ff0 2024-09-12T01:57:25.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.673+0000 7f0e81200640 1 -- 172.21.15.62:0/938163121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e7c1054d0 con 0x7f0e7c103ff0 2024-09-12T01:57:25.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.676+0000 7f0e73400640 1 -- 172.21.15.62:0/938163121 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0e6c042070 con 0x7f0e7c103ff0 2024-09-12T01:57:25.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.677+0000 7f0e73400640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0e600a2b80 0x7f0e600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:25.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.677+0000 7f0e73400640 1 -- 172.21.15.62:0/938163121 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f0e6c0efbf0 con 0x7f0e7c103ff0 2024-09-12T01:57:25.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.677+0000 7f0e71400640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0e600a2b80 0x7f0e600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:25.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.678+0000 7f0e71400640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0e600a2b80 0x7f0e600a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0fff20 tx=0x7f0e64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:25.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.679+0000 7f0e73400640 1 -- 172.21.15.62:0/938163121 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e6c0bc200 con 0x7f0e7c103ff0 2024-09-12T01:57:25.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.903+0000 7f0e81200640 1 -- 172.21.15.62:0/938163121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0e7c1043d0 con 0x7f0e7c103ff0 2024-09-12T01:57:25.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.967+0000 7f0e73400640 1 -- 172.21.15.62:0/938163121 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f0e6c0c0500 con 0x7f0e7c103ff0 2024-09-12T01:57:25.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.969+0000 7f0e81200640 1 -- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0e600a2b80 msgr2=0x7f0e600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:25.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.969+0000 7f0e81200640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0e600a2b80 0x7f0e600a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0fff20 tx=0x7f0e64005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:25.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.969+0000 7f0e81200640 1 -- 172.21.15.62:0/938163121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e7c103ff0 msgr2=0x7f0e7c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:25.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.969+0000 7f0e81200640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e7c103ff0 0x7f0e7c19a620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c004770 tx=0x7f0e6c003c10 comp rx=0 tx=0).stop 2024-09-12T01:57:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.970+0000 7f0e81200640 1 -- 172.21.15.62:0/938163121 shutdown_connections 2024-09-12T01:57:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.970+0000 7f0e81200640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f0e600a2b80 0x7f0e600a5040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.970+0000 7f0e81200640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e7c109120 0x7f0e7c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.970+0000 7f0e81200640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e7c1049a0 0x7f0e7c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.970+0000 7f0e81200640 1 --2- 172.21.15.62:0/938163121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e7c103ff0 0x7f0e7c19a620 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.970+0000 7f0e81200640 1 -- 172.21.15.62:0/938163121 >> 172.21.15.62:0/938163121 conn(0x7f0e7c0ffa90 msgr2=0x7f0e7c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.970+0000 7f0e81200640 1 -- 172.21.15.62:0/938163121 shutdown_connections 2024-09-12T01:57:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:25.970+0000 7f0e81200640 1 -- 172.21.15.62:0/938163121 wait complete. 2024-09-12T01:57:26.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:25 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/938163121' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:57:26.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:25 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:57:26.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:25 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/938163121' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:57:26.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:25 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:57:26.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:25 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/938163121' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:57:26.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:25 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:57:26.684 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-12T01:57:26.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T01:57:27.061 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:27.219 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:26 smithi062 ceph-mon[30666]: pgmap v324: 129 pgs: 4 peering, 125 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:27.219 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:26 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:57:27.219 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:26 smithi062 ceph-mon[30666]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-12T01:57:27.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:26 smithi107 ceph-mon[35463]: pgmap v324: 129 pgs: 4 peering, 125 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:27.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:26 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:57:27.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:26 smithi107 ceph-mon[35463]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-12T01:57:27.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:26 smithi077 ceph-mon[35095]: pgmap v324: 129 pgs: 4 peering, 125 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:27.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:26 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:57:27.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:26 smithi077 ceph-mon[35095]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-12T01:57:27.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.628+0000 7fad08a00640 1 -- 172.21.15.62:0/3580323789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad04103e30 msgr2=0x7fad04104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:27.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.628+0000 7fad08a00640 1 --2- 172.21.15.62:0/3580323789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad04103e30 0x7fad04104210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7facf4009900 tx=0x7facf402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.628+0000 7fad08a00640 1 -- 172.21.15.62:0/3580323789 shutdown_connections 2024-09-12T01:57:27.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.628+0000 7fad08a00640 1 --2- 172.21.15.62:0/3580323789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad04108f60 0x7fad04110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.628+0000 7fad08a00640 1 --2- 172.21.15.62:0/3580323789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad041047e0 0x7fad04108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.628+0000 7fad08a00640 1 --2- 172.21.15.62:0/3580323789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad04103e30 0x7fad04104210 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.628+0000 7fad08a00640 1 -- 172.21.15.62:0/3580323789 >> 172.21.15.62:0/3580323789 conn(0x7fad040ff910 msgr2=0x7fad04101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:27.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.628+0000 7fad08a00640 1 -- 172.21.15.62:0/3580323789 shutdown_connections 2024-09-12T01:57:27.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.628+0000 7fad08a00640 1 -- 172.21.15.62:0/3580323789 wait complete. 2024-09-12T01:57:27.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.629+0000 7fad08a00640 1 Processor -- start 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.629+0000 7fad08a00640 1 -- start start 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.629+0000 7fad08a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad04103e30 0x7fad0419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.629+0000 7fad08a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad041047e0 0x7fad0419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.629+0000 7fad08a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad04108f60 0x7fad0419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.629+0000 7fad08a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fad04113f80 con 0x7fad041047e0 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.629+0000 7fad08a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad04113e00 con 0x7fad04108f60 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.629+0000 7fad08a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fad04114100 con 0x7fad04103e30 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.630+0000 7fad02a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad041047e0 0x7fad0419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.630+0000 7fad02a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad041047e0 0x7fad0419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56596/0 (socket says 172.21.15.62:56596) 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.630+0000 7fad02a00640 1 -- 172.21.15.62:0/1275248686 learned_addr learned my addr 172.21.15.62:0/1275248686 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.630+0000 7fad03400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad04103e30 0x7fad0419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:27.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.630+0000 7fad03e00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad04108f60 0x7fad0419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:27.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.630+0000 7fad02a00640 1 -- 172.21.15.62:0/1275248686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad04103e30 msgr2=0x7fad0419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:27.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.630+0000 7fad02a00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad04103e30 0x7fad0419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.630+0000 7fad02a00640 1 -- 172.21.15.62:0/1275248686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad04108f60 msgr2=0x7fad0419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:27.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.630+0000 7fad02a00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad04108f60 0x7fad0419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.630+0000 7fad02a00640 1 -- 172.21.15.62:0/1275248686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0419f410 con 0x7fad041047e0 2024-09-12T01:57:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.631+0000 7fad02a00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad041047e0 0x7fad0419a9a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7facf000d950 tx=0x7facf000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.631+0000 7facfbe00640 1 -- 172.21.15.62:0/1275248686 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0017070 con 0x7fad041047e0 2024-09-12T01:57:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.631+0000 7facfbe00640 1 -- 172.21.15.62:0/1275248686 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facf0009c30 con 0x7fad041047e0 2024-09-12T01:57:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.631+0000 7fad08a00640 1 -- 172.21.15.62:0/1275248686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0419f700 con 0x7fad041047e0 2024-09-12T01:57:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.631+0000 7facfbe00640 1 -- 172.21.15.62:0/1275248686 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf000f6b0 con 0x7fad041047e0 2024-09-12T01:57:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.631+0000 7fad08a00640 1 -- 172.21.15.62:0/1275248686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad041a6fe0 con 0x7fad041047e0 2024-09-12T01:57:27.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.632+0000 7fad08a00640 1 -- 172.21.15.62:0/1275248686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad04105310 con 0x7fad041047e0 2024-09-12T01:57:27.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.634+0000 7facfbe00640 1 -- 172.21.15.62:0/1275248686 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7facf00109d0 con 0x7fad041047e0 2024-09-12T01:57:27.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.636+0000 7facfbe00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7face80a2c00 0x7face80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:27.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.636+0000 7facfbe00640 1 -- 172.21.15.62:0/1275248686 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7facf00cef40 con 0x7fad041047e0 2024-09-12T01:57:27.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.636+0000 7fad03400640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7face80a2c00 0x7face80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:27.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.637+0000 7fad03400640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7face80a2c00 0x7face80a50c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7facf4009230 tx=0x7facf40058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:27.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.641+0000 7facfbe00640 1 -- 172.21.15.62:0/1275248686 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facf0009de0 con 0x7fad041047e0 2024-09-12T01:57:27.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.851+0000 7fad08a00640 1 -- 172.21.15.62:0/1275248686 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fad04062630 con 0x7face80a2c00 2024-09-12T01:57:27.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.874+0000 7facfbe00640 1 -- 172.21.15.62:0/1275248686 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fad04062630 con 0x7face80a2c00 2024-09-12T01:57:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 -- 172.21.15.62:0/1275248686 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7face80a2c00 msgr2=0x7face80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7face80a2c00 0x7face80a50c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7facf4009230 tx=0x7facf40058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 -- 172.21.15.62:0/1275248686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad041047e0 msgr2=0x7fad0419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad041047e0 0x7fad0419a9a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7facf000d950 tx=0x7facf000de10 comp rx=0 tx=0).stop 2024-09-12T01:57:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 -- 172.21.15.62:0/1275248686 shutdown_connections 2024-09-12T01:57:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7face80a2c00 0x7face80a50c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad04108f60 0x7fad0419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad041047e0 0x7fad0419a9a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 --2- 172.21.15.62:0/1275248686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad04103e30 0x7fad0419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:27.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 -- 172.21.15.62:0/1275248686 >> 172.21.15.62:0/1275248686 conn(0x7fad040ff910 msgr2=0x7fad04100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:27.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 -- 172.21.15.62:0/1275248686 shutdown_connections 2024-09-12T01:57:27.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:27.876+0000 7fad08a00640 1 -- 172.21.15.62:0/1275248686 wait complete. 2024-09-12T01:57:28.210 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:57:27 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:57:27.857+0000 7f1f24000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:57:28.211 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:57:27 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:57:27.857+0000 7f1f24000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:57:28.211 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:57:27 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:57:27.857+0000 7f1f24000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:57:28.211 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:57:27 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:57:27.857+0000 7f1f24000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:57:28.211 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:57:27 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:57:27.857+0000 7f1f24000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:57:28.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T01:57:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:29.257 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:28 smithi062 ceph-mon[30666]: pgmap v325: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:29.257 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:28 smithi062 ceph-mon[30666]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:29.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:28 smithi107 ceph-mon[35463]: pgmap v325: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:29.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:28 smithi107 ceph-mon[35463]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:29.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:28 smithi077 ceph-mon[35095]: pgmap v325: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:29.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:28 smithi077 ceph-mon[35095]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:29.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.515+0000 7fe68b000640 1 -- 172.21.15.62:0/256688438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6841049c0 msgr2=0x7fe684108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.515+0000 7fe68b000640 1 --2- 172.21.15.62:0/256688438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6841049c0 0x7fe684108a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe670009860 tx=0x7fe67002a340 comp rx=0 tx=0).stop 2024-09-12T01:57:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.516+0000 7fe68b000640 1 -- 172.21.15.62:0/256688438 shutdown_connections 2024-09-12T01:57:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.516+0000 7fe68b000640 1 --2- 172.21.15.62:0/256688438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe684109140 0x7fe684110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.516+0000 7fe68b000640 1 --2- 172.21.15.62:0/256688438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6841049c0 0x7fe684108a10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.516+0000 7fe68b000640 1 --2- 172.21.15.62:0/256688438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe684104010 0x7fe6841043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.516+0000 7fe68b000640 1 -- 172.21.15.62:0/256688438 >> 172.21.15.62:0/256688438 conn(0x7fe6840ffa50 msgr2=0x7fe684101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.516+0000 7fe68b000640 1 -- 172.21.15.62:0/256688438 shutdown_connections 2024-09-12T01:57:29.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.516+0000 7fe68b000640 1 -- 172.21.15.62:0/256688438 wait complete. 2024-09-12T01:57:29.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.517+0000 7fe68b000640 1 Processor -- start 2024-09-12T01:57:29.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.517+0000 7fe68b000640 1 -- start start 2024-09-12T01:57:29.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.517+0000 7fe68b000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe684104010 0x7fe68419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:29.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.517+0000 7fe68b000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6841049c0 0x7fe68419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:29.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.517+0000 7fe68b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684109140 0x7fe68419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:29.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.517+0000 7fe68b000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe684114160 con 0x7fe684104010 2024-09-12T01:57:29.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.517+0000 7fe68b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe684113fe0 con 0x7fe684109140 2024-09-12T01:57:29.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.517+0000 7fe68b000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe6841142e0 con 0x7fe6841049c0 2024-09-12T01:57:29.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe683e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe684104010 0x7fe68419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:29.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe683e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe684104010 0x7fe68419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:56632/0 (socket says 172.21.15.62:56632) 2024-09-12T01:57:29.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe683e00640 1 -- 172.21.15.62:0/2835226672 learned_addr learned my addr 172.21.15.62:0/2835226672 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:29.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe689000640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684109140 0x7fe68419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:29.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe683400640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6841049c0 0x7fe68419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe683e00640 1 -- 172.21.15.62:0/2835226672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6841049c0 msgr2=0x7fe68419ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe683e00640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6841049c0 0x7fe68419ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe683e00640 1 -- 172.21.15.62:0/2835226672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684109140 msgr2=0x7fe68419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe683e00640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684109140 0x7fe68419efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe683e00640 1 -- 172.21.15.62:0/2835226672 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68419f6b0 con 0x7fe684104010 2024-09-12T01:57:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.518+0000 7fe683e00640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe684104010 0x7fe68419a700 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe67400e9c0 tx=0x7fe67400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:29.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.519+0000 7fe680c00640 1 -- 172.21.15.62:0/2835226672 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67400cde0 con 0x7fe684104010 2024-09-12T01:57:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.519+0000 7fe680c00640 1 -- 172.21.15.62:0/2835226672 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6740035f0 con 0x7fe684104010 2024-09-12T01:57:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.519+0000 7fe680c00640 1 -- 172.21.15.62:0/2835226672 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674010690 con 0x7fe684104010 2024-09-12T01:57:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.519+0000 7fe68b000640 1 -- 172.21.15.62:0/2835226672 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68419f9a0 con 0x7fe684104010 2024-09-12T01:57:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.519+0000 7fe68b000640 1 -- 172.21.15.62:0/2835226672 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6841a7280 con 0x7fe684104010 2024-09-12T01:57:29.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.520+0000 7fe68b000640 1 -- 172.21.15.62:0/2835226672 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6841043f0 con 0x7fe684104010 2024-09-12T01:57:29.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.522+0000 7fe680c00640 1 -- 172.21.15.62:0/2835226672 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe6740037a0 con 0x7fe684104010 2024-09-12T01:57:29.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.523+0000 7fe680c00640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe6680a2c00 0x7fe6680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:29.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.524+0000 7fe680c00640 1 -- 172.21.15.62:0/2835226672 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fe6740cf680 con 0x7fe684104010 2024-09-12T01:57:29.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.524+0000 7fe683400640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe6680a2c00 0x7fe6680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:29.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.524+0000 7fe683400640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe6680a2c00 0x7fe6680a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe67002a930 tx=0x7fe6700058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:29.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.527+0000 7fe680c00640 1 -- 172.21.15.62:0/2835226672 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe67409c220 con 0x7fe684104010 2024-09-12T01:57:29.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.737+0000 7fe68b000640 1 -- 172.21.15.62:0/2835226672 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe684062630 con 0x7fe6680a2c00 2024-09-12T01:57:29.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.763+0000 7fe680c00640 1 -- 172.21.15.62:0/2835226672 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe684062630 con 0x7fe6680a2c00 2024-09-12T01:57:29.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.765+0000 7fe68b000640 1 -- 172.21.15.62:0/2835226672 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe6680a2c00 msgr2=0x7fe6680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:29.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.765+0000 7fe68b000640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe6680a2c00 0x7fe6680a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe67002a930 tx=0x7fe6700058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:29.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.765+0000 7fe68b000640 1 -- 172.21.15.62:0/2835226672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe684104010 msgr2=0x7fe68419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:29.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.765+0000 7fe68b000640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe684104010 0x7fe68419a700 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe67400e9c0 tx=0x7fe67400ee80 comp rx=0 tx=0).stop 2024-09-12T01:57:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.765+0000 7fe68b000640 1 -- 172.21.15.62:0/2835226672 shutdown_connections 2024-09-12T01:57:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.765+0000 7fe68b000640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe6680a2c00 0x7fe6680a50c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.765+0000 7fe68b000640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe684109140 0x7fe68419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.765+0000 7fe68b000640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6841049c0 0x7fe68419ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.766+0000 7fe68b000640 1 --2- 172.21.15.62:0/2835226672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe684104010 0x7fe68419a700 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.766+0000 7fe68b000640 1 -- 172.21.15.62:0/2835226672 >> 172.21.15.62:0/2835226672 conn(0x7fe6840ffa50 msgr2=0x7fe684100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.766+0000 7fe68b000640 1 -- 172.21.15.62:0/2835226672 shutdown_connections 2024-09-12T01:57:29.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:29.766+0000 7fe68b000640 1 -- 172.21.15.62:0/2835226672 wait complete. 2024-09-12T01:57:30.508 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T01:57:30.886 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:31.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:30 smithi062 ceph-mon[30666]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:31.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:30 smithi062 ceph-mon[30666]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:31.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:30 smithi062 ceph-mon[30666]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T01:57:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.427+0000 7f3290000640 1 -- 172.21.15.62:0/4262448617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3288103ff0 msgr2=0x7f32881043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.427+0000 7f3290000640 1 --2- 172.21.15.62:0/4262448617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3288103ff0 0x7f32881043d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f327c009900 tx=0x7f327c02a410 comp rx=0 tx=0).stop 2024-09-12T01:57:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.427+0000 7f3290000640 1 -- 172.21.15.62:0/4262448617 shutdown_connections 2024-09-12T01:57:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.427+0000 7f3290000640 1 --2- 172.21.15.62:0/4262448617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3288109120 0x7f3288110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.427+0000 7f3290000640 1 --2- 172.21.15.62:0/4262448617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32881049a0 0x7f32881089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.427+0000 7f3290000640 1 --2- 172.21.15.62:0/4262448617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3288103ff0 0x7f32881043d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.427+0000 7f3290000640 1 -- 172.21.15.62:0/4262448617 >> 172.21.15.62:0/4262448617 conn(0x7f32880ffa90 msgr2=0x7f3288101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.427+0000 7f3290000640 1 -- 172.21.15.62:0/4262448617 shutdown_connections 2024-09-12T01:57:31.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.427+0000 7f3290000640 1 -- 172.21.15.62:0/4262448617 wait complete. 2024-09-12T01:57:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.428+0000 7f3290000640 1 Processor -- start 2024-09-12T01:57:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.428+0000 7f3290000640 1 -- start start 2024-09-12T01:57:31.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.428+0000 7f3290000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3288103ff0 0x7f328819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.428+0000 7f3290000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32881049a0 0x7f328819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.428+0000 7f3290000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3288109120 0x7f328819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.428+0000 7f3290000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3288114120 con 0x7f32881049a0 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.428+0000 7f3290000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3288113fa0 con 0x7f3288109120 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.428+0000 7f3290000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f32881142a0 con 0x7f3288103ff0 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328e000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3288109120 0x7f328819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328d600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3288103ff0 0x7f328819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328d600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3288103ff0 0x7f328819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:57448/0 (socket says 172.21.15.62:57448) 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328d600640 1 -- 172.21.15.62:0/1214697273 learned_addr learned my addr 172.21.15.62:0/1214697273 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328e000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3288109120 0x7f328819eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:44208/0 (socket says 172.21.15.62:44208) 2024-09-12T01:57:31.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328cc00640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32881049a0 0x7f328819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:31.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328e000640 1 -- 172.21.15.62:0/1214697273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3288103ff0 msgr2=0x7f328819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:31.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328e000640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3288103ff0 0x7f328819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:31.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328e000640 1 -- 172.21.15.62:0/1214697273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32881049a0 msgr2=0x7f328819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:31.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328e000640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32881049a0 0x7f328819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:31.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.429+0000 7f328e000640 1 -- 172.21.15.62:0/1214697273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328819f590 con 0x7f3288109120 2024-09-12T01:57:31.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.430+0000 7f328e000640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3288109120 0x7f328819eeb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3280009fd0 tx=0x7f328000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:31.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.430+0000 7f3286000640 1 -- 172.21.15.62:0/1214697273 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328000ce20 con 0x7f3288109120 2024-09-12T01:57:31.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.430+0000 7f3286000640 1 -- 172.21.15.62:0/1214697273 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3280005020 con 0x7f3288109120 2024-09-12T01:57:31.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.430+0000 7f3286000640 1 -- 172.21.15.62:0/1214697273 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280010720 con 0x7f3288109120 2024-09-12T01:57:31.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.430+0000 7f3290000640 1 -- 172.21.15.62:0/1214697273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328819f880 con 0x7f3288109120 2024-09-12T01:57:31.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.430+0000 7f3290000640 1 -- 172.21.15.62:0/1214697273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32881a7160 con 0x7f3288109120 2024-09-12T01:57:31.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.431+0000 7f3290000640 1 -- 172.21.15.62:0/1214697273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32881043d0 con 0x7f3288109120 2024-09-12T01:57:31.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.433+0000 7f3286000640 1 -- 172.21.15.62:0/1214697273 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3280005540 con 0x7f3288109120 2024-09-12T01:57:31.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.434+0000 7f3286000640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f32700a2c90 0x7f32700a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:31.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.434+0000 7f3286000640 1 -- 172.21.15.62:0/1214697273 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f32800cfb60 con 0x7f3288109120 2024-09-12T01:57:31.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.435+0000 7f328d600640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f32700a2c90 0x7f32700a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:31.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.435+0000 7f328d600640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f32700a2c90 0x7f32700a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f327c0096c0 tx=0x7f327c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:31.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.436+0000 7f3286000640 1 -- 172.21.15.62:0/1214697273 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f328009c5a0 con 0x7f3288109120 2024-09-12T01:57:31.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:30 smithi107 ceph-mon[35463]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:31.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:30 smithi107 ceph-mon[35463]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:31.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:30 smithi107 ceph-mon[35463]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T01:57:31.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:30 smithi077 ceph-mon[35095]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:31.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:30 smithi077 ceph-mon[35095]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:31.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:30 smithi077 ceph-mon[35095]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T01:57:31.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.649+0000 7f3290000640 1 -- 172.21.15.62:0/1214697273 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f3288062630 con 0x7f32700a2c90 2024-09-12T01:57:31.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.654+0000 7f3286000640 1 -- 172.21.15.62:0/1214697273 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3288062630 con 0x7f32700a2c90 2024-09-12T01:57:31.655 INFO:teuthology.orchestra.run.smithi062.stdout:/volumes/qa/sv_0/f758fb77-29a1-489c-8238-9924fc727006 2024-09-12T01:57:31.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 -- 172.21.15.62:0/1214697273 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f32700a2c90 msgr2=0x7f32700a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:31.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f32700a2c90 0x7f32700a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f327c0096c0 tx=0x7f327c005a20 comp rx=0 tx=0).stop 2024-09-12T01:57:31.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 -- 172.21.15.62:0/1214697273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3288109120 msgr2=0x7f328819eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:31.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3288109120 0x7f328819eeb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3280009fd0 tx=0x7f328000ef10 comp rx=0 tx=0).stop 2024-09-12T01:57:31.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 -- 172.21.15.62:0/1214697273 shutdown_connections 2024-09-12T01:57:31.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f32700a2c90 0x7f32700a5150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:31.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3288109120 0x7f328819eeb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:31.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32881049a0 0x7f328819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:31.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 --2- 172.21.15.62:0/1214697273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3288103ff0 0x7f328819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:31.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 -- 172.21.15.62:0/1214697273 >> 172.21.15.62:0/1214697273 conn(0x7f32880ffa90 msgr2=0x7f3288100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:31.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 -- 172.21.15.62:0/1214697273 shutdown_connections 2024-09-12T01:57:31.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:31.657+0000 7f3290000640 1 -- 172.21.15.62:0/1214697273 wait complete. 2024-09-12T01:57:32.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T01:57:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:33.184 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:32 smithi062 ceph-mon[30666]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 106 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:33.185 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:32 smithi062 ceph-mon[30666]: from='client.24707 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.401+0000 7f5f44800640 1 -- 172.21.15.62:0/3532849566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f3c109120 msgr2=0x7f5f3c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.401+0000 7f5f44800640 1 --2- 172.21.15.62:0/3532849566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f3c109120 0x7f5f3c110ca0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009ca0 tx=0x7f5f3802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.401+0000 7f5f44800640 1 -- 172.21.15.62:0/3532849566 shutdown_connections 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.401+0000 7f5f44800640 1 --2- 172.21.15.62:0/3532849566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f3c109120 0x7f5f3c110ca0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.401+0000 7f5f44800640 1 --2- 172.21.15.62:0/3532849566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f3c1049a0 0x7f5f3c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.401+0000 7f5f44800640 1 --2- 172.21.15.62:0/3532849566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f3c103ff0 0x7f5f3c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.401+0000 7f5f44800640 1 -- 172.21.15.62:0/3532849566 >> 172.21.15.62:0/3532849566 conn(0x7f5f3c0ffa90 msgr2=0x7f5f3c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.401+0000 7f5f44800640 1 -- 172.21.15.62:0/3532849566 shutdown_connections 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.401+0000 7f5f44800640 1 -- 172.21.15.62:0/3532849566 wait complete. 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.403+0000 7f5f44800640 1 Processor -- start 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.403+0000 7f5f44800640 1 -- start start 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.403+0000 7f5f44800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f3c103ff0 0x7f5f3c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.403+0000 7f5f44800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f3c1049a0 0x7f5f3c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.403+0000 7f5f44800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f3c109120 0x7f5f3c19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.403+0000 7f5f44800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c114180 con 0x7f5f3c1049a0 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.403+0000 7f5f44800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c114000 con 0x7f5f3c103ff0 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.403+0000 7f5f44800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c114300 con 0x7f5f3c109120 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f3c1049a0 0x7f5f3c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f3c1049a0 0x7f5f3c19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46162/0 (socket says 172.21.15.62:46162) 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41400640 1 -- 172.21.15.62:0/60043821 learned_addr learned my addr 172.21.15.62:0/60043821 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41e00640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f3c103ff0 0x7f5f3c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f42800640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f3c109120 0x7f5f3c19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41e00640 1 -- 172.21.15.62:0/60043821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f3c109120 msgr2=0x7f5f3c19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41e00640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f3c109120 0x7f5f3c19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41e00640 1 -- 172.21.15.62:0/60043821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f3c1049a0 msgr2=0x7f5f3c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41e00640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f3c1049a0 0x7f5f3c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41e00640 1 -- 172.21.15.62:0/60043821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3c19f550 con 0x7f5f3c103ff0 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41400640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f3c1049a0 0x7f5f3c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.404+0000 7f5f41e00640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f3c103ff0 0x7f5f3c19a5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000e9f0 tx=0x7f5f3000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.405+0000 7f5f36a00640 1 -- 172.21.15.62:0/60043821 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000ccc0 con 0x7f5f3c103ff0 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.405+0000 7f5f36a00640 1 -- 172.21.15.62:0/60043821 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f30010910 con 0x7f5f3c103ff0 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.405+0000 7f5f44800640 1 -- 172.21.15.62:0/60043821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3c19f840 con 0x7f5f3c103ff0 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.405+0000 7f5f36a00640 1 -- 172.21.15.62:0/60043821 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30018960 con 0x7f5f3c103ff0 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.405+0000 7f5f44800640 1 -- 172.21.15.62:0/60043821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f3c1a7120 con 0x7f5f3c103ff0 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.406+0000 7f5f44800640 1 -- 172.21.15.62:0/60043821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f3c1043d0 con 0x7f5f3c103ff0 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.408+0000 7f5f36a00640 1 -- 172.21.15.62:0/60043821 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5f30010ac0 con 0x7f5f3c103ff0 2024-09-12T01:57:33.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.409+0000 7f5f36a00640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f5f240a2c10 0x7f5f240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:33.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.409+0000 7f5f36a00640 1 -- 172.21.15.62:0/60043821 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f5f300cfc70 con 0x7f5f3c103ff0 2024-09-12T01:57:33.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.409+0000 7f5f41400640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f5f240a2c10 0x7f5f240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:33.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.410+0000 7f5f41400640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f5f240a2c10 0x7f5f240a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c10aaf0 tx=0x7f5f2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:33.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.411+0000 7f5f36a00640 1 -- 172.21.15.62:0/60043821 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f3009c060 con 0x7f5f3c103ff0 2024-09-12T01:57:33.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:32 smithi107 ceph-mon[35463]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 106 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:33.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:32 smithi107 ceph-mon[35463]: from='client.24707 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:32 smithi077 ceph-mon[35095]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 106 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:33.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:32 smithi077 ceph-mon[35095]: from='client.24707 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:33.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.630+0000 7f5f44800640 1 -- 172.21.15.62:0/60043821 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5f3c100cc0 con 0x7f5f240a2c10 2024-09-12T01:57:33.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.654+0000 7f5f36a00640 1 -- 172.21.15.62:0/60043821 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5f3c100cc0 con 0x7f5f240a2c10 2024-09-12T01:57:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 -- 172.21.15.62:0/60043821 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f5f240a2c10 msgr2=0x7f5f240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f5f240a2c10 0x7f5f240a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c10aaf0 tx=0x7f5f2c005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 -- 172.21.15.62:0/60043821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f3c103ff0 msgr2=0x7f5f3c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f3c103ff0 0x7f5f3c19a5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000e9f0 tx=0x7f5f3000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 -- 172.21.15.62:0/60043821 shutdown_connections 2024-09-12T01:57:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f5f240a2c10 0x7f5f240a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f3c109120 0x7f5f3c19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f3c1049a0 0x7f5f3c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 --2- 172.21.15.62:0/60043821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f3c103ff0 0x7f5f3c19a5a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:33.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 -- 172.21.15.62:0/60043821 >> 172.21.15.62:0/60043821 conn(0x7f5f3c0ffa90 msgr2=0x7f5f3c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:33.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.656+0000 7f5f44800640 1 -- 172.21.15.62:0/60043821 shutdown_connections 2024-09-12T01:57:33.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:33.657+0000 7f5f44800640 1 -- 172.21.15.62:0/60043821 wait complete. 2024-09-12T01:57:34.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T01:57:34.790 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:35.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:34 smithi062 ceph-mon[30666]: pgmap v328: 129 pgs: 129 active+clean; 606 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.8 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:35.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:34 smithi062 ceph-mon[30666]: from='client.24713 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:35.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.313+0000 7f1ef0e00640 1 -- 172.21.15.62:0/3845811139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eec1049a0 msgr2=0x7f1eec1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:35.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.313+0000 7f1ef0e00640 1 --2- 172.21.15.62:0/3845811139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eec1049a0 0x7f1eec1089f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009900 tx=0x7f1ed802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.313+0000 7f1ef0e00640 1 -- 172.21.15.62:0/3845811139 shutdown_connections 2024-09-12T01:57:35.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.313+0000 7f1ef0e00640 1 --2- 172.21.15.62:0/3845811139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec109120 0x7f1eec110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.313+0000 7f1ef0e00640 1 --2- 172.21.15.62:0/3845811139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eec1049a0 0x7f1eec1089f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.313+0000 7f1ef0e00640 1 --2- 172.21.15.62:0/3845811139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eec103ff0 0x7f1eec1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.313+0000 7f1ef0e00640 1 -- 172.21.15.62:0/3845811139 >> 172.21.15.62:0/3845811139 conn(0x7f1eec0ffa90 msgr2=0x7f1eec101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.313+0000 7f1ef0e00640 1 -- 172.21.15.62:0/3845811139 shutdown_connections 2024-09-12T01:57:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.313+0000 7f1ef0e00640 1 -- 172.21.15.62:0/3845811139 wait complete. 2024-09-12T01:57:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.314+0000 7f1ef0e00640 1 Processor -- start 2024-09-12T01:57:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ef0e00640 1 -- start start 2024-09-12T01:57:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ef0e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec103ff0 0x7f1eec19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ef0e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eec1049a0 0x7f1eec19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ef0e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eec109120 0x7f1eec19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ef0e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec114120 con 0x7f1eec1049a0 2024-09-12T01:57:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ef0e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec113fa0 con 0x7f1eec109120 2024-09-12T01:57:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ef0e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec1142a0 con 0x7f1eec103ff0 2024-09-12T01:57:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ee9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eec1049a0 0x7f1eec19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:35.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ee9e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec103ff0 0x7f1eec19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:35.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ee9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eec1049a0 0x7f1eec19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46168/0 (socket says 172.21.15.62:46168) 2024-09-12T01:57:35.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.315+0000 7f1ee9400640 1 -- 172.21.15.62:0/588694154 learned_addr learned my addr 172.21.15.62:0/588694154 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:35.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.316+0000 7f1eea800640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eec109120 0x7f1eec19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.316+0000 7f1ee9e00640 1 -- 172.21.15.62:0/588694154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eec109120 msgr2=0x7f1eec19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.316+0000 7f1ee9e00640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eec109120 0x7f1eec19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.316+0000 7f1ee9e00640 1 -- 172.21.15.62:0/588694154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eec1049a0 msgr2=0x7f1eec19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.316+0000 7f1ee9e00640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eec1049a0 0x7f1eec19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.316+0000 7f1ee9e00640 1 -- 172.21.15.62:0/588694154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eec19f5d0 con 0x7f1eec103ff0 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.316+0000 7f1ee9400640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eec1049a0 0x7f1eec19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.316+0000 7f1ee9e00640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec103ff0 0x7f1eec19a620 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00e9f0 tx=0x7f1edc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.316+0000 7f1ee2a00640 1 -- 172.21.15.62:0/588694154 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00ccc0 con 0x7f1eec103ff0 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.317+0000 7f1ee2a00640 1 -- 172.21.15.62:0/588694154 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1edc010910 con 0x7f1eec103ff0 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.317+0000 7f1ee2a00640 1 -- 172.21.15.62:0/588694154 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc018800 con 0x7f1eec103ff0 2024-09-12T01:57:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.317+0000 7f1ef0e00640 1 -- 172.21.15.62:0/588694154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eec19f8c0 con 0x7f1eec103ff0 2024-09-12T01:57:35.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.317+0000 7f1ef0e00640 1 -- 172.21.15.62:0/588694154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eec1a71a0 con 0x7f1eec103ff0 2024-09-12T01:57:35.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.318+0000 7f1ef0e00640 1 -- 172.21.15.62:0/588694154 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eec1043d0 con 0x7f1eec103ff0 2024-09-12T01:57:35.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.320+0000 7f1ee2a00640 1 -- 172.21.15.62:0/588694154 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1edc010ac0 con 0x7f1eec103ff0 2024-09-12T01:57:35.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.321+0000 7f1ee2a00640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f1ed00a2c90 0x7f1ed00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:35.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.321+0000 7f1ee2a00640 1 -- 172.21.15.62:0/588694154 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f1edc0cf7d0 con 0x7f1eec103ff0 2024-09-12T01:57:35.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.321+0000 7f1ee9400640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f1ed00a2c90 0x7f1ed00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:35.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.322+0000 7f1ee9400640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f1ed00a2c90 0x7f1ed00a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8031550 tx=0x7f1ed8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:35.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.325+0000 7f1ee2a00640 1 -- 172.21.15.62:0/588694154 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1edc09c210 con 0x7f1eec103ff0 2024-09-12T01:57:35.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:34 smithi107 ceph-mon[35463]: pgmap v328: 129 pgs: 129 active+clean; 606 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.8 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:35.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:34 smithi107 ceph-mon[35463]: from='client.24713 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:35.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:34 smithi077 ceph-mon[35095]: pgmap v328: 129 pgs: 129 active+clean; 606 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.8 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:35.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:34 smithi077 ceph-mon[35095]: from='client.24713 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:35.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.537+0000 7f1ef0e00640 1 -- 172.21.15.62:0/588694154 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f1eec062630 con 0x7f1ed00a2c90 2024-09-12T01:57:35.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.542+0000 7f1ee2a00640 1 -- 172.21.15.62:0/588694154 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1eec062630 con 0x7f1ed00a2c90 2024-09-12T01:57:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:/volumes/qa/sv_1/6ce17497-48d7-412a-802f-1f68aeacf26d 2024-09-12T01:57:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 -- 172.21.15.62:0/588694154 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f1ed00a2c90 msgr2=0x7f1ed00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f1ed00a2c90 0x7f1ed00a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8031550 tx=0x7f1ed8005a20 comp rx=0 tx=0).stop 2024-09-12T01:57:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 -- 172.21.15.62:0/588694154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec103ff0 msgr2=0x7f1eec19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec103ff0 0x7f1eec19a620 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00e9f0 tx=0x7f1edc00edf0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 -- 172.21.15.62:0/588694154 shutdown_connections 2024-09-12T01:57:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f1ed00a2c90 0x7f1ed00a5150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eec109120 0x7f1eec19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eec1049a0 0x7f1eec19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 --2- 172.21.15.62:0/588694154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1eec103ff0 0x7f1eec19a620 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:35.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 -- 172.21.15.62:0/588694154 >> 172.21.15.62:0/588694154 conn(0x7f1eec0ffa90 msgr2=0x7f1eec100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:35.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 -- 172.21.15.62:0/588694154 shutdown_connections 2024-09-12T01:57:35.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:35.544+0000 7f1ef0e00640 1 -- 172.21.15.62:0/588694154 wait complete. 2024-09-12T01:57:36.262 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:57:36.638 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:37.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:36 smithi062 ceph-mon[30666]: from='client.24751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:37.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:36 smithi062 ceph-mon[30666]: pgmap v329: 129 pgs: 129 active+clean; 606 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.9 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.217+0000 7f0517200640 1 -- 172.21.15.62:0/2663212283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05181047e0 msgr2=0x7f0518108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.217+0000 7f0517200640 1 --2- 172.21.15.62:0/2663212283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05181047e0 0x7f0518108830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0504009900 tx=0x7f050402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.217+0000 7f0517200640 1 -- 172.21.15.62:0/2663212283 shutdown_connections 2024-09-12T01:57:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.217+0000 7f0517200640 1 --2- 172.21.15.62:0/2663212283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0518108f60 0x7f0518110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.217+0000 7f0517200640 1 --2- 172.21.15.62:0/2663212283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05181047e0 0x7f0518108830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.217+0000 7f0517200640 1 --2- 172.21.15.62:0/2663212283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0518103e30 0x7f0518104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.217+0000 7f0517200640 1 -- 172.21.15.62:0/2663212283 >> 172.21.15.62:0/2663212283 conn(0x7f05180ff910 msgr2=0x7f0518101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.217+0000 7f0517200640 1 -- 172.21.15.62:0/2663212283 shutdown_connections 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.217+0000 7f0517200640 1 -- 172.21.15.62:0/2663212283 wait complete. 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.218+0000 7f0517200640 1 Processor -- start 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.218+0000 7f0517200640 1 -- start start 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0517200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0518103e30 0x7f051819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0517200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05181047e0 0x7f051819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0517200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0518108f60 0x7f051819ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0517200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0518114010 con 0x7f05181047e0 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0517200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0518113e90 con 0x7f0518108f60 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0517200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0518114190 con 0x7f0518103e30 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0515400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05181047e0 0x7f051819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0515400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05181047e0 0x7f051819aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46182/0 (socket says 172.21.15.62:46182) 2024-09-12T01:57:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0515400640 1 -- 172.21.15.62:0/1270259131 learned_addr learned my addr 172.21.15.62:0/1270259131 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0515e00640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0518103e30 0x7f051819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0516800640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0518108f60 0x7f051819ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0515400640 1 -- 172.21.15.62:0/1270259131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0518103e30 msgr2=0x7f051819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0515400640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0518103e30 0x7f051819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0515400640 1 -- 172.21.15.62:0/1270259131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0518108f60 msgr2=0x7f051819ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0515400640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0518108f60 0x7f051819ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0515400640 1 -- 172.21.15.62:0/1270259131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051819f4c0 con 0x7f05181047e0 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.219+0000 7f0515e00640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0518103e30 0x7f051819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.220+0000 7f0515400640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05181047e0 0x7f051819aa50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0504004770 tx=0x7f0504003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.220+0000 7f050ea00640 1 -- 172.21.15.62:0/1270259131 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050403f070 con 0x7f05181047e0 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.220+0000 7f050ea00640 1 -- 172.21.15.62:0/1270259131 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0504031ca0 con 0x7f05181047e0 2024-09-12T01:57:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.220+0000 7f050ea00640 1 -- 172.21.15.62:0/1270259131 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504035030 con 0x7f05181047e0 2024-09-12T01:57:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.220+0000 7f0517200640 1 -- 172.21.15.62:0/1270259131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051819f750 con 0x7f05181047e0 2024-09-12T01:57:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.220+0000 7f0517200640 1 -- 172.21.15.62:0/1270259131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051819fbe0 con 0x7f05181047e0 2024-09-12T01:57:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.221+0000 7f0517200640 1 -- 172.21.15.62:0/1270259131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0518105310 con 0x7f05181047e0 2024-09-12T01:57:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.223+0000 7f050ea00640 1 -- 172.21.15.62:0/1270259131 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0504042070 con 0x7f05181047e0 2024-09-12T01:57:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.224+0000 7f050ea00640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04fc0a2c90 0x7f04fc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.224+0000 7f050ea00640 1 -- 172.21.15.62:0/1270259131 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f05040efd90 con 0x7f05181047e0 2024-09-12T01:57:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.225+0000 7f0515e00640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04fc0a2c90 0x7f04fc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.225+0000 7f0515e00640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04fc0a2c90 0x7f04fc0a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f05080058c0 tx=0x7f0508005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.229+0000 7f050ea00640 1 -- 172.21.15.62:0/1270259131 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05040bc7d0 con 0x7f05181047e0 2024-09-12T01:57:37.255 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:36 smithi107 ceph-mon[35463]: from='client.24751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:37.256 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:36 smithi107 ceph-mon[35463]: pgmap v329: 129 pgs: 129 active+clean; 606 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.9 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:37.266 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:36 smithi077 ceph-mon[35095]: from='client.24751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:57:37.266 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:36 smithi077 ceph-mon[35095]: pgmap v329: 129 pgs: 129 active+clean; 606 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.9 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.450+0000 7f0517200640 1 -- 172.21.15.62:0/1270259131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f051802d7c0 con 0x7f05181047e0 2024-09-12T01:57:37.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.451+0000 7f050ea00640 1 -- 172.21.15.62:0/1270259131 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11851 (secure 0 0 0) 0x7f05040bc0d0 con 0x7f05181047e0 2024-09-12T01:57:37.452 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:37.452 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"btime":"2024-09-12T01:57:25:959947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:56:41.854823+0000","modified":"2024-09-12T01:57:25.905993+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24529":{"gid":24529,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24530]},"id":1}]} 2024-09-12T01:57:37.452 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2024-09-12T01:57:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.453+0000 7f0517200640 1 -- 172.21.15.62:0/1270259131 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04fc0a2c90 msgr2=0x7f04fc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.453+0000 7f0517200640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04fc0a2c90 0x7f04fc0a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f05080058c0 tx=0x7f0508005850 comp rx=0 tx=0).stop 2024-09-12T01:57:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.453+0000 7f0517200640 1 -- 172.21.15.62:0/1270259131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05181047e0 msgr2=0x7f051819aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.453+0000 7f0517200640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05181047e0 0x7f051819aa50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0504004770 tx=0x7f0504003c10 comp rx=0 tx=0).stop 2024-09-12T01:57:37.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.454+0000 7f0517200640 1 -- 172.21.15.62:0/1270259131 shutdown_connections 2024-09-12T01:57:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.454+0000 7f0517200640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04fc0a2c90 0x7f04fc0a5150 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.454+0000 7f0517200640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0518108f60 0x7f051819ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.454+0000 7f0517200640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05181047e0 0x7f051819aa50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.454+0000 7f0517200640 1 --2- 172.21.15.62:0/1270259131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0518103e30 0x7f051819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.454+0000 7f0517200640 1 -- 172.21.15.62:0/1270259131 >> 172.21.15.62:0/1270259131 conn(0x7f05180ff910 msgr2=0x7f0518100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.454+0000 7f0517200640 1 -- 172.21.15.62:0/1270259131 shutdown_connections 2024-09-12T01:57:37.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:37.454+0000 7f0517200640 1 -- 172.21.15.62:0/1270259131 wait complete. 2024-09-12T01:57:38.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:37 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1270259131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:38.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:57:38.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:37 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1270259131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:38.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:37 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1270259131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:38.542 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.040+0000 7f0452600640 1 -- 172.21.15.62:0/565820215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f044c1049a0 msgr2=0x7f044c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.040+0000 7f0452600640 1 --2- 172.21.15.62:0/565820215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f044c1049a0 0x7f044c1089f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0438009900 tx=0x7f043802a400 comp rx=0 tx=0).stop 2024-09-12T01:57:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.040+0000 7f0452600640 1 -- 172.21.15.62:0/565820215 shutdown_connections 2024-09-12T01:57:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.040+0000 7f0452600640 1 --2- 172.21.15.62:0/565820215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c109120 0x7f044c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.040+0000 7f0452600640 1 --2- 172.21.15.62:0/565820215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f044c1049a0 0x7f044c1089f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.040+0000 7f0452600640 1 --2- 172.21.15.62:0/565820215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f044c103ff0 0x7f044c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.040+0000 7f0452600640 1 -- 172.21.15.62:0/565820215 >> 172.21.15.62:0/565820215 conn(0x7f044c0ffa90 msgr2=0x7f044c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.040+0000 7f0452600640 1 -- 172.21.15.62:0/565820215 shutdown_connections 2024-09-12T01:57:39.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.041+0000 7f0452600640 1 -- 172.21.15.62:0/565820215 wait complete. 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.041+0000 7f0452600640 1 Processor -- start 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f0452600640 1 -- start start 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f0452600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f044c103ff0 0x7f044c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f0452600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f044c1049a0 0x7f044c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f0452600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c109120 0x7f044c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f0452600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f044c114140 con 0x7f044c1049a0 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f0452600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f044c113fc0 con 0x7f044c109120 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f0452600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f044c1142c0 con 0x7f044c103ff0 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f044b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f044c103ff0 0x7f044c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f044b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f044c103ff0 0x7f044c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:53406/0 (socket says 172.21.15.62:53406) 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f044be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c109120 0x7f044c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f044b400640 1 -- 172.21.15.62:0/78745620 learned_addr learned my addr 172.21.15.62:0/78745620 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.042+0000 7f044aa00640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f044c1049a0 0x7f044c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.043+0000 7f044b400640 1 -- 172.21.15.62:0/78745620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c109120 msgr2=0x7f044c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.043+0000 7f044b400640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c109120 0x7f044c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.043+0000 7f044b400640 1 -- 172.21.15.62:0/78745620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f044c1049a0 msgr2=0x7f044c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.043+0000 7f044b400640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f044c1049a0 0x7f044c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.043+0000 7f044b400640 1 -- 172.21.15.62:0/78745620 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c19f5d0 con 0x7f044c103ff0 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.043+0000 7f044be00640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c109120 0x7f044c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.043+0000 7f044b400640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f044c103ff0 0x7f044c19a620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f043c00e9f0 tx=0x7f043c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.044+0000 7f0443e00640 1 -- 172.21.15.62:0/78745620 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c00cd80 con 0x7f044c103ff0 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.044+0000 7f0443e00640 1 -- 172.21.15.62:0/78745620 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043c005500 con 0x7f044c103ff0 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.044+0000 7f0452600640 1 -- 172.21.15.62:0/78745620 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c19f8c0 con 0x7f044c103ff0 2024-09-12T01:57:39.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.044+0000 7f0443e00640 1 -- 172.21.15.62:0/78745620 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c010690 con 0x7f044c103ff0 2024-09-12T01:57:39.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.044+0000 7f0452600640 1 -- 172.21.15.62:0/78745620 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c1a71a0 con 0x7f044c103ff0 2024-09-12T01:57:39.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.045+0000 7f0452600640 1 -- 172.21.15.62:0/78745620 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044c1043d0 con 0x7f044c103ff0 2024-09-12T01:57:39.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.047+0000 7f0443e00640 1 -- 172.21.15.62:0/78745620 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f043c0046c0 con 0x7f044c103ff0 2024-09-12T01:57:39.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.048+0000 7f0443e00640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04300a2c90 0x7f04300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.049+0000 7f0443e00640 1 -- 172.21.15.62:0/78745620 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f043c0cf920 con 0x7f044c103ff0 2024-09-12T01:57:39.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.049+0000 7f044aa00640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04300a2c90 0x7f04300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.050+0000 7f044aa00640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04300a2c90 0x7f04300a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0438009230 tx=0x7f04380058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.050+0000 7f0443e00640 1 -- 172.21.15.62:0/78745620 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f043c09c360 con 0x7f044c103ff0 2024-09-12T01:57:39.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.238+0000 7f0452600640 1 -- 172.21.15.62:0/78745620 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f044c10c3c0 con 0x7f044c103ff0 2024-09-12T01:57:39.239 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:38 smithi062 ceph-mon[30666]: pgmap v330: 129 pgs: 129 active+clean; 632 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.4 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:39.239 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:38 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:57:39.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.240+0000 7f0443e00640 1 -- 172.21.15.62:0/78745620 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24723 (secure 0 0 0) 0x7f043c09bc60 con 0x7f044c103ff0 2024-09-12T01:57:39.241 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:39.241 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":92,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:57:22.942056+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.243+0000 7f0452600640 1 -- 172.21.15.62:0/78745620 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04300a2c90 msgr2=0x7f04300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.243+0000 7f0452600640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04300a2c90 0x7f04300a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0438009230 tx=0x7f04380058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.243+0000 7f0452600640 1 -- 172.21.15.62:0/78745620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f044c103ff0 msgr2=0x7f044c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.243+0000 7f0452600640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f044c103ff0 0x7f044c19a620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f043c00e9f0 tx=0x7f043c00edf0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.243+0000 7f0452600640 1 -- 172.21.15.62:0/78745620 shutdown_connections 2024-09-12T01:57:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.244+0000 7f0452600640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f04300a2c90 0x7f04300a5150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.244+0000 7f0452600640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c109120 0x7f044c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.244+0000 7f0452600640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f044c1049a0 0x7f044c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.244+0000 7f0452600640 1 --2- 172.21.15.62:0/78745620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f044c103ff0 0x7f044c19a620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.244+0000 7f0452600640 1 -- 172.21.15.62:0/78745620 >> 172.21.15.62:0/78745620 conn(0x7f044c0ffa90 msgr2=0x7f044c100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.244+0000 7f0452600640 1 -- 172.21.15.62:0/78745620 shutdown_connections 2024-09-12T01:57:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:39.244+0000 7f0452600640 1 -- 172.21.15.62:0/78745620 wait complete. 2024-09-12T01:57:39.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:38 smithi107 ceph-mon[35463]: pgmap v330: 129 pgs: 129 active+clean; 632 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.4 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:39.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:38 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:57:39.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:38 smithi077 ceph-mon[35095]: pgmap v330: 129 pgs: 129 active+clean; 632 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.4 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:57:39.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:38 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:57:39.935 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:57:39.935 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:57:40.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:40 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/78745620' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:40.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:39 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/78745620' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:40.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:40 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/78745620' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:41.072 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:41.513 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:41 smithi062 ceph-mon[30666]: pgmap v331: 129 pgs: 129 active+clean; 632 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-09-12T01:57:41.514 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:41 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.514 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:41 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.514 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:41 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.514 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:41 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.627+0000 7f448d800640 1 -- 172.21.15.62:0/4245555769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4488108f60 msgr2=0x7f4488110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.627+0000 7f448d800640 1 --2- 172.21.15.62:0/4245555769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4488108f60 0x7f4488110ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4480009ca0 tx=0x7f448002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.627+0000 7f448d800640 1 -- 172.21.15.62:0/4245555769 shutdown_connections 2024-09-12T01:57:41.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.627+0000 7f448d800640 1 --2- 172.21.15.62:0/4245555769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4488108f60 0x7f4488110ae0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.627+0000 7f448d800640 1 --2- 172.21.15.62:0/4245555769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44881047e0 0x7f4488108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.627+0000 7f448d800640 1 --2- 172.21.15.62:0/4245555769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4488103e30 0x7f4488104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.627+0000 7f448d800640 1 -- 172.21.15.62:0/4245555769 >> 172.21.15.62:0/4245555769 conn(0x7f44880ff910 msgr2=0x7f4488101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.628+0000 7f448d800640 1 -- 172.21.15.62:0/4245555769 shutdown_connections 2024-09-12T01:57:41.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.628+0000 7f448d800640 1 -- 172.21.15.62:0/4245555769 wait complete. 2024-09-12T01:57:41.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f448d800640 1 Processor -- start 2024-09-12T01:57:41.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f448d800640 1 -- start start 2024-09-12T01:57:41.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f448d800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4488103e30 0x7f448819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f448d800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44881047e0 0x7f448819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f448d800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4488108f60 0x7f448819ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f448d800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4488114010 con 0x7f44881047e0 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f448d800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4488113e90 con 0x7f4488103e30 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f448d800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4488114190 con 0x7f4488108f60 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f4487e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4488103e30 0x7f448819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f4487e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4488103e30 0x7f448819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:38046/0 (socket says 172.21.15.62:38046) 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.629+0000 7f4487e00640 1 -- 172.21.15.62:0/541835327 learned_addr learned my addr 172.21.15.62:0/541835327 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f447fe00640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44881047e0 0x7f448819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f448ce00640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4488108f60 0x7f448819ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f4487e00640 1 -- 172.21.15.62:0/541835327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4488108f60 msgr2=0x7f448819ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f4487e00640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4488108f60 0x7f448819ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f4487e00640 1 -- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44881047e0 msgr2=0x7f448819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f4487e00640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44881047e0 0x7f448819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f4487e00640 1 -- 172.21.15.62:0/541835327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448819f3c0 con 0x7f4488103e30 2024-09-12T01:57:41.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f447fe00640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44881047e0 0x7f448819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:41.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f4487e00640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4488103e30 0x7f448819a410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f447800e9f0 tx=0x7f447800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f4485600640 1 -- 172.21.15.62:0/541835327 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447800cd80 con 0x7f4488103e30 2024-09-12T01:57:41.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f4485600640 1 -- 172.21.15.62:0/541835327 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4478010910 con 0x7f4488103e30 2024-09-12T01:57:41.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.630+0000 7f4485600640 1 -- 172.21.15.62:0/541835327 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478018990 con 0x7f4488103e30 2024-09-12T01:57:41.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.631+0000 7f448d800640 1 -- 172.21.15.62:0/541835327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448819f6b0 con 0x7f4488103e30 2024-09-12T01:57:41.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.631+0000 7f448d800640 1 -- 172.21.15.62:0/541835327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44881a6f90 con 0x7f4488103e30 2024-09-12T01:57:41.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.632+0000 7f448d800640 1 -- 172.21.15.62:0/541835327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4488105310 con 0x7f4488103e30 2024-09-12T01:57:41.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.634+0000 7f4485600640 1 -- 172.21.15.62:0/541835327 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4478010ac0 con 0x7f4488103e30 2024-09-12T01:57:41.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.636+0000 7f4485600640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f446c0a2c10 0x7f446c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.636+0000 7f4485600640 1 -- 172.21.15.62:0/541835327 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f44780cff70 con 0x7f4488103e30 2024-09-12T01:57:41.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.636+0000 7f447fe00640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f446c0a2c10 0x7f446c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.637+0000 7f447fe00640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f446c0a2c10 0x7f446c0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f44880ffd30 tx=0x7f4470005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.637+0000 7f4485600640 1 -- 172.21.15.62:0/541835327 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f447809c9b0 con 0x7f4488103e30 2024-09-12T01:57:41.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:41 smithi107 ceph-mon[35463]: pgmap v331: 129 pgs: 129 active+clean; 632 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-09-12T01:57:41.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:41 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:41 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:41 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:41 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:41 smithi077 ceph-mon[35095]: pgmap v331: 129 pgs: 129 active+clean; 632 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-09-12T01:57:41.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:41 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:41 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:41 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:41 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:41.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.868+0000 7f448d800640 1 -- 172.21.15.62:0/541835327 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f448810c1a0 con 0x7f446c0a2c10 2024-09-12T01:57:41.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.879+0000 7f4485600640 1 -- 172.21.15.62:0/541835327 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340277 (secure 0 0 0) 0x7f448810c1a0 con 0x7f446c0a2c10 2024-09-12T01:57:41.885 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:41.887 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 -- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f446c0a2c10 msgr2=0x7f446c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f446c0a2c10 0x7f446c0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f44880ffd30 tx=0x7f4470005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 -- 172.21.15.62:0/541835327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4488103e30 msgr2=0x7f448819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4488103e30 0x7f448819a410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f447800e9f0 tx=0x7f447800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 -- 172.21.15.62:0/541835327 shutdown_connections 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f446c0a2c10 0x7f446c0a50d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4488108f60 0x7f448819ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44881047e0 0x7f448819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 --2- 172.21.15.62:0/541835327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4488103e30 0x7f448819a410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 -- 172.21.15.62:0/541835327 >> 172.21.15.62:0/541835327 conn(0x7f44880ff910 msgr2=0x7f4488100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 -- 172.21.15.62:0/541835327 shutdown_connections 2024-09-12T01:57:41.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:41.885+0000 7f448d800640 1 -- 172.21.15.62:0/541835327 wait complete. 2024-09-12T01:57:42.624 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-12T01:57:41.552302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646863,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":175,"num_read_kb":195,"num_write":264,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371700,"kb_used_data":14120,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124570124,"statfs":{"total":1151940427776,"available":1151559806976,"internally_reserved":0,"allocated":14458880,"data_stored":8140007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51853,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":62,"num_write":34,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003611"},"pg_stats":[{"pgid":"2.1f","version":"84'4","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956758+0000","last_change":"2024-09-12T01:56:37.753384+0000","last_active":"2024-09-12T01:57:22.956758+0000","last_peered":"2024-09-12T01:57:22.956758+0000","last_clean":"2024-09-12T01:57:22.956758+0000","last_became_active":"2024-09-12T01:56:37.751999+0000","last_became_peered":"2024-09-12T01:56:37.751999+0000","last_unstale":"2024-09-12T01:57:22.956758+0000","last_undegraded":"2024-09-12T01:57:22.956758+0000","last_fullsized":"2024-09-12T01:57:22.956758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:21.459291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482775+0000","last_change":"2024-09-12T01:57:23.481994+0000","last_active":"2024-09-12T01:57:23.482775+0000","last_peered":"2024-09-12T01:57:23.482775+0000","last_clean":"2024-09-12T01:57:23.482775+0000","last_became_active":"2024-09-12T01:57:23.481613+0000","last_became_peered":"2024-09-12T01:57:23.481613+0000","last_unstale":"2024-09-12T01:57:23.482775+0000","last_undegraded":"2024-09-12T01:57:23.482775+0000","last_fullsized":"2024-09-12T01:57:23.482775+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:30.571049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951372+0000","last_change":"2024-09-12T01:56:49.873220+0000","last_active":"2024-09-12T01:57:22.951372+0000","last_peered":"2024-09-12T01:57:22.951372+0000","last_clean":"2024-09-12T01:57:22.951372+0000","last_became_active":"2024-09-12T01:56:49.872786+0000","last_became_peered":"2024-09-12T01:56:49.872786+0000","last_unstale":"2024-09-12T01:57:22.951372+0000","last_undegraded":"2024-09-12T01:57:22.951372+0000","last_fullsized":"2024-09-12T01:57:22.951372+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:06.588088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946819+0000","last_change":"2024-09-12T01:56:38.175159+0000","last_active":"2024-09-12T01:57:22.946819+0000","last_peered":"2024-09-12T01:57:22.946819+0000","last_clean":"2024-09-12T01:57:22.946819+0000","last_became_active":"2024-09-12T01:56:38.174792+0000","last_became_peered":"2024-09-12T01:56:38.174792+0000","last_unstale":"2024-09-12T01:57:22.946819+0000","last_undegraded":"2024-09-12T01:57:22.946819+0000","last_fullsized":"2024-09-12T01:57:22.946819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.355819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949796+0000","last_change":"2024-09-12T01:56:40.816906+0000","last_active":"2024-09-12T01:57:22.949796+0000","last_peered":"2024-09-12T01:57:22.949796+0000","last_clean":"2024-09-12T01:57:22.949796+0000","last_became_active":"2024-09-12T01:56:40.816197+0000","last_became_peered":"2024-09-12T01:56:40.816197+0000","last_unstale":"2024-09-12T01:57:22.949796+0000","last_undegraded":"2024-09-12T01:57:22.949796+0000","last_fullsized":"2024-09-12T01:57:22.949796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:39.033451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946641+0000","last_change":"2024-09-12T01:56:49.875694+0000","last_active":"2024-09-12T01:57:22.946641+0000","last_peered":"2024-09-12T01:57:22.946641+0000","last_clean":"2024-09-12T01:57:22.946641+0000","last_became_active":"2024-09-12T01:56:49.875226+0000","last_became_peered":"2024-09-12T01:56:49.875226+0000","last_unstale":"2024-09-12T01:57:22.946641+0000","last_undegraded":"2024-09-12T01:57:22.946641+0000","last_fullsized":"2024-09-12T01:57:22.946641+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:54.025926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946757+0000","last_change":"2024-09-12T01:56:37.750494+0000","last_active":"2024-09-12T01:57:22.946757+0000","last_peered":"2024-09-12T01:57:22.946757+0000","last_clean":"2024-09-12T01:57:22.946757+0000","last_became_active":"2024-09-12T01:56:37.750115+0000","last_became_peered":"2024-09-12T01:56:37.750115+0000","last_unstale":"2024-09-12T01:57:22.946757+0000","last_undegraded":"2024-09-12T01:57:22.946757+0000","last_fullsized":"2024-09-12T01:57:22.946757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:25.632133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951175+0000","last_change":"2024-09-12T01:56:40.798528+0000","last_active":"2024-09-12T01:57:22.951175+0000","last_peered":"2024-09-12T01:57:22.951175+0000","last_clean":"2024-09-12T01:57:22.951175+0000","last_became_active":"2024-09-12T01:56:40.798192+0000","last_became_peered":"2024-09-12T01:56:40.798192+0000","last_unstale":"2024-09-12T01:57:22.951175+0000","last_undegraded":"2024-09-12T01:57:22.951175+0000","last_fullsized":"2024-09-12T01:57:22.951175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:43.533060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482228+0000","last_change":"2024-09-12T01:57:23.482228+0000","last_active":"2024-09-12T01:57:23.482228+0000","last_peered":"2024-09-12T01:57:23.482228+0000","last_clean":"2024-09-12T01:57:23.482228+0000","last_became_active":"2024-09-12T01:57:23.481845+0000","last_became_peered":"2024-09-12T01:57:23.481845+0000","last_unstale":"2024-09-12T01:57:23.482228+0000","last_undegraded":"2024-09-12T01:57:23.482228+0000","last_fullsized":"2024-09-12T01:57:23.482228+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:01.804914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946568+0000","last_change":"2024-09-12T01:56:37.747071+0000","last_active":"2024-09-12T01:57:22.946568+0000","last_peered":"2024-09-12T01:57:22.946568+0000","last_clean":"2024-09-12T01:57:22.946568+0000","last_became_active":"2024-09-12T01:56:37.746729+0000","last_became_peered":"2024-09-12T01:56:37.746729+0000","last_unstale":"2024-09-12T01:57:22.946568+0000","last_undegraded":"2024-09-12T01:57:22.946568+0000","last_fullsized":"2024-09-12T01:57:22.946568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:43.361782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481674+0000","last_change":"2024-09-12T01:56:40.799328+0000","last_active":"2024-09-12T01:57:23.481674+0000","last_peered":"2024-09-12T01:57:23.481674+0000","last_clean":"2024-09-12T01:57:23.481674+0000","last_became_active":"2024-09-12T01:56:40.798817+0000","last_became_peered":"2024-09-12T01:56:40.798817+0000","last_unstale":"2024-09-12T01:57:23.481674+0000","last_undegraded":"2024-09-12T01:57:23.481674+0000","last_fullsized":"2024-09-12T01:57:23.481674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:11.020387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946782+0000","last_change":"2024-09-12T01:56:49.862705+0000","last_active":"2024-09-12T01:57:22.946782+0000","last_peered":"2024-09-12T01:57:22.946782+0000","last_clean":"2024-09-12T01:57:22.946782+0000","last_became_active":"2024-09-12T01:56:49.862339+0000","last_became_peered":"2024-09-12T01:56:49.862339+0000","last_unstale":"2024-09-12T01:57:22.946782+0000","last_undegraded":"2024-09-12T01:57:22.946782+0000","last_fullsized":"2024-09-12T01:57:22.946782+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:07.418851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949948+0000","last_change":"2024-09-12T01:56:40.802464+0000","last_active":"2024-09-12T01:57:22.949948+0000","last_peered":"2024-09-12T01:57:22.949948+0000","last_clean":"2024-09-12T01:57:22.949948+0000","last_became_active":"2024-09-12T01:56:40.802058+0000","last_became_peered":"2024-09-12T01:56:40.802058+0000","last_unstale":"2024-09-12T01:57:22.949948+0000","last_undegraded":"2024-09-12T01:57:22.949948+0000","last_fullsized":"2024-09-12T01:57:22.949948+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:01.915067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.960107+0000","last_change":"2024-09-12T01:57:22.959598+0000","last_active":"2024-09-12T01:57:22.960107+0000","last_peered":"2024-09-12T01:57:22.960107+0000","last_clean":"2024-09-12T01:57:22.960107+0000","last_became_active":"2024-09-12T01:57:22.956659+0000","last_became_peered":"2024-09-12T01:57:22.956659+0000","last_unstale":"2024-09-12T01:57:22.960107+0000","last_undegraded":"2024-09-12T01:57:22.960107+0000","last_fullsized":"2024-09-12T01:57:22.960107+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.838889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947196+0000","last_change":"2024-09-12T01:56:49.881126+0000","last_active":"2024-09-12T01:57:22.947196+0000","last_peered":"2024-09-12T01:57:22.947196+0000","last_clean":"2024-09-12T01:57:22.947196+0000","last_became_active":"2024-09-12T01:56:49.880750+0000","last_became_peered":"2024-09-12T01:56:49.880750+0000","last_unstale":"2024-09-12T01:57:22.947196+0000","last_undegraded":"2024-09-12T01:57:22.947196+0000","last_fullsized":"2024-09-12T01:57:22.947196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:08.105160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946162+0000","last_change":"2024-09-12T01:56:40.807475+0000","last_active":"2024-09-12T01:57:22.946162+0000","last_peered":"2024-09-12T01:57:22.946162+0000","last_clean":"2024-09-12T01:57:22.946162+0000","last_became_active":"2024-09-12T01:56:40.806943+0000","last_became_peered":"2024-09-12T01:56:40.806943+0000","last_unstale":"2024-09-12T01:57:22.946162+0000","last_undegraded":"2024-09-12T01:57:22.946162+0000","last_fullsized":"2024-09-12T01:57:22.946162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:28.021204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951447+0000","last_change":"2024-09-12T01:56:37.752714+0000","last_active":"2024-09-12T01:57:22.951447+0000","last_peered":"2024-09-12T01:57:22.951447+0000","last_clean":"2024-09-12T01:57:22.951447+0000","last_became_active":"2024-09-12T01:56:37.752401+0000","last_became_peered":"2024-09-12T01:56:37.752401+0000","last_unstale":"2024-09-12T01:57:22.951447+0000","last_undegraded":"2024-09-12T01:57:22.951447+0000","last_fullsized":"2024-09-12T01:57:22.951447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:06.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947240+0000","last_change":"2024-09-12T01:56:49.876369+0000","last_active":"2024-09-12T01:57:22.947240+0000","last_peered":"2024-09-12T01:57:22.947240+0000","last_clean":"2024-09-12T01:57:22.947240+0000","last_became_active":"2024-09-12T01:56:49.875573+0000","last_became_peered":"2024-09-12T01:56:49.875573+0000","last_unstale":"2024-09-12T01:57:22.947240+0000","last_undegraded":"2024-09-12T01:57:22.947240+0000","last_fullsized":"2024-09-12T01:57:22.947240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:43.942369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947776+0000","last_change":"2024-09-12T01:56:40.807316+0000","last_active":"2024-09-12T01:57:22.947776+0000","last_peered":"2024-09-12T01:57:22.947776+0000","last_clean":"2024-09-12T01:57:22.947776+0000","last_became_active":"2024-09-12T01:56:40.806978+0000","last_became_peered":"2024-09-12T01:56:40.806978+0000","last_unstale":"2024-09-12T01:57:22.947776+0000","last_undegraded":"2024-09-12T01:57:22.947776+0000","last_fullsized":"2024-09-12T01:57:22.947776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:21.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946121+0000","last_change":"2024-09-12T01:56:37.752818+0000","last_active":"2024-09-12T01:57:22.946121+0000","last_peered":"2024-09-12T01:57:22.946121+0000","last_clean":"2024-09-12T01:57:22.946121+0000","last_became_active":"2024-09-12T01:56:37.752484+0000","last_became_peered":"2024-09-12T01:56:37.752484+0000","last_unstale":"2024-09-12T01:57:22.946121+0000","last_undegraded":"2024-09-12T01:57:22.946121+0000","last_fullsized":"2024-09-12T01:57:22.946121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.916149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956416+0000","last_change":"2024-09-12T01:56:49.878089+0000","last_active":"2024-09-12T01:57:22.956416+0000","last_peered":"2024-09-12T01:57:22.956416+0000","last_clean":"2024-09-12T01:57:22.956416+0000","last_became_active":"2024-09-12T01:56:49.875070+0000","last_became_peered":"2024-09-12T01:56:49.875070+0000","last_unstale":"2024-09-12T01:57:22.956416+0000","last_undegraded":"2024-09-12T01:57:22.956416+0000","last_fullsized":"2024-09-12T01:57:22.956416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:33.106652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946096+0000","last_change":"2024-09-12T01:56:40.797909+0000","last_active":"2024-09-12T01:57:22.946096+0000","last_peered":"2024-09-12T01:57:22.946096+0000","last_clean":"2024-09-12T01:57:22.946096+0000","last_became_active":"2024-09-12T01:56:40.797534+0000","last_became_peered":"2024-09-12T01:56:40.797534+0000","last_unstale":"2024-09-12T01:57:22.946096+0000","last_undegraded":"2024-09-12T01:57:22.946096+0000","last_fullsized":"2024-09-12T01:57:22.946096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:57.262669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950706+0000","last_change":"2024-09-12T01:56:38.176597+0000","last_active":"2024-09-12T01:57:22.950706+0000","last_peered":"2024-09-12T01:57:22.950706+0000","last_clean":"2024-09-12T01:57:22.950706+0000","last_became_active":"2024-09-12T01:56:38.176225+0000","last_became_peered":"2024-09-12T01:56:38.176225+0000","last_unstale":"2024-09-12T01:57:22.950706+0000","last_undegraded":"2024-09-12T01:57:22.950706+0000","last_fullsized":"2024-09-12T01:57:22.950706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:51.401286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947316+0000","last_change":"2024-09-12T01:56:49.881191+0000","last_active":"2024-09-12T01:57:22.947316+0000","last_peered":"2024-09-12T01:57:22.947316+0000","last_clean":"2024-09-12T01:57:22.947316+0000","last_became_active":"2024-09-12T01:56:49.880737+0000","last_became_peered":"2024-09-12T01:56:49.880737+0000","last_unstale":"2024-09-12T01:57:22.947316+0000","last_undegraded":"2024-09-12T01:57:22.947316+0000","last_fullsized":"2024-09-12T01:57:22.947316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:33.842527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949625+0000","last_change":"2024-09-12T01:56:40.806688+0000","last_active":"2024-09-12T01:57:22.949625+0000","last_peered":"2024-09-12T01:57:22.949625+0000","last_clean":"2024-09-12T01:57:22.949625+0000","last_became_active":"2024-09-12T01:56:40.806221+0000","last_became_peered":"2024-09-12T01:56:40.806221+0000","last_unstale":"2024-09-12T01:57:22.949625+0000","last_undegraded":"2024-09-12T01:57:22.949625+0000","last_fullsized":"2024-09-12T01:57:22.949625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.888750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'2","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947646+0000","last_change":"2024-09-12T01:56:37.882612+0000","last_active":"2024-09-12T01:57:22.947646+0000","last_peered":"2024-09-12T01:57:22.947646+0000","last_clean":"2024-09-12T01:57:22.947646+0000","last_became_active":"2024-09-12T01:56:37.882252+0000","last_became_peered":"2024-09-12T01:56:37.882252+0000","last_unstale":"2024-09-12T01:57:22.947646+0000","last_undegraded":"2024-09-12T01:57:22.947646+0000","last_fullsized":"2024-09-12T01:57:22.947646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:09.286264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951677+0000","last_change":"2024-09-12T01:56:49.862073+0000","last_active":"2024-09-12T01:57:22.951677+0000","last_peered":"2024-09-12T01:57:22.951677+0000","last_clean":"2024-09-12T01:57:22.951677+0000","last_became_active":"2024-09-12T01:56:49.861586+0000","last_became_peered":"2024-09-12T01:56:49.861586+0000","last_unstale":"2024-09-12T01:57:22.951677+0000","last_undegraded":"2024-09-12T01:57:22.951677+0000","last_fullsized":"2024-09-12T01:57:22.951677+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:51.503334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946912+0000","last_change":"2024-09-12T01:56:40.803456+0000","last_active":"2024-09-12T01:57:22.946912+0000","last_peered":"2024-09-12T01:57:22.946912+0000","last_clean":"2024-09-12T01:57:22.946912+0000","last_became_active":"2024-09-12T01:56:40.797474+0000","last_became_peered":"2024-09-12T01:56:40.797474+0000","last_unstale":"2024-09-12T01:57:22.946912+0000","last_undegraded":"2024-09-12T01:57:22.946912+0000","last_fullsized":"2024-09-12T01:57:22.946912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:03.965692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'7","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:35.804786+0000","last_change":"2024-09-12T01:57:22.961059+0000","last_active":"2024-09-12T01:57:35.804786+0000","last_peered":"2024-09-12T01:57:35.804786+0000","last_clean":"2024-09-12T01:57:35.804786+0000","last_became_active":"2024-09-12T01:57:22.953667+0000","last_became_peered":"2024-09-12T01:57:22.953667+0000","last_unstale":"2024-09-12T01:57:35.804786+0000","last_undegraded":"2024-09-12T01:57:35.804786+0000","last_fullsized":"2024-09-12T01:57:35.804786+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:02.040016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.945755+0000","last_change":"2024-09-12T01:56:49.881209+0000","last_active":"2024-09-12T01:57:22.945755+0000","last_peered":"2024-09-12T01:57:22.945755+0000","last_clean":"2024-09-12T01:57:22.945755+0000","last_became_active":"2024-09-12T01:56:49.880787+0000","last_became_peered":"2024-09-12T01:56:49.880787+0000","last_unstale":"2024-09-12T01:57:22.945755+0000","last_undegraded":"2024-09-12T01:57:22.945755+0000","last_fullsized":"2024-09-12T01:57:22.945755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:55.432935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956337+0000","last_change":"2024-09-12T01:56:40.799664+0000","last_active":"2024-09-12T01:57:22.956337+0000","last_peered":"2024-09-12T01:57:22.956337+0000","last_clean":"2024-09-12T01:57:22.956337+0000","last_became_active":"2024-09-12T01:56:40.799174+0000","last_became_peered":"2024-09-12T01:56:40.799174+0000","last_unstale":"2024-09-12T01:57:22.956337+0000","last_undegraded":"2024-09-12T01:57:22.956337+0000","last_fullsized":"2024-09-12T01:57:22.956337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:37.347036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946779+0000","last_change":"2024-09-12T01:56:38.177277+0000","last_active":"2024-09-12T01:57:22.946779+0000","last_peered":"2024-09-12T01:57:22.946779+0000","last_clean":"2024-09-12T01:57:22.946779+0000","last_became_active":"2024-09-12T01:56:38.176532+0000","last_became_peered":"2024-09-12T01:56:38.176532+0000","last_unstale":"2024-09-12T01:57:22.946779+0000","last_undegraded":"2024-09-12T01:57:22.946779+0000","last_fullsized":"2024-09-12T01:57:22.946779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:19.424600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948386+0000","last_change":"2024-09-12T01:56:49.863474+0000","last_active":"2024-09-12T01:57:22.948386+0000","last_peered":"2024-09-12T01:57:22.948386+0000","last_clean":"2024-09-12T01:57:22.948386+0000","last_became_active":"2024-09-12T01:56:49.863019+0000","last_became_peered":"2024-09-12T01:56:49.863019+0000","last_unstale":"2024-09-12T01:57:22.948386+0000","last_undegraded":"2024-09-12T01:57:22.948386+0000","last_fullsized":"2024-09-12T01:57:22.948386+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:48.057450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480831+0000","last_change":"2024-09-12T01:56:40.808860+0000","last_active":"2024-09-12T01:57:23.480831+0000","last_peered":"2024-09-12T01:57:23.480831+0000","last_clean":"2024-09-12T01:57:23.480831+0000","last_became_active":"2024-09-12T01:56:40.808521+0000","last_became_peered":"2024-09-12T01:56:40.808521+0000","last_unstale":"2024-09-12T01:57:23.480831+0000","last_undegraded":"2024-09-12T01:57:23.480831+0000","last_fullsized":"2024-09-12T01:57:23.480831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:11.026296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955861+0000","last_change":"2024-09-12T01:56:38.176812+0000","last_active":"2024-09-12T01:57:22.955861+0000","last_peered":"2024-09-12T01:57:22.955861+0000","last_clean":"2024-09-12T01:57:22.955861+0000","last_became_active":"2024-09-12T01:56:38.176431+0000","last_became_peered":"2024-09-12T01:56:38.176431+0000","last_unstale":"2024-09-12T01:57:22.955861+0000","last_undegraded":"2024-09-12T01:57:22.955861+0000","last_fullsized":"2024-09-12T01:57:22.955861+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:24.132211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946130+0000","last_change":"2024-09-12T01:56:49.881391+0000","last_active":"2024-09-12T01:57:22.946130+0000","last_peered":"2024-09-12T01:57:22.946130+0000","last_clean":"2024-09-12T01:57:22.946130+0000","last_became_active":"2024-09-12T01:56:49.880890+0000","last_became_peered":"2024-09-12T01:56:49.880890+0000","last_unstale":"2024-09-12T01:57:22.946130+0000","last_undegraded":"2024-09-12T01:57:22.946130+0000","last_fullsized":"2024-09-12T01:57:22.946130+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:29.633558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480762+0000","last_change":"2024-09-12T01:56:40.813468+0000","last_active":"2024-09-12T01:57:23.480762+0000","last_peered":"2024-09-12T01:57:23.480762+0000","last_clean":"2024-09-12T01:57:23.480762+0000","last_became_active":"2024-09-12T01:56:40.813121+0000","last_became_peered":"2024-09-12T01:56:40.813121+0000","last_unstale":"2024-09-12T01:57:23.480762+0000","last_undegraded":"2024-09-12T01:57:23.480762+0000","last_fullsized":"2024-09-12T01:57:23.480762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:13.633672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950033+0000","last_change":"2024-09-12T01:56:37.751076+0000","last_active":"2024-09-12T01:57:22.950033+0000","last_peered":"2024-09-12T01:57:22.950033+0000","last_clean":"2024-09-12T01:57:22.950033+0000","last_became_active":"2024-09-12T01:56:37.750730+0000","last_became_peered":"2024-09-12T01:56:37.750730+0000","last_unstale":"2024-09-12T01:57:22.950033+0000","last_undegraded":"2024-09-12T01:57:22.950033+0000","last_fullsized":"2024-09-12T01:57:22.950033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:33.791431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955008+0000","last_change":"2024-09-12T01:56:49.870381+0000","last_active":"2024-09-12T01:57:22.955008+0000","last_peered":"2024-09-12T01:57:22.955008+0000","last_clean":"2024-09-12T01:57:22.955008+0000","last_became_active":"2024-09-12T01:56:49.869787+0000","last_became_peered":"2024-09-12T01:56:49.869787+0000","last_unstale":"2024-09-12T01:57:22.955008+0000","last_undegraded":"2024-09-12T01:57:22.955008+0000","last_fullsized":"2024-09-12T01:57:22.955008+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:01.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.957415+0000","last_change":"2024-09-12T01:57:22.955352+0000","last_active":"2024-09-12T01:57:22.957415+0000","last_peered":"2024-09-12T01:57:22.957415+0000","last_clean":"2024-09-12T01:57:22.957415+0000","last_became_active":"2024-09-12T01:57:22.954949+0000","last_became_peered":"2024-09-12T01:57:22.954949+0000","last_unstale":"2024-09-12T01:57:22.957415+0000","last_undegraded":"2024-09-12T01:57:22.957415+0000","last_fullsized":"2024-09-12T01:57:22.957415+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:38.707897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954634+0000","last_change":"2024-09-12T01:56:38.174983+0000","last_active":"2024-09-12T01:57:22.954634+0000","last_peered":"2024-09-12T01:57:22.954634+0000","last_clean":"2024-09-12T01:57:22.954634+0000","last_became_active":"2024-09-12T01:56:38.174578+0000","last_became_peered":"2024-09-12T01:56:38.174578+0000","last_unstale":"2024-09-12T01:57:22.954634+0000","last_undegraded":"2024-09-12T01:57:22.954634+0000","last_fullsized":"2024-09-12T01:57:22.954634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:44.629321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.957417+0000","last_change":"2024-09-12T01:56:49.881829+0000","last_active":"2024-09-12T01:57:22.957417+0000","last_peered":"2024-09-12T01:57:22.957417+0000","last_clean":"2024-09-12T01:57:22.957417+0000","last_became_active":"2024-09-12T01:56:49.881373+0000","last_became_peered":"2024-09-12T01:56:49.881373+0000","last_unstale":"2024-09-12T01:57:22.957417+0000","last_undegraded":"2024-09-12T01:57:22.957417+0000","last_fullsized":"2024-09-12T01:57:22.957417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:36.706558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954402+0000","last_change":"2024-09-12T01:56:40.810202+0000","last_active":"2024-09-12T01:57:22.954402+0000","last_peered":"2024-09-12T01:57:22.954402+0000","last_clean":"2024-09-12T01:57:22.954402+0000","last_became_active":"2024-09-12T01:56:40.808567+0000","last_became_peered":"2024-09-12T01:56:40.808567+0000","last_unstale":"2024-09-12T01:57:22.954402+0000","last_undegraded":"2024-09-12T01:57:22.954402+0000","last_fullsized":"2024-09-12T01:57:22.954402+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:49.157369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949569+0000","last_change":"2024-09-12T01:56:37.753459+0000","last_active":"2024-09-12T01:57:22.949569+0000","last_peered":"2024-09-12T01:57:22.949569+0000","last_clean":"2024-09-12T01:57:22.949569+0000","last_became_active":"2024-09-12T01:56:37.753129+0000","last_became_peered":"2024-09-12T01:56:37.753129+0000","last_unstale":"2024-09-12T01:57:22.949569+0000","last_undegraded":"2024-09-12T01:57:22.949569+0000","last_fullsized":"2024-09-12T01:57:22.949569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:47.841217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481822+0000","last_change":"2024-09-12T01:56:49.881600+0000","last_active":"2024-09-12T01:57:23.481822+0000","last_peered":"2024-09-12T01:57:23.481822+0000","last_clean":"2024-09-12T01:57:23.481822+0000","last_became_active":"2024-09-12T01:56:49.881116+0000","last_became_peered":"2024-09-12T01:56:49.881116+0000","last_unstale":"2024-09-12T01:57:23.481822+0000","last_undegraded":"2024-09-12T01:57:23.481822+0000","last_fullsized":"2024-09-12T01:57:23.481822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:42.515473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946172+0000","last_change":"2024-09-12T01:56:40.796878+0000","last_active":"2024-09-12T01:57:22.946172+0000","last_peered":"2024-09-12T01:57:22.946172+0000","last_clean":"2024-09-12T01:57:22.946172+0000","last_became_active":"2024-09-12T01:56:40.795031+0000","last_became_peered":"2024-09-12T01:56:40.795031+0000","last_unstale":"2024-09-12T01:57:22.946172+0000","last_undegraded":"2024-09-12T01:57:22.946172+0000","last_fullsized":"2024-09-12T01:57:22.946172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:02.497135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947593+0000","last_change":"2024-09-12T01:56:37.754379+0000","last_active":"2024-09-12T01:57:22.947593+0000","last_peered":"2024-09-12T01:57:22.947593+0000","last_clean":"2024-09-12T01:57:22.947593+0000","last_became_active":"2024-09-12T01:56:37.753986+0000","last_became_peered":"2024-09-12T01:56:37.753986+0000","last_unstale":"2024-09-12T01:57:22.947593+0000","last_undegraded":"2024-09-12T01:57:22.947593+0000","last_fullsized":"2024-09-12T01:57:22.947593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:09.877482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":360,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949762+0000","last_change":"2024-09-12T01:55:24.577685+0000","last_active":"2024-09-12T01:57:22.949762+0000","last_peered":"2024-09-12T01:57:22.949762+0000","last_clean":"2024-09-12T01:57:22.949762+0000","last_became_active":"2024-09-12T01:55:24.577248+0000","last_became_peered":"2024-09-12T01:55:24.577248+0000","last_unstale":"2024-09-12T01:57:22.949762+0000","last_undegraded":"2024-09-12T01:57:22.949762+0000","last_fullsized":"2024-09-12T01:57:22.949762+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:51:44.081524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:51:44.081524+0000","last_clean_scrub_stamp":"2024-09-12T01:51:44.081524+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:25.146507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950317+0000","last_change":"2024-09-12T01:56:49.872339+0000","last_active":"2024-09-12T01:57:22.950317+0000","last_peered":"2024-09-12T01:57:22.950317+0000","last_clean":"2024-09-12T01:57:22.950317+0000","last_became_active":"2024-09-12T01:56:49.872035+0000","last_became_peered":"2024-09-12T01:56:49.872035+0000","last_unstale":"2024-09-12T01:57:22.950317+0000","last_undegraded":"2024-09-12T01:57:22.950317+0000","last_fullsized":"2024-09-12T01:57:22.950317+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:28.512384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950428+0000","last_change":"2024-09-12T01:56:40.805832+0000","last_active":"2024-09-12T01:57:22.950428+0000","last_peered":"2024-09-12T01:57:22.950428+0000","last_clean":"2024-09-12T01:57:22.950428+0000","last_became_active":"2024-09-12T01:56:40.805407+0000","last_became_peered":"2024-09-12T01:56:40.805407+0000","last_unstale":"2024-09-12T01:57:22.950428+0000","last_undegraded":"2024-09-12T01:57:22.950428+0000","last_fullsized":"2024-09-12T01:57:22.950428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:36.699461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.958274+0000","last_change":"2024-09-12T01:57:22.958274+0000","last_active":"2024-09-12T01:57:22.958274+0000","last_peered":"2024-09-12T01:57:22.958274+0000","last_clean":"2024-09-12T01:57:22.958274+0000","last_became_active":"2024-09-12T01:57:22.957927+0000","last_became_peered":"2024-09-12T01:57:22.957927+0000","last_unstale":"2024-09-12T01:57:22.958274+0000","last_undegraded":"2024-09-12T01:57:22.958274+0000","last_fullsized":"2024-09-12T01:57:22.958274+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:58.031082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950975+0000","last_change":"2024-09-12T01:56:49.863237+0000","last_active":"2024-09-12T01:57:22.950975+0000","last_peered":"2024-09-12T01:57:22.950975+0000","last_clean":"2024-09-12T01:57:22.950975+0000","last_became_active":"2024-09-12T01:56:49.862831+0000","last_became_peered":"2024-09-12T01:56:49.862831+0000","last_unstale":"2024-09-12T01:57:22.950975+0000","last_undegraded":"2024-09-12T01:57:22.950975+0000","last_fullsized":"2024-09-12T01:57:22.950975+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:45.970500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949744+0000","last_change":"2024-09-12T01:56:40.806634+0000","last_active":"2024-09-12T01:57:22.949744+0000","last_peered":"2024-09-12T01:57:22.949744+0000","last_clean":"2024-09-12T01:57:22.949744+0000","last_became_active":"2024-09-12T01:56:40.806308+0000","last_became_peered":"2024-09-12T01:56:40.806308+0000","last_unstale":"2024-09-12T01:57:22.949744+0000","last_undegraded":"2024-09-12T01:57:22.949744+0000","last_fullsized":"2024-09-12T01:57:22.949744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:46.800939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482190+0000","last_change":"2024-09-12T01:56:37.752897+0000","last_active":"2024-09-12T01:57:23.482190+0000","last_peered":"2024-09-12T01:57:23.482190+0000","last_clean":"2024-09-12T01:57:23.482190+0000","last_became_active":"2024-09-12T01:56:37.752612+0000","last_became_peered":"2024-09-12T01:56:37.752612+0000","last_unstale":"2024-09-12T01:57:23.482190+0000","last_undegraded":"2024-09-12T01:57:23.482190+0000","last_fullsized":"2024-09-12T01:57:23.482190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:16.690620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949456+0000","last_change":"2024-09-12T01:56:49.876113+0000","last_active":"2024-09-12T01:57:22.949456+0000","last_peered":"2024-09-12T01:57:22.949456+0000","last_clean":"2024-09-12T01:57:22.949456+0000","last_became_active":"2024-09-12T01:56:49.875743+0000","last_became_peered":"2024-09-12T01:56:49.875743+0000","last_unstale":"2024-09-12T01:57:22.949456+0000","last_undegraded":"2024-09-12T01:57:22.949456+0000","last_fullsized":"2024-09-12T01:57:22.949456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:20.818024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950510+0000","last_change":"2024-09-12T01:56:40.799329+0000","last_active":"2024-09-12T01:57:22.950510+0000","last_peered":"2024-09-12T01:57:22.950510+0000","last_clean":"2024-09-12T01:57:22.950510+0000","last_became_active":"2024-09-12T01:56:40.798999+0000","last_became_peered":"2024-09-12T01:56:40.798999+0000","last_unstale":"2024-09-12T01:57:22.950510+0000","last_undegraded":"2024-09-12T01:57:22.950510+0000","last_fullsized":"2024-09-12T01:57:22.950510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:33.291045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.963796+0000","last_change":"2024-09-12T01:57:22.963796+0000","last_active":"2024-09-12T01:57:22.963796+0000","last_peered":"2024-09-12T01:57:22.963796+0000","last_clean":"2024-09-12T01:57:22.963796+0000","last_became_active":"2024-09-12T01:57:22.958887+0000","last_became_peered":"2024-09-12T01:57:22.958887+0000","last_unstale":"2024-09-12T01:57:22.963796+0000","last_undegraded":"2024-09-12T01:57:22.963796+0000","last_fullsized":"2024-09-12T01:57:22.963796+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:57.272630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480866+0000","last_change":"2024-09-12T01:56:49.864958+0000","last_active":"2024-09-12T01:57:23.480866+0000","last_peered":"2024-09-12T01:57:23.480866+0000","last_clean":"2024-09-12T01:57:23.480866+0000","last_became_active":"2024-09-12T01:56:49.864564+0000","last_became_peered":"2024-09-12T01:56:49.864564+0000","last_unstale":"2024-09-12T01:57:23.480866+0000","last_undegraded":"2024-09-12T01:57:23.480866+0000","last_fullsized":"2024-09-12T01:57:23.480866+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:20.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948473+0000","last_change":"2024-09-12T01:56:40.799887+0000","last_active":"2024-09-12T01:57:22.948473+0000","last_peered":"2024-09-12T01:57:22.948473+0000","last_clean":"2024-09-12T01:57:22.948473+0000","last_became_active":"2024-09-12T01:56:40.799561+0000","last_became_peered":"2024-09-12T01:56:40.799561+0000","last_unstale":"2024-09-12T01:57:22.948473+0000","last_undegraded":"2024-09-12T01:57:22.948473+0000","last_fullsized":"2024-09-12T01:57:22.948473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:25.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946890+0000","last_change":"2024-09-12T01:56:37.746147+0000","last_active":"2024-09-12T01:57:22.946890+0000","last_peered":"2024-09-12T01:57:22.946890+0000","last_clean":"2024-09-12T01:57:22.946890+0000","last_became_active":"2024-09-12T01:56:37.745810+0000","last_became_peered":"2024-09-12T01:56:37.745810+0000","last_unstale":"2024-09-12T01:57:22.946890+0000","last_undegraded":"2024-09-12T01:57:22.946890+0000","last_fullsized":"2024-09-12T01:57:22.946890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:09.304520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480837+0000","last_change":"2024-09-12T01:56:49.869301+0000","last_active":"2024-09-12T01:57:23.480837+0000","last_peered":"2024-09-12T01:57:23.480837+0000","last_clean":"2024-09-12T01:57:23.480837+0000","last_became_active":"2024-09-12T01:56:49.868883+0000","last_became_peered":"2024-09-12T01:56:49.868883+0000","last_unstale":"2024-09-12T01:57:23.480837+0000","last_undegraded":"2024-09-12T01:57:23.480837+0000","last_fullsized":"2024-09-12T01:57:23.480837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:11.110423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481186+0000","last_change":"2024-09-12T01:56:40.808574+0000","last_active":"2024-09-12T01:57:23.481186+0000","last_peered":"2024-09-12T01:57:23.481186+0000","last_clean":"2024-09-12T01:57:23.481186+0000","last_became_active":"2024-09-12T01:56:40.808257+0000","last_became_peered":"2024-09-12T01:56:40.808257+0000","last_unstale":"2024-09-12T01:57:23.481186+0000","last_undegraded":"2024-09-12T01:57:23.481186+0000","last_fullsized":"2024-09-12T01:57:23.481186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:58.375055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946185+0000","last_change":"2024-09-12T01:56:38.177026+0000","last_active":"2024-09-12T01:57:22.946185+0000","last_peered":"2024-09-12T01:57:22.946185+0000","last_clean":"2024-09-12T01:57:22.946185+0000","last_became_active":"2024-09-12T01:56:38.176566+0000","last_became_peered":"2024-09-12T01:56:38.176566+0000","last_unstale":"2024-09-12T01:57:22.946185+0000","last_undegraded":"2024-09-12T01:57:22.946185+0000","last_fullsized":"2024-09-12T01:57:22.946185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:53.167228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956686+0000","last_change":"2024-09-12T01:56:49.876297+0000","last_active":"2024-09-12T01:57:22.956686+0000","last_peered":"2024-09-12T01:57:22.956686+0000","last_clean":"2024-09-12T01:57:22.956686+0000","last_became_active":"2024-09-12T01:56:49.875765+0000","last_became_peered":"2024-09-12T01:56:49.875765+0000","last_unstale":"2024-09-12T01:57:22.956686+0000","last_undegraded":"2024-09-12T01:57:22.956686+0000","last_fullsized":"2024-09-12T01:57:22.956686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:55.104025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949657+0000","last_change":"2024-09-12T01:56:40.801653+0000","last_active":"2024-09-12T01:57:22.949657+0000","last_peered":"2024-09-12T01:57:22.949657+0000","last_clean":"2024-09-12T01:57:22.949657+0000","last_became_active":"2024-09-12T01:56:40.801348+0000","last_became_peered":"2024-09-12T01:56:40.801348+0000","last_unstale":"2024-09-12T01:57:22.949657+0000","last_undegraded":"2024-09-12T01:57:22.949657+0000","last_fullsized":"2024-09-12T01:57:22.949657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:59.076443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947119+0000","last_change":"2024-09-12T01:56:37.749817+0000","last_active":"2024-09-12T01:57:22.947119+0000","last_peered":"2024-09-12T01:57:22.947119+0000","last_clean":"2024-09-12T01:57:22.947119+0000","last_became_active":"2024-09-12T01:56:37.749431+0000","last_became_peered":"2024-09-12T01:56:37.749431+0000","last_unstale":"2024-09-12T01:57:22.947119+0000","last_undegraded":"2024-09-12T01:57:22.947119+0000","last_fullsized":"2024-09-12T01:57:22.947119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:13.193083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956507+0000","last_change":"2024-09-12T01:56:49.877371+0000","last_active":"2024-09-12T01:57:22.956507+0000","last_peered":"2024-09-12T01:57:22.956507+0000","last_clean":"2024-09-12T01:57:22.956507+0000","last_became_active":"2024-09-12T01:56:49.873147+0000","last_became_peered":"2024-09-12T01:56:49.873147+0000","last_unstale":"2024-09-12T01:57:22.956507+0000","last_undegraded":"2024-09-12T01:57:22.956507+0000","last_fullsized":"2024-09-12T01:57:22.956507+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:23.215058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.958641+0000","last_change":"2024-09-12T01:57:22.958641+0000","last_active":"2024-09-12T01:57:22.958641+0000","last_peered":"2024-09-12T01:57:22.958641+0000","last_clean":"2024-09-12T01:57:22.958641+0000","last_became_active":"2024-09-12T01:57:22.958274+0000","last_became_peered":"2024-09-12T01:57:22.958274+0000","last_unstale":"2024-09-12T01:57:22.958641+0000","last_undegraded":"2024-09-12T01:57:22.958641+0000","last_fullsized":"2024-09-12T01:57:22.958641+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:22.529517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481486+0000","last_change":"2024-09-12T01:56:37.751527+0000","last_active":"2024-09-12T01:57:23.481486+0000","last_peered":"2024-09-12T01:57:23.481486+0000","last_clean":"2024-09-12T01:57:23.481486+0000","last_became_active":"2024-09-12T01:56:37.751190+0000","last_became_peered":"2024-09-12T01:56:37.751190+0000","last_unstale":"2024-09-12T01:57:23.481486+0000","last_undegraded":"2024-09-12T01:57:23.481486+0000","last_fullsized":"2024-09-12T01:57:23.481486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:01.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948103+0000","last_change":"2024-09-12T01:56:49.873101+0000","last_active":"2024-09-12T01:57:22.948103+0000","last_peered":"2024-09-12T01:57:22.948103+0000","last_clean":"2024-09-12T01:57:22.948103+0000","last_became_active":"2024-09-12T01:56:49.872670+0000","last_became_peered":"2024-09-12T01:56:49.872670+0000","last_unstale":"2024-09-12T01:57:22.948103+0000","last_undegraded":"2024-09-12T01:57:22.948103+0000","last_fullsized":"2024-09-12T01:57:22.948103+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.794244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954436+0000","last_change":"2024-09-12T01:56:40.805982+0000","last_active":"2024-09-12T01:57:22.954436+0000","last_peered":"2024-09-12T01:57:22.954436+0000","last_clean":"2024-09-12T01:57:22.954436+0000","last_became_active":"2024-09-12T01:56:40.805653+0000","last_became_peered":"2024-09-12T01:56:40.805653+0000","last_unstale":"2024-09-12T01:57:22.954436+0000","last_undegraded":"2024-09-12T01:57:22.954436+0000","last_fullsized":"2024-09-12T01:57:22.954436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:37.117089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'2","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952725+0000","last_change":"2024-09-12T01:56:37.753569+0000","last_active":"2024-09-12T01:57:22.952725+0000","last_peered":"2024-09-12T01:57:22.952725+0000","last_clean":"2024-09-12T01:57:22.952725+0000","last_became_active":"2024-09-12T01:56:37.753153+0000","last_became_peered":"2024-09-12T01:56:37.753153+0000","last_unstale":"2024-09-12T01:57:22.952725+0000","last_undegraded":"2024-09-12T01:57:22.952725+0000","last_fullsized":"2024-09-12T01:57:22.952725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:33.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481671+0000","last_change":"2024-09-12T01:56:49.866532+0000","last_active":"2024-09-12T01:57:23.481671+0000","last_peered":"2024-09-12T01:57:23.481671+0000","last_clean":"2024-09-12T01:57:23.481671+0000","last_became_active":"2024-09-12T01:56:49.866114+0000","last_became_peered":"2024-09-12T01:56:49.866114+0000","last_unstale":"2024-09-12T01:57:23.481671+0000","last_undegraded":"2024-09-12T01:57:23.481671+0000","last_fullsized":"2024-09-12T01:57:23.481671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:03.241292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946624+0000","last_change":"2024-09-12T01:56:40.799319+0000","last_active":"2024-09-12T01:57:22.946624+0000","last_peered":"2024-09-12T01:57:22.946624+0000","last_clean":"2024-09-12T01:57:22.946624+0000","last_became_active":"2024-09-12T01:56:40.798949+0000","last_became_peered":"2024-09-12T01:56:40.798949+0000","last_unstale":"2024-09-12T01:57:22.946624+0000","last_undegraded":"2024-09-12T01:57:22.946624+0000","last_fullsized":"2024-09-12T01:57:22.946624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:01.254059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'29","reported_seq":100,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:35.986934+0000","last_change":"2024-09-12T01:56:37.750425+0000","last_active":"2024-09-12T01:57:35.986934+0000","last_peered":"2024-09-12T01:57:35.986934+0000","last_clean":"2024-09-12T01:57:35.986934+0000","last_became_active":"2024-09-12T01:56:37.749995+0000","last_became_peered":"2024-09-12T01:56:37.749995+0000","last_unstale":"2024-09-12T01:57:35.986934+0000","last_undegraded":"2024-09-12T01:57:35.986934+0000","last_fullsized":"2024-09-12T01:57:35.986934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:53.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55463,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":70,"num_write":29,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949962+0000","last_change":"2024-09-12T01:56:49.872968+0000","last_active":"2024-09-12T01:57:22.949962+0000","last_peered":"2024-09-12T01:57:22.949962+0000","last_clean":"2024-09-12T01:57:22.949962+0000","last_became_active":"2024-09-12T01:56:49.872537+0000","last_became_peered":"2024-09-12T01:56:49.872537+0000","last_unstale":"2024-09-12T01:57:22.949962+0000","last_undegraded":"2024-09-12T01:57:22.949962+0000","last_fullsized":"2024-09-12T01:57:22.949962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:05.684396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951183+0000","last_change":"2024-09-12T01:56:40.808116+0000","last_active":"2024-09-12T01:57:22.951183+0000","last_peered":"2024-09-12T01:57:22.951183+0000","last_clean":"2024-09-12T01:57:22.951183+0000","last_became_active":"2024-09-12T01:56:40.807763+0000","last_became_peered":"2024-09-12T01:56:40.807763+0000","last_unstale":"2024-09-12T01:57:22.951183+0000","last_undegraded":"2024-09-12T01:57:22.951183+0000","last_fullsized":"2024-09-12T01:57:22.951183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:24.553929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'3","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481823+0000","last_change":"2024-09-12T01:56:38.177027+0000","last_active":"2024-09-12T01:57:23.481823+0000","last_peered":"2024-09-12T01:57:23.481823+0000","last_clean":"2024-09-12T01:57:23.481823+0000","last_became_active":"2024-09-12T01:56:38.176610+0000","last_became_peered":"2024-09-12T01:56:38.176610+0000","last_unstale":"2024-09-12T01:57:23.481823+0000","last_undegraded":"2024-09-12T01:57:23.481823+0000","last_fullsized":"2024-09-12T01:57:23.481823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:18.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947469+0000","last_change":"2024-09-12T01:56:49.875835+0000","last_active":"2024-09-12T01:57:22.947469+0000","last_peered":"2024-09-12T01:57:22.947469+0000","last_clean":"2024-09-12T01:57:22.947469+0000","last_became_active":"2024-09-12T01:56:49.875310+0000","last_became_peered":"2024-09-12T01:56:49.875310+0000","last_unstale":"2024-09-12T01:57:22.947469+0000","last_undegraded":"2024-09-12T01:57:22.947469+0000","last_fullsized":"2024-09-12T01:57:22.947469+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:57.153633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482387+0000","last_change":"2024-09-12T01:57:23.482387+0000","last_active":"2024-09-12T01:57:23.482387+0000","last_peered":"2024-09-12T01:57:23.482387+0000","last_clean":"2024-09-12T01:57:23.482387+0000","last_became_active":"2024-09-12T01:57:23.481842+0000","last_became_peered":"2024-09-12T01:57:23.481842+0000","last_unstale":"2024-09-12T01:57:23.482387+0000","last_undegraded":"2024-09-12T01:57:23.482387+0000","last_fullsized":"2024-09-12T01:57:23.482387+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:40.227322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950521+0000","last_change":"2024-09-12T01:56:37.749911+0000","last_active":"2024-09-12T01:57:22.950521+0000","last_peered":"2024-09-12T01:57:22.950521+0000","last_clean":"2024-09-12T01:57:22.950521+0000","last_became_active":"2024-09-12T01:56:37.749565+0000","last_became_peered":"2024-09-12T01:56:37.749565+0000","last_unstale":"2024-09-12T01:57:22.950521+0000","last_undegraded":"2024-09-12T01:57:22.950521+0000","last_fullsized":"2024-09-12T01:57:22.950521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:33.462391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949697+0000","last_change":"2024-09-12T01:56:49.873274+0000","last_active":"2024-09-12T01:57:22.949697+0000","last_peered":"2024-09-12T01:57:22.949697+0000","last_clean":"2024-09-12T01:57:22.949697+0000","last_became_active":"2024-09-12T01:56:49.872769+0000","last_became_peered":"2024-09-12T01:56:49.872769+0000","last_unstale":"2024-09-12T01:57:22.949697+0000","last_undegraded":"2024-09-12T01:57:22.949697+0000","last_fullsized":"2024-09-12T01:57:22.949697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:04.288198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951512+0000","last_change":"2024-09-12T01:56:40.798008+0000","last_active":"2024-09-12T01:57:22.951512+0000","last_peered":"2024-09-12T01:57:22.951512+0000","last_clean":"2024-09-12T01:57:22.951512+0000","last_became_active":"2024-09-12T01:56:40.797607+0000","last_became_peered":"2024-09-12T01:56:40.797607+0000","last_unstale":"2024-09-12T01:57:22.951512+0000","last_undegraded":"2024-09-12T01:57:22.951512+0000","last_fullsized":"2024-09-12T01:57:22.951512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.738161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481088+0000","last_change":"2024-09-12T01:56:37.754607+0000","last_active":"2024-09-12T01:57:23.481088+0000","last_peered":"2024-09-12T01:57:23.481088+0000","last_clean":"2024-09-12T01:57:23.481088+0000","last_became_active":"2024-09-12T01:56:37.754311+0000","last_became_peered":"2024-09-12T01:56:37.754311+0000","last_unstale":"2024-09-12T01:57:23.481088+0000","last_undegraded":"2024-09-12T01:57:23.481088+0000","last_fullsized":"2024-09-12T01:57:23.481088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:05.597502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.945922+0000","last_change":"2024-09-12T01:56:49.860561+0000","last_active":"2024-09-12T01:57:22.945922+0000","last_peered":"2024-09-12T01:57:22.945922+0000","last_clean":"2024-09-12T01:57:22.945922+0000","last_became_active":"2024-09-12T01:56:49.860149+0000","last_became_peered":"2024-09-12T01:56:49.860149+0000","last_unstale":"2024-09-12T01:57:22.945922+0000","last_undegraded":"2024-09-12T01:57:22.945922+0000","last_fullsized":"2024-09-12T01:57:22.945922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:19.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949432+0000","last_change":"2024-09-12T01:56:49.868171+0000","last_active":"2024-09-12T01:57:22.949432+0000","last_peered":"2024-09-12T01:57:22.949432+0000","last_clean":"2024-09-12T01:57:22.949432+0000","last_became_active":"2024-09-12T01:56:49.867729+0000","last_became_peered":"2024-09-12T01:56:49.867729+0000","last_unstale":"2024-09-12T01:57:22.949432+0000","last_undegraded":"2024-09-12T01:57:22.949432+0000","last_fullsized":"2024-09-12T01:57:22.949432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:48.599568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949836+0000","last_change":"2024-09-12T01:56:40.807872+0000","last_active":"2024-09-12T01:57:22.949836+0000","last_peered":"2024-09-12T01:57:22.949836+0000","last_clean":"2024-09-12T01:57:22.949836+0000","last_became_active":"2024-09-12T01:56:40.807422+0000","last_became_peered":"2024-09-12T01:56:40.807422+0000","last_unstale":"2024-09-12T01:57:22.949836+0000","last_undegraded":"2024-09-12T01:57:22.949836+0000","last_fullsized":"2024-09-12T01:57:22.949836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.679501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481145+0000","last_change":"2024-09-12T01:56:37.750758+0000","last_active":"2024-09-12T01:57:23.481145+0000","last_peered":"2024-09-12T01:57:23.481145+0000","last_clean":"2024-09-12T01:57:23.481145+0000","last_became_active":"2024-09-12T01:56:37.750455+0000","last_became_peered":"2024-09-12T01:56:37.750455+0000","last_unstale":"2024-09-12T01:57:23.481145+0000","last_undegraded":"2024-09-12T01:57:23.481145+0000","last_fullsized":"2024-09-12T01:57:23.481145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:44.279233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948593+0000","last_change":"2024-09-12T01:56:49.877992+0000","last_active":"2024-09-12T01:57:22.948593+0000","last_peered":"2024-09-12T01:57:22.948593+0000","last_clean":"2024-09-12T01:57:22.948593+0000","last_became_active":"2024-09-12T01:56:49.877682+0000","last_became_peered":"2024-09-12T01:56:49.877682+0000","last_unstale":"2024-09-12T01:57:22.948593+0000","last_undegraded":"2024-09-12T01:57:22.948593+0000","last_fullsized":"2024-09-12T01:57:22.948593+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:28.326232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.945922+0000","last_change":"2024-09-12T01:56:40.803688+0000","last_active":"2024-09-12T01:57:22.945922+0000","last_peered":"2024-09-12T01:57:22.945922+0000","last_clean":"2024-09-12T01:57:22.945922+0000","last_became_active":"2024-09-12T01:56:40.797538+0000","last_became_peered":"2024-09-12T01:56:40.797538+0000","last_unstale":"2024-09-12T01:57:22.945922+0000","last_undegraded":"2024-09-12T01:57:22.945922+0000","last_fullsized":"2024-09-12T01:57:22.945922+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:19.309770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954527+0000","last_change":"2024-09-12T01:56:37.756077+0000","last_active":"2024-09-12T01:57:22.954527+0000","last_peered":"2024-09-12T01:57:22.954527+0000","last_clean":"2024-09-12T01:57:22.954527+0000","last_became_active":"2024-09-12T01:56:37.754873+0000","last_became_peered":"2024-09-12T01:56:37.754873+0000","last_unstale":"2024-09-12T01:57:22.954527+0000","last_undegraded":"2024-09-12T01:57:22.954527+0000","last_fullsized":"2024-09-12T01:57:22.954527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:38.889020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480689+0000","last_change":"2024-09-12T01:56:37.752122+0000","last_active":"2024-09-12T01:57:23.480689+0000","last_peered":"2024-09-12T01:57:23.480689+0000","last_clean":"2024-09-12T01:57:23.480689+0000","last_became_active":"2024-09-12T01:56:37.751690+0000","last_became_peered":"2024-09-12T01:56:37.751690+0000","last_unstale":"2024-09-12T01:57:23.480689+0000","last_undegraded":"2024-09-12T01:57:23.480689+0000","last_fullsized":"2024-09-12T01:57:23.480689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:37.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481499+0000","last_change":"2024-09-12T01:56:40.800079+0000","last_active":"2024-09-12T01:57:23.481499+0000","last_peered":"2024-09-12T01:57:23.481499+0000","last_clean":"2024-09-12T01:57:23.481499+0000","last_became_active":"2024-09-12T01:56:40.799766+0000","last_became_peered":"2024-09-12T01:56:40.799766+0000","last_unstale":"2024-09-12T01:57:23.481499+0000","last_undegraded":"2024-09-12T01:57:23.481499+0000","last_fullsized":"2024-09-12T01:57:23.481499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:32.211511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951575+0000","last_change":"2024-09-12T01:56:49.875360+0000","last_active":"2024-09-12T01:57:22.951575+0000","last_peered":"2024-09-12T01:57:22.951575+0000","last_clean":"2024-09-12T01:57:22.951575+0000","last_became_active":"2024-09-12T01:56:49.874781+0000","last_became_peered":"2024-09-12T01:56:49.874781+0000","last_unstale":"2024-09-12T01:57:22.951575+0000","last_undegraded":"2024-09-12T01:57:22.951575+0000","last_fullsized":"2024-09-12T01:57:22.951575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.667086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481582+0000","last_change":"2024-09-12T01:56:37.751251+0000","last_active":"2024-09-12T01:57:23.481582+0000","last_peered":"2024-09-12T01:57:23.481582+0000","last_clean":"2024-09-12T01:57:23.481582+0000","last_became_active":"2024-09-12T01:56:37.750886+0000","last_became_peered":"2024-09-12T01:56:37.750886+0000","last_unstale":"2024-09-12T01:57:23.481582+0000","last_undegraded":"2024-09-12T01:57:23.481582+0000","last_fullsized":"2024-09-12T01:57:23.481582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.377703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946203+0000","last_change":"2024-09-12T01:56:40.800259+0000","last_active":"2024-09-12T01:57:22.946203+0000","last_peered":"2024-09-12T01:57:22.946203+0000","last_clean":"2024-09-12T01:57:22.946203+0000","last_became_active":"2024-09-12T01:56:40.799892+0000","last_became_peered":"2024-09-12T01:56:40.799892+0000","last_unstale":"2024-09-12T01:57:22.946203+0000","last_undegraded":"2024-09-12T01:57:22.946203+0000","last_fullsized":"2024-09-12T01:57:22.946203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:59.402783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952362+0000","last_change":"2024-09-12T01:56:49.864057+0000","last_active":"2024-09-12T01:57:22.952362+0000","last_peered":"2024-09-12T01:57:22.952362+0000","last_clean":"2024-09-12T01:57:22.952362+0000","last_became_active":"2024-09-12T01:56:49.863033+0000","last_became_peered":"2024-09-12T01:56:49.863033+0000","last_unstale":"2024-09-12T01:57:22.952362+0000","last_undegraded":"2024-09-12T01:57:22.952362+0000","last_fullsized":"2024-09-12T01:57:22.952362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:11.134060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947710+0000","last_change":"2024-09-12T01:56:40.800392+0000","last_active":"2024-09-12T01:57:22.947710+0000","last_peered":"2024-09-12T01:57:22.947710+0000","last_clean":"2024-09-12T01:57:22.947710+0000","last_became_active":"2024-09-12T01:56:40.800042+0000","last_became_peered":"2024-09-12T01:56:40.800042+0000","last_unstale":"2024-09-12T01:57:22.947710+0000","last_undegraded":"2024-09-12T01:57:22.947710+0000","last_fullsized":"2024-09-12T01:57:22.947710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:15.543600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951920+0000","last_change":"2024-09-12T01:56:40.806231+0000","last_active":"2024-09-12T01:57:22.951920+0000","last_peered":"2024-09-12T01:57:22.951920+0000","last_clean":"2024-09-12T01:57:22.951920+0000","last_became_active":"2024-09-12T01:56:40.805748+0000","last_became_peered":"2024-09-12T01:56:40.805748+0000","last_unstale":"2024-09-12T01:57:22.951920+0000","last_undegraded":"2024-09-12T01:57:22.951920+0000","last_fullsized":"2024-09-12T01:57:22.951920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:48.753339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951532+0000","last_change":"2024-09-12T01:56:40.809433+0000","last_active":"2024-09-12T01:57:22.951532+0000","last_peered":"2024-09-12T01:57:22.951532+0000","last_clean":"2024-09-12T01:57:22.951532+0000","last_became_active":"2024-09-12T01:56:40.809000+0000","last_became_peered":"2024-09-12T01:56:40.809000+0000","last_unstale":"2024-09-12T01:57:22.951532+0000","last_undegraded":"2024-09-12T01:57:22.951532+0000","last_fullsized":"2024-09-12T01:57:22.951532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:45.506511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949568+0000","last_change":"2024-09-12T01:56:40.811304+0000","last_active":"2024-09-12T01:57:22.949568+0000","last_peered":"2024-09-12T01:57:22.949568+0000","last_clean":"2024-09-12T01:57:22.949568+0000","last_became_active":"2024-09-12T01:56:40.810759+0000","last_became_peered":"2024-09-12T01:56:40.810759+0000","last_unstale":"2024-09-12T01:57:22.949568+0000","last_undegraded":"2024-09-12T01:57:22.949568+0000","last_fullsized":"2024-09-12T01:57:22.949568+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:45.093498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956119+0000","last_change":"2024-09-12T01:56:40.809009+0000","last_active":"2024-09-12T01:57:22.956119+0000","last_peered":"2024-09-12T01:57:22.956119+0000","last_clean":"2024-09-12T01:57:22.956119+0000","last_became_active":"2024-09-12T01:56:40.808523+0000","last_became_peered":"2024-09-12T01:56:40.808523+0000","last_unstale":"2024-09-12T01:57:22.956119+0000","last_undegraded":"2024-09-12T01:57:22.956119+0000","last_fullsized":"2024-09-12T01:57:22.956119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:02.312093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948450+0000","last_change":"2024-09-12T01:56:40.796468+0000","last_active":"2024-09-12T01:57:22.948450+0000","last_peered":"2024-09-12T01:57:22.948450+0000","last_clean":"2024-09-12T01:57:22.948450+0000","last_became_active":"2024-09-12T01:56:40.796128+0000","last_became_peered":"2024-09-12T01:56:40.796128+0000","last_unstale":"2024-09-12T01:57:22.948450+0000","last_undegraded":"2024-09-12T01:57:22.948450+0000","last_fullsized":"2024-09-12T01:57:22.948450+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:55.521802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952974+0000","last_change":"2024-09-12T01:56:40.800836+0000","last_active":"2024-09-12T01:57:22.952974+0000","last_peered":"2024-09-12T01:57:22.952974+0000","last_clean":"2024-09-12T01:57:22.952974+0000","last_became_active":"2024-09-12T01:56:40.800274+0000","last_became_peered":"2024-09-12T01:56:40.800274+0000","last_unstale":"2024-09-12T01:57:22.952974+0000","last_undegraded":"2024-09-12T01:57:22.952974+0000","last_fullsized":"2024-09-12T01:57:22.952974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:27.774825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946804+0000","last_change":"2024-09-12T01:56:40.804247+0000","last_active":"2024-09-12T01:57:22.946804+0000","last_peered":"2024-09-12T01:57:22.946804+0000","last_clean":"2024-09-12T01:57:22.946804+0000","last_became_active":"2024-09-12T01:56:40.803892+0000","last_became_peered":"2024-09-12T01:56:40.803892+0000","last_unstale":"2024-09-12T01:57:22.946804+0000","last_undegraded":"2024-09-12T01:57:22.946804+0000","last_fullsized":"2024-09-12T01:57:22.946804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:57.537524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480965+0000","last_change":"2024-09-12T01:56:40.805206+0000","last_active":"2024-09-12T01:57:23.480965+0000","last_peered":"2024-09-12T01:57:23.480965+0000","last_clean":"2024-09-12T01:57:23.480965+0000","last_became_active":"2024-09-12T01:56:40.804710+0000","last_became_peered":"2024-09-12T01:56:40.804710+0000","last_unstale":"2024-09-12T01:57:23.480965+0000","last_undegraded":"2024-09-12T01:57:23.480965+0000","last_fullsized":"2024-09-12T01:57:23.480965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.945986+0000","last_change":"2024-09-12T01:56:40.795793+0000","last_active":"2024-09-12T01:57:22.945986+0000","last_peered":"2024-09-12T01:57:22.945986+0000","last_clean":"2024-09-12T01:57:22.945986+0000","last_became_active":"2024-09-12T01:56:40.795389+0000","last_became_peered":"2024-09-12T01:56:40.795389+0000","last_unstale":"2024-09-12T01:57:22.945986+0000","last_undegraded":"2024-09-12T01:57:22.945986+0000","last_fullsized":"2024-09-12T01:57:22.945986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:16.413066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951131+0000","last_change":"2024-09-12T01:56:40.800624+0000","last_active":"2024-09-12T01:57:22.951131+0000","last_peered":"2024-09-12T01:57:22.951131+0000","last_clean":"2024-09-12T01:57:22.951131+0000","last_became_active":"2024-09-12T01:56:40.800203+0000","last_became_peered":"2024-09-12T01:56:40.800203+0000","last_unstale":"2024-09-12T01:57:22.951131+0000","last_undegraded":"2024-09-12T01:57:22.951131+0000","last_fullsized":"2024-09-12T01:57:22.951131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:01.688455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955164+0000","last_change":"2024-09-12T01:56:40.814818+0000","last_active":"2024-09-12T01:57:22.955164+0000","last_peered":"2024-09-12T01:57:22.955164+0000","last_clean":"2024-09-12T01:57:22.955164+0000","last_became_active":"2024-09-12T01:56:40.813521+0000","last_became_peered":"2024-09-12T01:56:40.813521+0000","last_unstale":"2024-09-12T01:57:22.955164+0000","last_undegraded":"2024-09-12T01:57:22.955164+0000","last_fullsized":"2024-09-12T01:57:22.955164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.393165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948221+0000","last_change":"2024-09-12T01:56:40.808186+0000","last_active":"2024-09-12T01:57:22.948221+0000","last_peered":"2024-09-12T01:57:22.948221+0000","last_clean":"2024-09-12T01:57:22.948221+0000","last_became_active":"2024-09-12T01:56:40.807817+0000","last_became_peered":"2024-09-12T01:56:40.807817+0000","last_unstale":"2024-09-12T01:57:22.948221+0000","last_undegraded":"2024-09-12T01:57:22.948221+0000","last_fullsized":"2024-09-12T01:57:22.948221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:21.055662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952548+0000","last_change":"2024-09-12T01:56:40.805693+0000","last_active":"2024-09-12T01:57:22.952548+0000","last_peered":"2024-09-12T01:57:22.952548+0000","last_clean":"2024-09-12T01:57:22.952548+0000","last_became_active":"2024-09-12T01:56:40.805327+0000","last_became_peered":"2024-09-12T01:56:40.805327+0000","last_unstale":"2024-09-12T01:57:22.952548+0000","last_undegraded":"2024-09-12T01:57:22.952548+0000","last_fullsized":"2024-09-12T01:57:22.952548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:40.313504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956039+0000","last_change":"2024-09-12T01:56:40.802263+0000","last_active":"2024-09-12T01:57:22.956039+0000","last_peered":"2024-09-12T01:57:22.956039+0000","last_clean":"2024-09-12T01:57:22.956039+0000","last_became_active":"2024-09-12T01:56:40.801009+0000","last_became_peered":"2024-09-12T01:56:40.801009+0000","last_unstale":"2024-09-12T01:57:22.956039+0000","last_undegraded":"2024-09-12T01:57:22.956039+0000","last_fullsized":"2024-09-12T01:57:22.956039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:03.283370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948958+0000","last_change":"2024-09-12T01:56:40.817597+0000","last_active":"2024-09-12T01:57:22.948958+0000","last_peered":"2024-09-12T01:57:22.948958+0000","last_clean":"2024-09-12T01:57:22.948958+0000","last_became_active":"2024-09-12T01:56:40.817314+0000","last_became_peered":"2024-09-12T01:56:40.817314+0000","last_unstale":"2024-09-12T01:57:22.948958+0000","last_undegraded":"2024-09-12T01:57:22.948958+0000","last_fullsized":"2024-09-12T01:57:22.948958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:33.421685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950442+0000","last_change":"2024-09-12T01:56:40.803580+0000","last_active":"2024-09-12T01:57:22.950442+0000","last_peered":"2024-09-12T01:57:22.950442+0000","last_clean":"2024-09-12T01:57:22.950442+0000","last_became_active":"2024-09-12T01:56:40.803251+0000","last_became_peered":"2024-09-12T01:56:40.803251+0000","last_unstale":"2024-09-12T01:57:22.950442+0000","last_undegraded":"2024-09-12T01:57:22.950442+0000","last_fullsized":"2024-09-12T01:57:22.950442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:48.813142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954092+0000","last_change":"2024-09-12T01:57:22.954092+0000","last_active":"2024-09-12T01:57:22.954092+0000","last_peered":"2024-09-12T01:57:22.954092+0000","last_clean":"2024-09-12T01:57:22.954092+0000","last_became_active":"2024-09-12T01:57:22.953702+0000","last_became_peered":"2024-09-12T01:57:22.953702+0000","last_unstale":"2024-09-12T01:57:22.954092+0000","last_undegraded":"2024-09-12T01:57:22.954092+0000","last_fullsized":"2024-09-12T01:57:22.954092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:21.939930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949090+0000","last_change":"2024-09-12T01:56:40.805635+0000","last_active":"2024-09-12T01:57:22.949090+0000","last_peered":"2024-09-12T01:57:22.949090+0000","last_clean":"2024-09-12T01:57:22.949090+0000","last_became_active":"2024-09-12T01:56:40.805272+0000","last_became_peered":"2024-09-12T01:56:40.805272+0000","last_unstale":"2024-09-12T01:57:22.949090+0000","last_undegraded":"2024-09-12T01:57:22.949090+0000","last_fullsized":"2024-09-12T01:57:22.949090+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:38.069722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955059+0000","last_change":"2024-09-12T01:56:40.804448+0000","last_active":"2024-09-12T01:57:22.955059+0000","last_peered":"2024-09-12T01:57:22.955059+0000","last_clean":"2024-09-12T01:57:22.955059+0000","last_became_active":"2024-09-12T01:56:40.804087+0000","last_became_peered":"2024-09-12T01:56:40.804087+0000","last_unstale":"2024-09-12T01:57:22.955059+0000","last_undegraded":"2024-09-12T01:57:22.955059+0000","last_fullsized":"2024-09-12T01:57:22.955059+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:21.840684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947614+0000","last_change":"2024-09-12T01:56:40.805791+0000","last_active":"2024-09-12T01:57:22.947614+0000","last_peered":"2024-09-12T01:57:22.947614+0000","last_clean":"2024-09-12T01:57:22.947614+0000","last_became_active":"2024-09-12T01:56:40.805240+0000","last_became_peered":"2024-09-12T01:56:40.805240+0000","last_unstale":"2024-09-12T01:57:22.947614+0000","last_undegraded":"2024-09-12T01:57:22.947614+0000","last_fullsized":"2024-09-12T01:57:22.947614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:14.060341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950705+0000","last_change":"2024-09-12T01:56:40.803546+0000","last_active":"2024-09-12T01:57:22.950705+0000","last_peered":"2024-09-12T01:57:22.950705+0000","last_clean":"2024-09-12T01:57:22.950705+0000","last_became_active":"2024-09-12T01:56:40.803235+0000","last_became_peered":"2024-09-12T01:56:40.803235+0000","last_unstale":"2024-09-12T01:57:22.950705+0000","last_undegraded":"2024-09-12T01:57:22.950705+0000","last_fullsized":"2024-09-12T01:57:22.950705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:15.758641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481136+0000","last_change":"2024-09-12T01:56:40.806725+0000","last_active":"2024-09-12T01:57:23.481136+0000","last_peered":"2024-09-12T01:57:23.481136+0000","last_clean":"2024-09-12T01:57:23.481136+0000","last_became_active":"2024-09-12T01:56:40.806378+0000","last_became_peered":"2024-09-12T01:56:40.806378+0000","last_unstale":"2024-09-12T01:57:23.481136+0000","last_undegraded":"2024-09-12T01:57:23.481136+0000","last_fullsized":"2024-09-12T01:57:23.481136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:09.124282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951505+0000","last_change":"2024-09-12T01:56:40.794601+0000","last_active":"2024-09-12T01:57:22.951505+0000","last_peered":"2024-09-12T01:57:22.951505+0000","last_clean":"2024-09-12T01:57:22.951505+0000","last_became_active":"2024-09-12T01:56:40.794281+0000","last_became_peered":"2024-09-12T01:56:40.794281+0000","last_unstale":"2024-09-12T01:57:22.951505+0000","last_undegraded":"2024-09-12T01:57:22.951505+0000","last_fullsized":"2024-09-12T01:57:22.951505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.408464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.945905+0000","last_change":"2024-09-12T01:56:40.806003+0000","last_active":"2024-09-12T01:57:22.945905+0000","last_peered":"2024-09-12T01:57:22.945905+0000","last_clean":"2024-09-12T01:57:22.945905+0000","last_became_active":"2024-09-12T01:56:40.805689+0000","last_became_peered":"2024-09-12T01:56:40.805689+0000","last_unstale":"2024-09-12T01:57:22.945905+0000","last_undegraded":"2024-09-12T01:57:22.945905+0000","last_fullsized":"2024-09-12T01:57:22.945905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:47.498654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950087+0000","last_change":"2024-09-12T01:56:40.800840+0000","last_active":"2024-09-12T01:57:22.950087+0000","last_peered":"2024-09-12T01:57:22.950087+0000","last_clean":"2024-09-12T01:57:22.950087+0000","last_became_active":"2024-09-12T01:56:40.800479+0000","last_became_peered":"2024-09-12T01:56:40.800479+0000","last_unstale":"2024-09-12T01:57:22.950087+0000","last_undegraded":"2024-09-12T01:57:22.950087+0000","last_fullsized":"2024-09-12T01:57:22.950087+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:11.789524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480654+0000","last_change":"2024-09-12T01:56:40.799488+0000","last_active":"2024-09-12T01:57:23.480654+0000","last_peered":"2024-09-12T01:57:23.480654+0000","last_clean":"2024-09-12T01:57:23.480654+0000","last_became_active":"2024-09-12T01:56:40.799131+0000","last_became_peered":"2024-09-12T01:56:40.799131+0000","last_unstale":"2024-09-12T01:57:23.480654+0000","last_undegraded":"2024-09-12T01:57:23.480654+0000","last_fullsized":"2024-09-12T01:57:23.480654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:37.722651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946176+0000","last_change":"2024-09-12T01:56:40.809821+0000","last_active":"2024-09-12T01:57:22.946176+0000","last_peered":"2024-09-12T01:57:22.946176+0000","last_clean":"2024-09-12T01:57:22.946176+0000","last_became_active":"2024-09-12T01:56:40.809500+0000","last_became_peered":"2024-09-12T01:56:40.809500+0000","last_unstale":"2024-09-12T01:57:22.946176+0000","last_undegraded":"2024-09-12T01:57:22.946176+0000","last_fullsized":"2024-09-12T01:57:22.946176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:23.271230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947610+0000","last_change":"2024-09-12T01:56:40.805722+0000","last_active":"2024-09-12T01:57:22.947610+0000","last_peered":"2024-09-12T01:57:22.947610+0000","last_clean":"2024-09-12T01:57:22.947610+0000","last_became_active":"2024-09-12T01:56:40.805406+0000","last_became_peered":"2024-09-12T01:56:40.805406+0000","last_unstale":"2024-09-12T01:57:22.947610+0000","last_undegraded":"2024-09-12T01:57:22.947610+0000","last_fullsized":"2024-09-12T01:57:22.947610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:14.214021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951499+0000","last_change":"2024-09-12T01:56:40.807957+0000","last_active":"2024-09-12T01:57:22.951499+0000","last_peered":"2024-09-12T01:57:22.951499+0000","last_clean":"2024-09-12T01:57:22.951499+0000","last_became_active":"2024-09-12T01:56:40.807635+0000","last_became_peered":"2024-09-12T01:56:40.807635+0000","last_unstale":"2024-09-12T01:57:22.951499+0000","last_undegraded":"2024-09-12T01:57:22.951499+0000","last_fullsized":"2024-09-12T01:57:22.951499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:05.378671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949492+0000","last_change":"2024-09-12T01:56:40.813995+0000","last_active":"2024-09-12T01:57:22.949492+0000","last_peered":"2024-09-12T01:57:22.949492+0000","last_clean":"2024-09-12T01:57:22.949492+0000","last_became_active":"2024-09-12T01:56:40.806665+0000","last_became_peered":"2024-09-12T01:56:40.806665+0000","last_unstale":"2024-09-12T01:57:22.949492+0000","last_undegraded":"2024-09-12T01:57:22.949492+0000","last_fullsized":"2024-09-12T01:57:22.949492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:01.652850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948866+0000","last_change":"2024-09-12T01:56:40.817591+0000","last_active":"2024-09-12T01:57:22.948866+0000","last_peered":"2024-09-12T01:57:22.948866+0000","last_clean":"2024-09-12T01:57:22.948866+0000","last_became_active":"2024-09-12T01:56:40.817281+0000","last_became_peered":"2024-09-12T01:56:40.817281+0000","last_unstale":"2024-09-12T01:57:22.948866+0000","last_undegraded":"2024-09-12T01:57:22.948866+0000","last_fullsized":"2024-09-12T01:57:22.948866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:51.933536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56261,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":39,"num_read_kb":76,"num_write":81,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":168783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514521,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":518042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743453,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32848,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712304,"statfs":{"total":95995035648,"available":95961399296,"internally_reserved":0,"allocated":1703936,"data_stored":1159971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906979,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":522720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":518646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364846,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36944,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708208,"statfs":{"total":95995035648,"available":95957204992,"internally_reserved":0,"allocated":1638400,"data_stored":1113088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1032192,"data_stored":513946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757306,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32788,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712364,"statfs":{"total":95995035648,"available":95961460736,"internally_reserved":0,"allocated":1642496,"data_stored":1108592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920831,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":518064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149763,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":514050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":569443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":569409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1036288,"data_stored":514036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":55463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":55497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":55657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:57:42.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:57:43.020 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:43.441 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:43 smithi062 ceph-mon[30666]: pgmap v332: 129 pgs: 129 active+clean; 632 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.5 KiB/s wr, 4 op/s 2024-09-12T01:57:43.513 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:43 smithi062 ceph-mon[30666]: from='client.24737 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:43.513 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:43 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:43.513 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:43 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:43.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.554+0000 7f8481c00640 1 -- 172.21.15.62:0/384330165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c103ff0 msgr2=0x7f847c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.554+0000 7f8481c00640 1 --2- 172.21.15.62:0/384330165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c103ff0 0x7f847c1043d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f846c009900 tx=0x7f846c02a410 comp rx=0 tx=0).stop 2024-09-12T01:57:43.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.554+0000 7f8481c00640 1 -- 172.21.15.62:0/384330165 shutdown_connections 2024-09-12T01:57:43.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.554+0000 7f8481c00640 1 --2- 172.21.15.62:0/384330165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f847c109120 0x7f847c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.554+0000 7f8481c00640 1 --2- 172.21.15.62:0/384330165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847c1049a0 0x7f847c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.554+0000 7f8481c00640 1 --2- 172.21.15.62:0/384330165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c103ff0 0x7f847c1043d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.554+0000 7f8481c00640 1 -- 172.21.15.62:0/384330165 >> 172.21.15.62:0/384330165 conn(0x7f847c0ffa90 msgr2=0x7f847c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:43.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.554+0000 7f8481c00640 1 -- 172.21.15.62:0/384330165 shutdown_connections 2024-09-12T01:57:43.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.554+0000 7f8481c00640 1 -- 172.21.15.62:0/384330165 wait complete. 2024-09-12T01:57:43.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.555+0000 7f8481c00640 1 Processor -- start 2024-09-12T01:57:43.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.555+0000 7f8481c00640 1 -- start start 2024-09-12T01:57:43.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.555+0000 7f8481c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c103ff0 0x7f847c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.555+0000 7f8481c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f847c1049a0 0x7f847c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.555+0000 7f8481c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847c109120 0x7f847c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f8481c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f847c1141a0 con 0x7f847c103ff0 2024-09-12T01:57:43.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f8481c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f847c114020 con 0x7f847c109120 2024-09-12T01:57:43.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f8481c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f847c114320 con 0x7f847c1049a0 2024-09-12T01:57:43.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c103ff0 0x7f847c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847a000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f847c1049a0 0x7f847c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c103ff0 0x7f847c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34228/0 (socket says 172.21.15.62:34228) 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847aa00640 1 -- 172.21.15.62:0/3148872533 learned_addr learned my addr 172.21.15.62:0/3148872533 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847b400640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847c109120 0x7f847c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847a000640 1 -- 172.21.15.62:0/3148872533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847c109120 msgr2=0x7f847c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847a000640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847c109120 0x7f847c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847a000640 1 -- 172.21.15.62:0/3148872533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c103ff0 msgr2=0x7f847c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847a000640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c103ff0 0x7f847c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847a000640 1 -- 172.21.15.62:0/3148872533 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847c19f5d0 con 0x7f847c1049a0 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.556+0000 7f847b400640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847c109120 0x7f847c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.557+0000 7f847a000640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f847c1049a0 0x7f847c19ab60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f846800e9f0 tx=0x7f846800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.557+0000 7f8473400640 1 -- 172.21.15.62:0/3148872533 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846800ccc0 con 0x7f847c1049a0 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.557+0000 7f8473400640 1 -- 172.21.15.62:0/3148872533 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8468010910 con 0x7f847c1049a0 2024-09-12T01:57:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.557+0000 7f8481c00640 1 -- 172.21.15.62:0/3148872533 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847c19f8c0 con 0x7f847c1049a0 2024-09-12T01:57:43.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.557+0000 7f8473400640 1 -- 172.21.15.62:0/3148872533 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468018960 con 0x7f847c1049a0 2024-09-12T01:57:43.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.557+0000 7f8481c00640 1 -- 172.21.15.62:0/3148872533 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f847c1a71a0 con 0x7f847c1049a0 2024-09-12T01:57:43.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.558+0000 7f8481c00640 1 -- 172.21.15.62:0/3148872533 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f847c1043d0 con 0x7f847c1049a0 2024-09-12T01:57:43.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.560+0000 7f8473400640 1 -- 172.21.15.62:0/3148872533 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8468010ac0 con 0x7f847c1049a0 2024-09-12T01:57:43.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.561+0000 7f8473400640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84600a2c90 0x7f84600a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:43.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.561+0000 7f8473400640 1 -- 172.21.15.62:0/3148872533 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f84680cf880 con 0x7f847c1049a0 2024-09-12T01:57:43.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.562+0000 7f847aa00640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84600a2c90 0x7f84600a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:43.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.562+0000 7f847aa00640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84600a2c90 0x7f84600a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f846c0096c0 tx=0x7f846c0046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:43.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.565+0000 7f8473400640 1 -- 172.21.15.62:0/3148872533 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f846809bc70 con 0x7f847c1049a0 2024-09-12T01:57:43.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:43 smithi107 ceph-mon[35463]: pgmap v332: 129 pgs: 129 active+clean; 632 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.5 KiB/s wr, 4 op/s 2024-09-12T01:57:43.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:43 smithi107 ceph-mon[35463]: from='client.24737 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:43.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:43 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:43.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:43 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:43.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:43 smithi077 ceph-mon[35095]: pgmap v332: 129 pgs: 129 active+clean; 632 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.5 KiB/s wr, 4 op/s 2024-09-12T01:57:43.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:43 smithi077 ceph-mon[35095]: from='client.24737 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:43.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:43 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:43.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:43 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:43.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.784+0000 7f8481c00640 1 -- 172.21.15.62:0/3148872533 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f847c062630 con 0x7f84600a2c90 2024-09-12T01:57:43.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.796+0000 7f8473400640 1 -- 172.21.15.62:0/3148872533 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340277 (secure 0 0 0) 0x7f847c062630 con 0x7f84600a2c90 2024-09-12T01:57:43.801 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:43.802 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:57:43.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 -- 172.21.15.62:0/3148872533 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84600a2c90 msgr2=0x7f84600a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84600a2c90 0x7f84600a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f846c0096c0 tx=0x7f846c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 -- 172.21.15.62:0/3148872533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f847c1049a0 msgr2=0x7f847c19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:43.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f847c1049a0 0x7f847c19ab60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f846800e9f0 tx=0x7f846800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 -- 172.21.15.62:0/3148872533 shutdown_connections 2024-09-12T01:57:43.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84600a2c90 0x7f84600a5150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f847c109120 0x7f847c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f847c1049a0 0x7f847c19ab60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 --2- 172.21.15.62:0/3148872533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c103ff0 0x7f847c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 -- 172.21.15.62:0/3148872533 >> 172.21.15.62:0/3148872533 conn(0x7f847c0ffa90 msgr2=0x7f847c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 -- 172.21.15.62:0/3148872533 shutdown_connections 2024-09-12T01:57:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:43.800+0000 7f8481c00640 1 -- 172.21.15.62:0/3148872533 wait complete. 2024-09-12T01:57:44.577 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-12T01:57:43.552734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651128,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":186,"num_read_kb":205,"num_write":265,"num_write_kb":3028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371708,"kb_used_data":14128,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124570116,"statfs":{"total":1151940427776,"available":1151559798784,"internally_reserved":0,"allocated":14467072,"data_stored":8148537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56118,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":72,"num_write":33,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003311"},"pg_stats":[{"pgid":"2.1f","version":"84'4","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956758+0000","last_change":"2024-09-12T01:56:37.753384+0000","last_active":"2024-09-12T01:57:22.956758+0000","last_peered":"2024-09-12T01:57:22.956758+0000","last_clean":"2024-09-12T01:57:22.956758+0000","last_became_active":"2024-09-12T01:56:37.751999+0000","last_became_peered":"2024-09-12T01:56:37.751999+0000","last_unstale":"2024-09-12T01:57:22.956758+0000","last_undegraded":"2024-09-12T01:57:22.956758+0000","last_fullsized":"2024-09-12T01:57:22.956758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:21.459291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482775+0000","last_change":"2024-09-12T01:57:23.481994+0000","last_active":"2024-09-12T01:57:23.482775+0000","last_peered":"2024-09-12T01:57:23.482775+0000","last_clean":"2024-09-12T01:57:23.482775+0000","last_became_active":"2024-09-12T01:57:23.481613+0000","last_became_peered":"2024-09-12T01:57:23.481613+0000","last_unstale":"2024-09-12T01:57:23.482775+0000","last_undegraded":"2024-09-12T01:57:23.482775+0000","last_fullsized":"2024-09-12T01:57:23.482775+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:30.571049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951372+0000","last_change":"2024-09-12T01:56:49.873220+0000","last_active":"2024-09-12T01:57:22.951372+0000","last_peered":"2024-09-12T01:57:22.951372+0000","last_clean":"2024-09-12T01:57:22.951372+0000","last_became_active":"2024-09-12T01:56:49.872786+0000","last_became_peered":"2024-09-12T01:56:49.872786+0000","last_unstale":"2024-09-12T01:57:22.951372+0000","last_undegraded":"2024-09-12T01:57:22.951372+0000","last_fullsized":"2024-09-12T01:57:22.951372+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:06.588088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946819+0000","last_change":"2024-09-12T01:56:38.175159+0000","last_active":"2024-09-12T01:57:22.946819+0000","last_peered":"2024-09-12T01:57:22.946819+0000","last_clean":"2024-09-12T01:57:22.946819+0000","last_became_active":"2024-09-12T01:56:38.174792+0000","last_became_peered":"2024-09-12T01:56:38.174792+0000","last_unstale":"2024-09-12T01:57:22.946819+0000","last_undegraded":"2024-09-12T01:57:22.946819+0000","last_fullsized":"2024-09-12T01:57:22.946819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.355819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949796+0000","last_change":"2024-09-12T01:56:40.816906+0000","last_active":"2024-09-12T01:57:22.949796+0000","last_peered":"2024-09-12T01:57:22.949796+0000","last_clean":"2024-09-12T01:57:22.949796+0000","last_became_active":"2024-09-12T01:56:40.816197+0000","last_became_peered":"2024-09-12T01:56:40.816197+0000","last_unstale":"2024-09-12T01:57:22.949796+0000","last_undegraded":"2024-09-12T01:57:22.949796+0000","last_fullsized":"2024-09-12T01:57:22.949796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:39.033451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946641+0000","last_change":"2024-09-12T01:56:49.875694+0000","last_active":"2024-09-12T01:57:22.946641+0000","last_peered":"2024-09-12T01:57:22.946641+0000","last_clean":"2024-09-12T01:57:22.946641+0000","last_became_active":"2024-09-12T01:56:49.875226+0000","last_became_peered":"2024-09-12T01:56:49.875226+0000","last_unstale":"2024-09-12T01:57:22.946641+0000","last_undegraded":"2024-09-12T01:57:22.946641+0000","last_fullsized":"2024-09-12T01:57:22.946641+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:54.025926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946757+0000","last_change":"2024-09-12T01:56:37.750494+0000","last_active":"2024-09-12T01:57:22.946757+0000","last_peered":"2024-09-12T01:57:22.946757+0000","last_clean":"2024-09-12T01:57:22.946757+0000","last_became_active":"2024-09-12T01:56:37.750115+0000","last_became_peered":"2024-09-12T01:56:37.750115+0000","last_unstale":"2024-09-12T01:57:22.946757+0000","last_undegraded":"2024-09-12T01:57:22.946757+0000","last_fullsized":"2024-09-12T01:57:22.946757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:25.632133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951175+0000","last_change":"2024-09-12T01:56:40.798528+0000","last_active":"2024-09-12T01:57:22.951175+0000","last_peered":"2024-09-12T01:57:22.951175+0000","last_clean":"2024-09-12T01:57:22.951175+0000","last_became_active":"2024-09-12T01:56:40.798192+0000","last_became_peered":"2024-09-12T01:56:40.798192+0000","last_unstale":"2024-09-12T01:57:22.951175+0000","last_undegraded":"2024-09-12T01:57:22.951175+0000","last_fullsized":"2024-09-12T01:57:22.951175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:43.533060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482228+0000","last_change":"2024-09-12T01:57:23.482228+0000","last_active":"2024-09-12T01:57:23.482228+0000","last_peered":"2024-09-12T01:57:23.482228+0000","last_clean":"2024-09-12T01:57:23.482228+0000","last_became_active":"2024-09-12T01:57:23.481845+0000","last_became_peered":"2024-09-12T01:57:23.481845+0000","last_unstale":"2024-09-12T01:57:23.482228+0000","last_undegraded":"2024-09-12T01:57:23.482228+0000","last_fullsized":"2024-09-12T01:57:23.482228+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:01.804914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946568+0000","last_change":"2024-09-12T01:56:37.747071+0000","last_active":"2024-09-12T01:57:22.946568+0000","last_peered":"2024-09-12T01:57:22.946568+0000","last_clean":"2024-09-12T01:57:22.946568+0000","last_became_active":"2024-09-12T01:56:37.746729+0000","last_became_peered":"2024-09-12T01:56:37.746729+0000","last_unstale":"2024-09-12T01:57:22.946568+0000","last_undegraded":"2024-09-12T01:57:22.946568+0000","last_fullsized":"2024-09-12T01:57:22.946568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:43.361782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481674+0000","last_change":"2024-09-12T01:56:40.799328+0000","last_active":"2024-09-12T01:57:23.481674+0000","last_peered":"2024-09-12T01:57:23.481674+0000","last_clean":"2024-09-12T01:57:23.481674+0000","last_became_active":"2024-09-12T01:56:40.798817+0000","last_became_peered":"2024-09-12T01:56:40.798817+0000","last_unstale":"2024-09-12T01:57:23.481674+0000","last_undegraded":"2024-09-12T01:57:23.481674+0000","last_fullsized":"2024-09-12T01:57:23.481674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:11.020387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946782+0000","last_change":"2024-09-12T01:56:49.862705+0000","last_active":"2024-09-12T01:57:22.946782+0000","last_peered":"2024-09-12T01:57:22.946782+0000","last_clean":"2024-09-12T01:57:22.946782+0000","last_became_active":"2024-09-12T01:56:49.862339+0000","last_became_peered":"2024-09-12T01:56:49.862339+0000","last_unstale":"2024-09-12T01:57:22.946782+0000","last_undegraded":"2024-09-12T01:57:22.946782+0000","last_fullsized":"2024-09-12T01:57:22.946782+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:07.418851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949948+0000","last_change":"2024-09-12T01:56:40.802464+0000","last_active":"2024-09-12T01:57:22.949948+0000","last_peered":"2024-09-12T01:57:22.949948+0000","last_clean":"2024-09-12T01:57:22.949948+0000","last_became_active":"2024-09-12T01:56:40.802058+0000","last_became_peered":"2024-09-12T01:56:40.802058+0000","last_unstale":"2024-09-12T01:57:22.949948+0000","last_undegraded":"2024-09-12T01:57:22.949948+0000","last_fullsized":"2024-09-12T01:57:22.949948+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:01.915067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.960107+0000","last_change":"2024-09-12T01:57:22.959598+0000","last_active":"2024-09-12T01:57:22.960107+0000","last_peered":"2024-09-12T01:57:22.960107+0000","last_clean":"2024-09-12T01:57:22.960107+0000","last_became_active":"2024-09-12T01:57:22.956659+0000","last_became_peered":"2024-09-12T01:57:22.956659+0000","last_unstale":"2024-09-12T01:57:22.960107+0000","last_undegraded":"2024-09-12T01:57:22.960107+0000","last_fullsized":"2024-09-12T01:57:22.960107+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.838889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947196+0000","last_change":"2024-09-12T01:56:49.881126+0000","last_active":"2024-09-12T01:57:22.947196+0000","last_peered":"2024-09-12T01:57:22.947196+0000","last_clean":"2024-09-12T01:57:22.947196+0000","last_became_active":"2024-09-12T01:56:49.880750+0000","last_became_peered":"2024-09-12T01:56:49.880750+0000","last_unstale":"2024-09-12T01:57:22.947196+0000","last_undegraded":"2024-09-12T01:57:22.947196+0000","last_fullsized":"2024-09-12T01:57:22.947196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:08.105160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946162+0000","last_change":"2024-09-12T01:56:40.807475+0000","last_active":"2024-09-12T01:57:22.946162+0000","last_peered":"2024-09-12T01:57:22.946162+0000","last_clean":"2024-09-12T01:57:22.946162+0000","last_became_active":"2024-09-12T01:56:40.806943+0000","last_became_peered":"2024-09-12T01:56:40.806943+0000","last_unstale":"2024-09-12T01:57:22.946162+0000","last_undegraded":"2024-09-12T01:57:22.946162+0000","last_fullsized":"2024-09-12T01:57:22.946162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:28.021204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951447+0000","last_change":"2024-09-12T01:56:37.752714+0000","last_active":"2024-09-12T01:57:22.951447+0000","last_peered":"2024-09-12T01:57:22.951447+0000","last_clean":"2024-09-12T01:57:22.951447+0000","last_became_active":"2024-09-12T01:56:37.752401+0000","last_became_peered":"2024-09-12T01:56:37.752401+0000","last_unstale":"2024-09-12T01:57:22.951447+0000","last_undegraded":"2024-09-12T01:57:22.951447+0000","last_fullsized":"2024-09-12T01:57:22.951447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:06.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947240+0000","last_change":"2024-09-12T01:56:49.876369+0000","last_active":"2024-09-12T01:57:22.947240+0000","last_peered":"2024-09-12T01:57:22.947240+0000","last_clean":"2024-09-12T01:57:22.947240+0000","last_became_active":"2024-09-12T01:56:49.875573+0000","last_became_peered":"2024-09-12T01:56:49.875573+0000","last_unstale":"2024-09-12T01:57:22.947240+0000","last_undegraded":"2024-09-12T01:57:22.947240+0000","last_fullsized":"2024-09-12T01:57:22.947240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:43.942369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947776+0000","last_change":"2024-09-12T01:56:40.807316+0000","last_active":"2024-09-12T01:57:22.947776+0000","last_peered":"2024-09-12T01:57:22.947776+0000","last_clean":"2024-09-12T01:57:22.947776+0000","last_became_active":"2024-09-12T01:56:40.806978+0000","last_became_peered":"2024-09-12T01:56:40.806978+0000","last_unstale":"2024-09-12T01:57:22.947776+0000","last_undegraded":"2024-09-12T01:57:22.947776+0000","last_fullsized":"2024-09-12T01:57:22.947776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:21.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946121+0000","last_change":"2024-09-12T01:56:37.752818+0000","last_active":"2024-09-12T01:57:22.946121+0000","last_peered":"2024-09-12T01:57:22.946121+0000","last_clean":"2024-09-12T01:57:22.946121+0000","last_became_active":"2024-09-12T01:56:37.752484+0000","last_became_peered":"2024-09-12T01:56:37.752484+0000","last_unstale":"2024-09-12T01:57:22.946121+0000","last_undegraded":"2024-09-12T01:57:22.946121+0000","last_fullsized":"2024-09-12T01:57:22.946121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.916149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956416+0000","last_change":"2024-09-12T01:56:49.878089+0000","last_active":"2024-09-12T01:57:22.956416+0000","last_peered":"2024-09-12T01:57:22.956416+0000","last_clean":"2024-09-12T01:57:22.956416+0000","last_became_active":"2024-09-12T01:56:49.875070+0000","last_became_peered":"2024-09-12T01:56:49.875070+0000","last_unstale":"2024-09-12T01:57:22.956416+0000","last_undegraded":"2024-09-12T01:57:22.956416+0000","last_fullsized":"2024-09-12T01:57:22.956416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:33.106652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946096+0000","last_change":"2024-09-12T01:56:40.797909+0000","last_active":"2024-09-12T01:57:22.946096+0000","last_peered":"2024-09-12T01:57:22.946096+0000","last_clean":"2024-09-12T01:57:22.946096+0000","last_became_active":"2024-09-12T01:56:40.797534+0000","last_became_peered":"2024-09-12T01:56:40.797534+0000","last_unstale":"2024-09-12T01:57:22.946096+0000","last_undegraded":"2024-09-12T01:57:22.946096+0000","last_fullsized":"2024-09-12T01:57:22.946096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:57.262669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950706+0000","last_change":"2024-09-12T01:56:38.176597+0000","last_active":"2024-09-12T01:57:22.950706+0000","last_peered":"2024-09-12T01:57:22.950706+0000","last_clean":"2024-09-12T01:57:22.950706+0000","last_became_active":"2024-09-12T01:56:38.176225+0000","last_became_peered":"2024-09-12T01:56:38.176225+0000","last_unstale":"2024-09-12T01:57:22.950706+0000","last_undegraded":"2024-09-12T01:57:22.950706+0000","last_fullsized":"2024-09-12T01:57:22.950706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:51.401286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947316+0000","last_change":"2024-09-12T01:56:49.881191+0000","last_active":"2024-09-12T01:57:22.947316+0000","last_peered":"2024-09-12T01:57:22.947316+0000","last_clean":"2024-09-12T01:57:22.947316+0000","last_became_active":"2024-09-12T01:56:49.880737+0000","last_became_peered":"2024-09-12T01:56:49.880737+0000","last_unstale":"2024-09-12T01:57:22.947316+0000","last_undegraded":"2024-09-12T01:57:22.947316+0000","last_fullsized":"2024-09-12T01:57:22.947316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:33.842527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949625+0000","last_change":"2024-09-12T01:56:40.806688+0000","last_active":"2024-09-12T01:57:22.949625+0000","last_peered":"2024-09-12T01:57:22.949625+0000","last_clean":"2024-09-12T01:57:22.949625+0000","last_became_active":"2024-09-12T01:56:40.806221+0000","last_became_peered":"2024-09-12T01:56:40.806221+0000","last_unstale":"2024-09-12T01:57:22.949625+0000","last_undegraded":"2024-09-12T01:57:22.949625+0000","last_fullsized":"2024-09-12T01:57:22.949625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.888750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'2","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947646+0000","last_change":"2024-09-12T01:56:37.882612+0000","last_active":"2024-09-12T01:57:22.947646+0000","last_peered":"2024-09-12T01:57:22.947646+0000","last_clean":"2024-09-12T01:57:22.947646+0000","last_became_active":"2024-09-12T01:56:37.882252+0000","last_became_peered":"2024-09-12T01:56:37.882252+0000","last_unstale":"2024-09-12T01:57:22.947646+0000","last_undegraded":"2024-09-12T01:57:22.947646+0000","last_fullsized":"2024-09-12T01:57:22.947646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:09.286264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951677+0000","last_change":"2024-09-12T01:56:49.862073+0000","last_active":"2024-09-12T01:57:22.951677+0000","last_peered":"2024-09-12T01:57:22.951677+0000","last_clean":"2024-09-12T01:57:22.951677+0000","last_became_active":"2024-09-12T01:56:49.861586+0000","last_became_peered":"2024-09-12T01:56:49.861586+0000","last_unstale":"2024-09-12T01:57:22.951677+0000","last_undegraded":"2024-09-12T01:57:22.951677+0000","last_fullsized":"2024-09-12T01:57:22.951677+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:51.503334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946912+0000","last_change":"2024-09-12T01:56:40.803456+0000","last_active":"2024-09-12T01:57:22.946912+0000","last_peered":"2024-09-12T01:57:22.946912+0000","last_clean":"2024-09-12T01:57:22.946912+0000","last_became_active":"2024-09-12T01:56:40.797474+0000","last_became_peered":"2024-09-12T01:56:40.797474+0000","last_unstale":"2024-09-12T01:57:22.946912+0000","last_undegraded":"2024-09-12T01:57:22.946912+0000","last_fullsized":"2024-09-12T01:57:22.946912+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:03.965692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'7","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:35.804786+0000","last_change":"2024-09-12T01:57:22.961059+0000","last_active":"2024-09-12T01:57:35.804786+0000","last_peered":"2024-09-12T01:57:35.804786+0000","last_clean":"2024-09-12T01:57:35.804786+0000","last_became_active":"2024-09-12T01:57:22.953667+0000","last_became_peered":"2024-09-12T01:57:22.953667+0000","last_unstale":"2024-09-12T01:57:35.804786+0000","last_undegraded":"2024-09-12T01:57:35.804786+0000","last_fullsized":"2024-09-12T01:57:35.804786+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:02.040016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.945755+0000","last_change":"2024-09-12T01:56:49.881209+0000","last_active":"2024-09-12T01:57:22.945755+0000","last_peered":"2024-09-12T01:57:22.945755+0000","last_clean":"2024-09-12T01:57:22.945755+0000","last_became_active":"2024-09-12T01:56:49.880787+0000","last_became_peered":"2024-09-12T01:56:49.880787+0000","last_unstale":"2024-09-12T01:57:22.945755+0000","last_undegraded":"2024-09-12T01:57:22.945755+0000","last_fullsized":"2024-09-12T01:57:22.945755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:55.432935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956337+0000","last_change":"2024-09-12T01:56:40.799664+0000","last_active":"2024-09-12T01:57:22.956337+0000","last_peered":"2024-09-12T01:57:22.956337+0000","last_clean":"2024-09-12T01:57:22.956337+0000","last_became_active":"2024-09-12T01:56:40.799174+0000","last_became_peered":"2024-09-12T01:56:40.799174+0000","last_unstale":"2024-09-12T01:57:22.956337+0000","last_undegraded":"2024-09-12T01:57:22.956337+0000","last_fullsized":"2024-09-12T01:57:22.956337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:37.347036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946779+0000","last_change":"2024-09-12T01:56:38.177277+0000","last_active":"2024-09-12T01:57:22.946779+0000","last_peered":"2024-09-12T01:57:22.946779+0000","last_clean":"2024-09-12T01:57:22.946779+0000","last_became_active":"2024-09-12T01:56:38.176532+0000","last_became_peered":"2024-09-12T01:56:38.176532+0000","last_unstale":"2024-09-12T01:57:22.946779+0000","last_undegraded":"2024-09-12T01:57:22.946779+0000","last_fullsized":"2024-09-12T01:57:22.946779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:19.424600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948386+0000","last_change":"2024-09-12T01:56:49.863474+0000","last_active":"2024-09-12T01:57:22.948386+0000","last_peered":"2024-09-12T01:57:22.948386+0000","last_clean":"2024-09-12T01:57:22.948386+0000","last_became_active":"2024-09-12T01:56:49.863019+0000","last_became_peered":"2024-09-12T01:56:49.863019+0000","last_unstale":"2024-09-12T01:57:22.948386+0000","last_undegraded":"2024-09-12T01:57:22.948386+0000","last_fullsized":"2024-09-12T01:57:22.948386+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:48.057450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480831+0000","last_change":"2024-09-12T01:56:40.808860+0000","last_active":"2024-09-12T01:57:23.480831+0000","last_peered":"2024-09-12T01:57:23.480831+0000","last_clean":"2024-09-12T01:57:23.480831+0000","last_became_active":"2024-09-12T01:56:40.808521+0000","last_became_peered":"2024-09-12T01:56:40.808521+0000","last_unstale":"2024-09-12T01:57:23.480831+0000","last_undegraded":"2024-09-12T01:57:23.480831+0000","last_fullsized":"2024-09-12T01:57:23.480831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:11.026296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955861+0000","last_change":"2024-09-12T01:56:38.176812+0000","last_active":"2024-09-12T01:57:22.955861+0000","last_peered":"2024-09-12T01:57:22.955861+0000","last_clean":"2024-09-12T01:57:22.955861+0000","last_became_active":"2024-09-12T01:56:38.176431+0000","last_became_peered":"2024-09-12T01:56:38.176431+0000","last_unstale":"2024-09-12T01:57:22.955861+0000","last_undegraded":"2024-09-12T01:57:22.955861+0000","last_fullsized":"2024-09-12T01:57:22.955861+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:24.132211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946130+0000","last_change":"2024-09-12T01:56:49.881391+0000","last_active":"2024-09-12T01:57:22.946130+0000","last_peered":"2024-09-12T01:57:22.946130+0000","last_clean":"2024-09-12T01:57:22.946130+0000","last_became_active":"2024-09-12T01:56:49.880890+0000","last_became_peered":"2024-09-12T01:56:49.880890+0000","last_unstale":"2024-09-12T01:57:22.946130+0000","last_undegraded":"2024-09-12T01:57:22.946130+0000","last_fullsized":"2024-09-12T01:57:22.946130+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:29.633558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480762+0000","last_change":"2024-09-12T01:56:40.813468+0000","last_active":"2024-09-12T01:57:23.480762+0000","last_peered":"2024-09-12T01:57:23.480762+0000","last_clean":"2024-09-12T01:57:23.480762+0000","last_became_active":"2024-09-12T01:56:40.813121+0000","last_became_peered":"2024-09-12T01:56:40.813121+0000","last_unstale":"2024-09-12T01:57:23.480762+0000","last_undegraded":"2024-09-12T01:57:23.480762+0000","last_fullsized":"2024-09-12T01:57:23.480762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:13.633672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950033+0000","last_change":"2024-09-12T01:56:37.751076+0000","last_active":"2024-09-12T01:57:22.950033+0000","last_peered":"2024-09-12T01:57:22.950033+0000","last_clean":"2024-09-12T01:57:22.950033+0000","last_became_active":"2024-09-12T01:56:37.750730+0000","last_became_peered":"2024-09-12T01:56:37.750730+0000","last_unstale":"2024-09-12T01:57:22.950033+0000","last_undegraded":"2024-09-12T01:57:22.950033+0000","last_fullsized":"2024-09-12T01:57:22.950033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:33.791431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955008+0000","last_change":"2024-09-12T01:56:49.870381+0000","last_active":"2024-09-12T01:57:22.955008+0000","last_peered":"2024-09-12T01:57:22.955008+0000","last_clean":"2024-09-12T01:57:22.955008+0000","last_became_active":"2024-09-12T01:56:49.869787+0000","last_became_peered":"2024-09-12T01:56:49.869787+0000","last_unstale":"2024-09-12T01:57:22.955008+0000","last_undegraded":"2024-09-12T01:57:22.955008+0000","last_fullsized":"2024-09-12T01:57:22.955008+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:01.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.957415+0000","last_change":"2024-09-12T01:57:22.955352+0000","last_active":"2024-09-12T01:57:22.957415+0000","last_peered":"2024-09-12T01:57:22.957415+0000","last_clean":"2024-09-12T01:57:22.957415+0000","last_became_active":"2024-09-12T01:57:22.954949+0000","last_became_peered":"2024-09-12T01:57:22.954949+0000","last_unstale":"2024-09-12T01:57:22.957415+0000","last_undegraded":"2024-09-12T01:57:22.957415+0000","last_fullsized":"2024-09-12T01:57:22.957415+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:38.707897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954634+0000","last_change":"2024-09-12T01:56:38.174983+0000","last_active":"2024-09-12T01:57:22.954634+0000","last_peered":"2024-09-12T01:57:22.954634+0000","last_clean":"2024-09-12T01:57:22.954634+0000","last_became_active":"2024-09-12T01:56:38.174578+0000","last_became_peered":"2024-09-12T01:56:38.174578+0000","last_unstale":"2024-09-12T01:57:22.954634+0000","last_undegraded":"2024-09-12T01:57:22.954634+0000","last_fullsized":"2024-09-12T01:57:22.954634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:44.629321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.957417+0000","last_change":"2024-09-12T01:56:49.881829+0000","last_active":"2024-09-12T01:57:22.957417+0000","last_peered":"2024-09-12T01:57:22.957417+0000","last_clean":"2024-09-12T01:57:22.957417+0000","last_became_active":"2024-09-12T01:56:49.881373+0000","last_became_peered":"2024-09-12T01:56:49.881373+0000","last_unstale":"2024-09-12T01:57:22.957417+0000","last_undegraded":"2024-09-12T01:57:22.957417+0000","last_fullsized":"2024-09-12T01:57:22.957417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:36.706558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954402+0000","last_change":"2024-09-12T01:56:40.810202+0000","last_active":"2024-09-12T01:57:22.954402+0000","last_peered":"2024-09-12T01:57:22.954402+0000","last_clean":"2024-09-12T01:57:22.954402+0000","last_became_active":"2024-09-12T01:56:40.808567+0000","last_became_peered":"2024-09-12T01:56:40.808567+0000","last_unstale":"2024-09-12T01:57:22.954402+0000","last_undegraded":"2024-09-12T01:57:22.954402+0000","last_fullsized":"2024-09-12T01:57:22.954402+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:49.157369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949569+0000","last_change":"2024-09-12T01:56:37.753459+0000","last_active":"2024-09-12T01:57:22.949569+0000","last_peered":"2024-09-12T01:57:22.949569+0000","last_clean":"2024-09-12T01:57:22.949569+0000","last_became_active":"2024-09-12T01:56:37.753129+0000","last_became_peered":"2024-09-12T01:56:37.753129+0000","last_unstale":"2024-09-12T01:57:22.949569+0000","last_undegraded":"2024-09-12T01:57:22.949569+0000","last_fullsized":"2024-09-12T01:57:22.949569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:47.841217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481822+0000","last_change":"2024-09-12T01:56:49.881600+0000","last_active":"2024-09-12T01:57:23.481822+0000","last_peered":"2024-09-12T01:57:23.481822+0000","last_clean":"2024-09-12T01:57:23.481822+0000","last_became_active":"2024-09-12T01:56:49.881116+0000","last_became_peered":"2024-09-12T01:56:49.881116+0000","last_unstale":"2024-09-12T01:57:23.481822+0000","last_undegraded":"2024-09-12T01:57:23.481822+0000","last_fullsized":"2024-09-12T01:57:23.481822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:42.515473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946172+0000","last_change":"2024-09-12T01:56:40.796878+0000","last_active":"2024-09-12T01:57:22.946172+0000","last_peered":"2024-09-12T01:57:22.946172+0000","last_clean":"2024-09-12T01:57:22.946172+0000","last_became_active":"2024-09-12T01:56:40.795031+0000","last_became_peered":"2024-09-12T01:56:40.795031+0000","last_unstale":"2024-09-12T01:57:22.946172+0000","last_undegraded":"2024-09-12T01:57:22.946172+0000","last_fullsized":"2024-09-12T01:57:22.946172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:02.497135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947593+0000","last_change":"2024-09-12T01:56:37.754379+0000","last_active":"2024-09-12T01:57:22.947593+0000","last_peered":"2024-09-12T01:57:22.947593+0000","last_clean":"2024-09-12T01:57:22.947593+0000","last_became_active":"2024-09-12T01:56:37.753986+0000","last_became_peered":"2024-09-12T01:56:37.753986+0000","last_unstale":"2024-09-12T01:57:22.947593+0000","last_undegraded":"2024-09-12T01:57:22.947593+0000","last_fullsized":"2024-09-12T01:57:22.947593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:09.877482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":360,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949762+0000","last_change":"2024-09-12T01:55:24.577685+0000","last_active":"2024-09-12T01:57:22.949762+0000","last_peered":"2024-09-12T01:57:22.949762+0000","last_clean":"2024-09-12T01:57:22.949762+0000","last_became_active":"2024-09-12T01:55:24.577248+0000","last_became_peered":"2024-09-12T01:55:24.577248+0000","last_unstale":"2024-09-12T01:57:22.949762+0000","last_undegraded":"2024-09-12T01:57:22.949762+0000","last_fullsized":"2024-09-12T01:57:22.949762+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:51:44.081524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:51:44.081524+0000","last_clean_scrub_stamp":"2024-09-12T01:51:44.081524+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:25.146507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950317+0000","last_change":"2024-09-12T01:56:49.872339+0000","last_active":"2024-09-12T01:57:22.950317+0000","last_peered":"2024-09-12T01:57:22.950317+0000","last_clean":"2024-09-12T01:57:22.950317+0000","last_became_active":"2024-09-12T01:56:49.872035+0000","last_became_peered":"2024-09-12T01:56:49.872035+0000","last_unstale":"2024-09-12T01:57:22.950317+0000","last_undegraded":"2024-09-12T01:57:22.950317+0000","last_fullsized":"2024-09-12T01:57:22.950317+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:28.512384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950428+0000","last_change":"2024-09-12T01:56:40.805832+0000","last_active":"2024-09-12T01:57:22.950428+0000","last_peered":"2024-09-12T01:57:22.950428+0000","last_clean":"2024-09-12T01:57:22.950428+0000","last_became_active":"2024-09-12T01:56:40.805407+0000","last_became_peered":"2024-09-12T01:56:40.805407+0000","last_unstale":"2024-09-12T01:57:22.950428+0000","last_undegraded":"2024-09-12T01:57:22.950428+0000","last_fullsized":"2024-09-12T01:57:22.950428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:36.699461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.958274+0000","last_change":"2024-09-12T01:57:22.958274+0000","last_active":"2024-09-12T01:57:22.958274+0000","last_peered":"2024-09-12T01:57:22.958274+0000","last_clean":"2024-09-12T01:57:22.958274+0000","last_became_active":"2024-09-12T01:57:22.957927+0000","last_became_peered":"2024-09-12T01:57:22.957927+0000","last_unstale":"2024-09-12T01:57:22.958274+0000","last_undegraded":"2024-09-12T01:57:22.958274+0000","last_fullsized":"2024-09-12T01:57:22.958274+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:58.031082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950975+0000","last_change":"2024-09-12T01:56:49.863237+0000","last_active":"2024-09-12T01:57:22.950975+0000","last_peered":"2024-09-12T01:57:22.950975+0000","last_clean":"2024-09-12T01:57:22.950975+0000","last_became_active":"2024-09-12T01:56:49.862831+0000","last_became_peered":"2024-09-12T01:56:49.862831+0000","last_unstale":"2024-09-12T01:57:22.950975+0000","last_undegraded":"2024-09-12T01:57:22.950975+0000","last_fullsized":"2024-09-12T01:57:22.950975+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:45.970500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949744+0000","last_change":"2024-09-12T01:56:40.806634+0000","last_active":"2024-09-12T01:57:22.949744+0000","last_peered":"2024-09-12T01:57:22.949744+0000","last_clean":"2024-09-12T01:57:22.949744+0000","last_became_active":"2024-09-12T01:56:40.806308+0000","last_became_peered":"2024-09-12T01:56:40.806308+0000","last_unstale":"2024-09-12T01:57:22.949744+0000","last_undegraded":"2024-09-12T01:57:22.949744+0000","last_fullsized":"2024-09-12T01:57:22.949744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:46.800939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482190+0000","last_change":"2024-09-12T01:56:37.752897+0000","last_active":"2024-09-12T01:57:23.482190+0000","last_peered":"2024-09-12T01:57:23.482190+0000","last_clean":"2024-09-12T01:57:23.482190+0000","last_became_active":"2024-09-12T01:56:37.752612+0000","last_became_peered":"2024-09-12T01:56:37.752612+0000","last_unstale":"2024-09-12T01:57:23.482190+0000","last_undegraded":"2024-09-12T01:57:23.482190+0000","last_fullsized":"2024-09-12T01:57:23.482190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:16.690620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949456+0000","last_change":"2024-09-12T01:56:49.876113+0000","last_active":"2024-09-12T01:57:22.949456+0000","last_peered":"2024-09-12T01:57:22.949456+0000","last_clean":"2024-09-12T01:57:22.949456+0000","last_became_active":"2024-09-12T01:56:49.875743+0000","last_became_peered":"2024-09-12T01:56:49.875743+0000","last_unstale":"2024-09-12T01:57:22.949456+0000","last_undegraded":"2024-09-12T01:57:22.949456+0000","last_fullsized":"2024-09-12T01:57:22.949456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:20.818024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950510+0000","last_change":"2024-09-12T01:56:40.799329+0000","last_active":"2024-09-12T01:57:22.950510+0000","last_peered":"2024-09-12T01:57:22.950510+0000","last_clean":"2024-09-12T01:57:22.950510+0000","last_became_active":"2024-09-12T01:56:40.798999+0000","last_became_peered":"2024-09-12T01:56:40.798999+0000","last_unstale":"2024-09-12T01:57:22.950510+0000","last_undegraded":"2024-09-12T01:57:22.950510+0000","last_fullsized":"2024-09-12T01:57:22.950510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:33.291045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.963796+0000","last_change":"2024-09-12T01:57:22.963796+0000","last_active":"2024-09-12T01:57:22.963796+0000","last_peered":"2024-09-12T01:57:22.963796+0000","last_clean":"2024-09-12T01:57:22.963796+0000","last_became_active":"2024-09-12T01:57:22.958887+0000","last_became_peered":"2024-09-12T01:57:22.958887+0000","last_unstale":"2024-09-12T01:57:22.963796+0000","last_undegraded":"2024-09-12T01:57:22.963796+0000","last_fullsized":"2024-09-12T01:57:22.963796+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:57.272630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480866+0000","last_change":"2024-09-12T01:56:49.864958+0000","last_active":"2024-09-12T01:57:23.480866+0000","last_peered":"2024-09-12T01:57:23.480866+0000","last_clean":"2024-09-12T01:57:23.480866+0000","last_became_active":"2024-09-12T01:56:49.864564+0000","last_became_peered":"2024-09-12T01:56:49.864564+0000","last_unstale":"2024-09-12T01:57:23.480866+0000","last_undegraded":"2024-09-12T01:57:23.480866+0000","last_fullsized":"2024-09-12T01:57:23.480866+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:20.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948473+0000","last_change":"2024-09-12T01:56:40.799887+0000","last_active":"2024-09-12T01:57:22.948473+0000","last_peered":"2024-09-12T01:57:22.948473+0000","last_clean":"2024-09-12T01:57:22.948473+0000","last_became_active":"2024-09-12T01:56:40.799561+0000","last_became_peered":"2024-09-12T01:56:40.799561+0000","last_unstale":"2024-09-12T01:57:22.948473+0000","last_undegraded":"2024-09-12T01:57:22.948473+0000","last_fullsized":"2024-09-12T01:57:22.948473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:25.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946890+0000","last_change":"2024-09-12T01:56:37.746147+0000","last_active":"2024-09-12T01:57:22.946890+0000","last_peered":"2024-09-12T01:57:22.946890+0000","last_clean":"2024-09-12T01:57:22.946890+0000","last_became_active":"2024-09-12T01:56:37.745810+0000","last_became_peered":"2024-09-12T01:56:37.745810+0000","last_unstale":"2024-09-12T01:57:22.946890+0000","last_undegraded":"2024-09-12T01:57:22.946890+0000","last_fullsized":"2024-09-12T01:57:22.946890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:09.304520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480837+0000","last_change":"2024-09-12T01:56:49.869301+0000","last_active":"2024-09-12T01:57:23.480837+0000","last_peered":"2024-09-12T01:57:23.480837+0000","last_clean":"2024-09-12T01:57:23.480837+0000","last_became_active":"2024-09-12T01:56:49.868883+0000","last_became_peered":"2024-09-12T01:56:49.868883+0000","last_unstale":"2024-09-12T01:57:23.480837+0000","last_undegraded":"2024-09-12T01:57:23.480837+0000","last_fullsized":"2024-09-12T01:57:23.480837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:11.110423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481186+0000","last_change":"2024-09-12T01:56:40.808574+0000","last_active":"2024-09-12T01:57:23.481186+0000","last_peered":"2024-09-12T01:57:23.481186+0000","last_clean":"2024-09-12T01:57:23.481186+0000","last_became_active":"2024-09-12T01:56:40.808257+0000","last_became_peered":"2024-09-12T01:56:40.808257+0000","last_unstale":"2024-09-12T01:57:23.481186+0000","last_undegraded":"2024-09-12T01:57:23.481186+0000","last_fullsized":"2024-09-12T01:57:23.481186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:58.375055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946185+0000","last_change":"2024-09-12T01:56:38.177026+0000","last_active":"2024-09-12T01:57:22.946185+0000","last_peered":"2024-09-12T01:57:22.946185+0000","last_clean":"2024-09-12T01:57:22.946185+0000","last_became_active":"2024-09-12T01:56:38.176566+0000","last_became_peered":"2024-09-12T01:56:38.176566+0000","last_unstale":"2024-09-12T01:57:22.946185+0000","last_undegraded":"2024-09-12T01:57:22.946185+0000","last_fullsized":"2024-09-12T01:57:22.946185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:53.167228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956686+0000","last_change":"2024-09-12T01:56:49.876297+0000","last_active":"2024-09-12T01:57:22.956686+0000","last_peered":"2024-09-12T01:57:22.956686+0000","last_clean":"2024-09-12T01:57:22.956686+0000","last_became_active":"2024-09-12T01:56:49.875765+0000","last_became_peered":"2024-09-12T01:56:49.875765+0000","last_unstale":"2024-09-12T01:57:22.956686+0000","last_undegraded":"2024-09-12T01:57:22.956686+0000","last_fullsized":"2024-09-12T01:57:22.956686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:55.104025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949657+0000","last_change":"2024-09-12T01:56:40.801653+0000","last_active":"2024-09-12T01:57:22.949657+0000","last_peered":"2024-09-12T01:57:22.949657+0000","last_clean":"2024-09-12T01:57:22.949657+0000","last_became_active":"2024-09-12T01:56:40.801348+0000","last_became_peered":"2024-09-12T01:56:40.801348+0000","last_unstale":"2024-09-12T01:57:22.949657+0000","last_undegraded":"2024-09-12T01:57:22.949657+0000","last_fullsized":"2024-09-12T01:57:22.949657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:59.076443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947119+0000","last_change":"2024-09-12T01:56:37.749817+0000","last_active":"2024-09-12T01:57:22.947119+0000","last_peered":"2024-09-12T01:57:22.947119+0000","last_clean":"2024-09-12T01:57:22.947119+0000","last_became_active":"2024-09-12T01:56:37.749431+0000","last_became_peered":"2024-09-12T01:56:37.749431+0000","last_unstale":"2024-09-12T01:57:22.947119+0000","last_undegraded":"2024-09-12T01:57:22.947119+0000","last_fullsized":"2024-09-12T01:57:22.947119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:13.193083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956507+0000","last_change":"2024-09-12T01:56:49.877371+0000","last_active":"2024-09-12T01:57:22.956507+0000","last_peered":"2024-09-12T01:57:22.956507+0000","last_clean":"2024-09-12T01:57:22.956507+0000","last_became_active":"2024-09-12T01:56:49.873147+0000","last_became_peered":"2024-09-12T01:56:49.873147+0000","last_unstale":"2024-09-12T01:57:22.956507+0000","last_undegraded":"2024-09-12T01:57:22.956507+0000","last_fullsized":"2024-09-12T01:57:22.956507+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:23.215058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.958641+0000","last_change":"2024-09-12T01:57:22.958641+0000","last_active":"2024-09-12T01:57:22.958641+0000","last_peered":"2024-09-12T01:57:22.958641+0000","last_clean":"2024-09-12T01:57:22.958641+0000","last_became_active":"2024-09-12T01:57:22.958274+0000","last_became_peered":"2024-09-12T01:57:22.958274+0000","last_unstale":"2024-09-12T01:57:22.958641+0000","last_undegraded":"2024-09-12T01:57:22.958641+0000","last_fullsized":"2024-09-12T01:57:22.958641+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:22.529517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481486+0000","last_change":"2024-09-12T01:56:37.751527+0000","last_active":"2024-09-12T01:57:23.481486+0000","last_peered":"2024-09-12T01:57:23.481486+0000","last_clean":"2024-09-12T01:57:23.481486+0000","last_became_active":"2024-09-12T01:56:37.751190+0000","last_became_peered":"2024-09-12T01:56:37.751190+0000","last_unstale":"2024-09-12T01:57:23.481486+0000","last_undegraded":"2024-09-12T01:57:23.481486+0000","last_fullsized":"2024-09-12T01:57:23.481486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:01.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948103+0000","last_change":"2024-09-12T01:56:49.873101+0000","last_active":"2024-09-12T01:57:22.948103+0000","last_peered":"2024-09-12T01:57:22.948103+0000","last_clean":"2024-09-12T01:57:22.948103+0000","last_became_active":"2024-09-12T01:56:49.872670+0000","last_became_peered":"2024-09-12T01:56:49.872670+0000","last_unstale":"2024-09-12T01:57:22.948103+0000","last_undegraded":"2024-09-12T01:57:22.948103+0000","last_fullsized":"2024-09-12T01:57:22.948103+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.794244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954436+0000","last_change":"2024-09-12T01:56:40.805982+0000","last_active":"2024-09-12T01:57:22.954436+0000","last_peered":"2024-09-12T01:57:22.954436+0000","last_clean":"2024-09-12T01:57:22.954436+0000","last_became_active":"2024-09-12T01:56:40.805653+0000","last_became_peered":"2024-09-12T01:56:40.805653+0000","last_unstale":"2024-09-12T01:57:22.954436+0000","last_undegraded":"2024-09-12T01:57:22.954436+0000","last_fullsized":"2024-09-12T01:57:22.954436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:37.117089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'2","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952725+0000","last_change":"2024-09-12T01:56:37.753569+0000","last_active":"2024-09-12T01:57:22.952725+0000","last_peered":"2024-09-12T01:57:22.952725+0000","last_clean":"2024-09-12T01:57:22.952725+0000","last_became_active":"2024-09-12T01:56:37.753153+0000","last_became_peered":"2024-09-12T01:56:37.753153+0000","last_unstale":"2024-09-12T01:57:22.952725+0000","last_undegraded":"2024-09-12T01:57:22.952725+0000","last_fullsized":"2024-09-12T01:57:22.952725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:33.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481671+0000","last_change":"2024-09-12T01:56:49.866532+0000","last_active":"2024-09-12T01:57:23.481671+0000","last_peered":"2024-09-12T01:57:23.481671+0000","last_clean":"2024-09-12T01:57:23.481671+0000","last_became_active":"2024-09-12T01:56:49.866114+0000","last_became_peered":"2024-09-12T01:56:49.866114+0000","last_unstale":"2024-09-12T01:57:23.481671+0000","last_undegraded":"2024-09-12T01:57:23.481671+0000","last_fullsized":"2024-09-12T01:57:23.481671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:03.241292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946624+0000","last_change":"2024-09-12T01:56:40.799319+0000","last_active":"2024-09-12T01:57:22.946624+0000","last_peered":"2024-09-12T01:57:22.946624+0000","last_clean":"2024-09-12T01:57:22.946624+0000","last_became_active":"2024-09-12T01:56:40.798949+0000","last_became_peered":"2024-09-12T01:56:40.798949+0000","last_unstale":"2024-09-12T01:57:22.946624+0000","last_undegraded":"2024-09-12T01:57:22.946624+0000","last_fullsized":"2024-09-12T01:57:22.946624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:01.254059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'30","reported_seq":112,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:40.994276+0000","last_change":"2024-09-12T01:56:37.750425+0000","last_active":"2024-09-12T01:57:40.994276+0000","last_peered":"2024-09-12T01:57:40.994276+0000","last_clean":"2024-09-12T01:57:40.994276+0000","last_became_active":"2024-09-12T01:56:37.749995+0000","last_became_peered":"2024-09-12T01:56:37.749995+0000","last_unstale":"2024-09-12T01:57:40.994276+0000","last_undegraded":"2024-09-12T01:57:40.994276+0000","last_fullsized":"2024-09-12T01:57:40.994276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:53.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59728,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":80,"num_write":30,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949962+0000","last_change":"2024-09-12T01:56:49.872968+0000","last_active":"2024-09-12T01:57:22.949962+0000","last_peered":"2024-09-12T01:57:22.949962+0000","last_clean":"2024-09-12T01:57:22.949962+0000","last_became_active":"2024-09-12T01:56:49.872537+0000","last_became_peered":"2024-09-12T01:56:49.872537+0000","last_unstale":"2024-09-12T01:57:22.949962+0000","last_undegraded":"2024-09-12T01:57:22.949962+0000","last_fullsized":"2024-09-12T01:57:22.949962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:05.684396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951183+0000","last_change":"2024-09-12T01:56:40.808116+0000","last_active":"2024-09-12T01:57:22.951183+0000","last_peered":"2024-09-12T01:57:22.951183+0000","last_clean":"2024-09-12T01:57:22.951183+0000","last_became_active":"2024-09-12T01:56:40.807763+0000","last_became_peered":"2024-09-12T01:56:40.807763+0000","last_unstale":"2024-09-12T01:57:22.951183+0000","last_undegraded":"2024-09-12T01:57:22.951183+0000","last_fullsized":"2024-09-12T01:57:22.951183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:24.553929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'3","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481823+0000","last_change":"2024-09-12T01:56:38.177027+0000","last_active":"2024-09-12T01:57:23.481823+0000","last_peered":"2024-09-12T01:57:23.481823+0000","last_clean":"2024-09-12T01:57:23.481823+0000","last_became_active":"2024-09-12T01:56:38.176610+0000","last_became_peered":"2024-09-12T01:56:38.176610+0000","last_unstale":"2024-09-12T01:57:23.481823+0000","last_undegraded":"2024-09-12T01:57:23.481823+0000","last_fullsized":"2024-09-12T01:57:23.481823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:18.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947469+0000","last_change":"2024-09-12T01:56:49.875835+0000","last_active":"2024-09-12T01:57:22.947469+0000","last_peered":"2024-09-12T01:57:22.947469+0000","last_clean":"2024-09-12T01:57:22.947469+0000","last_became_active":"2024-09-12T01:56:49.875310+0000","last_became_peered":"2024-09-12T01:56:49.875310+0000","last_unstale":"2024-09-12T01:57:22.947469+0000","last_undegraded":"2024-09-12T01:57:22.947469+0000","last_fullsized":"2024-09-12T01:57:22.947469+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:57.153633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482387+0000","last_change":"2024-09-12T01:57:23.482387+0000","last_active":"2024-09-12T01:57:23.482387+0000","last_peered":"2024-09-12T01:57:23.482387+0000","last_clean":"2024-09-12T01:57:23.482387+0000","last_became_active":"2024-09-12T01:57:23.481842+0000","last_became_peered":"2024-09-12T01:57:23.481842+0000","last_unstale":"2024-09-12T01:57:23.482387+0000","last_undegraded":"2024-09-12T01:57:23.482387+0000","last_fullsized":"2024-09-12T01:57:23.482387+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:40.227322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950521+0000","last_change":"2024-09-12T01:56:37.749911+0000","last_active":"2024-09-12T01:57:22.950521+0000","last_peered":"2024-09-12T01:57:22.950521+0000","last_clean":"2024-09-12T01:57:22.950521+0000","last_became_active":"2024-09-12T01:56:37.749565+0000","last_became_peered":"2024-09-12T01:56:37.749565+0000","last_unstale":"2024-09-12T01:57:22.950521+0000","last_undegraded":"2024-09-12T01:57:22.950521+0000","last_fullsized":"2024-09-12T01:57:22.950521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:33.462391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949697+0000","last_change":"2024-09-12T01:56:49.873274+0000","last_active":"2024-09-12T01:57:22.949697+0000","last_peered":"2024-09-12T01:57:22.949697+0000","last_clean":"2024-09-12T01:57:22.949697+0000","last_became_active":"2024-09-12T01:56:49.872769+0000","last_became_peered":"2024-09-12T01:56:49.872769+0000","last_unstale":"2024-09-12T01:57:22.949697+0000","last_undegraded":"2024-09-12T01:57:22.949697+0000","last_fullsized":"2024-09-12T01:57:22.949697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:04.288198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951512+0000","last_change":"2024-09-12T01:56:40.798008+0000","last_active":"2024-09-12T01:57:22.951512+0000","last_peered":"2024-09-12T01:57:22.951512+0000","last_clean":"2024-09-12T01:57:22.951512+0000","last_became_active":"2024-09-12T01:56:40.797607+0000","last_became_peered":"2024-09-12T01:56:40.797607+0000","last_unstale":"2024-09-12T01:57:22.951512+0000","last_undegraded":"2024-09-12T01:57:22.951512+0000","last_fullsized":"2024-09-12T01:57:22.951512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.738161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481088+0000","last_change":"2024-09-12T01:56:37.754607+0000","last_active":"2024-09-12T01:57:23.481088+0000","last_peered":"2024-09-12T01:57:23.481088+0000","last_clean":"2024-09-12T01:57:23.481088+0000","last_became_active":"2024-09-12T01:56:37.754311+0000","last_became_peered":"2024-09-12T01:56:37.754311+0000","last_unstale":"2024-09-12T01:57:23.481088+0000","last_undegraded":"2024-09-12T01:57:23.481088+0000","last_fullsized":"2024-09-12T01:57:23.481088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:05.597502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.945922+0000","last_change":"2024-09-12T01:56:49.860561+0000","last_active":"2024-09-12T01:57:22.945922+0000","last_peered":"2024-09-12T01:57:22.945922+0000","last_clean":"2024-09-12T01:57:22.945922+0000","last_became_active":"2024-09-12T01:56:49.860149+0000","last_became_peered":"2024-09-12T01:56:49.860149+0000","last_unstale":"2024-09-12T01:57:22.945922+0000","last_undegraded":"2024-09-12T01:57:22.945922+0000","last_fullsized":"2024-09-12T01:57:22.945922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:19.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949432+0000","last_change":"2024-09-12T01:56:49.868171+0000","last_active":"2024-09-12T01:57:22.949432+0000","last_peered":"2024-09-12T01:57:22.949432+0000","last_clean":"2024-09-12T01:57:22.949432+0000","last_became_active":"2024-09-12T01:56:49.867729+0000","last_became_peered":"2024-09-12T01:56:49.867729+0000","last_unstale":"2024-09-12T01:57:22.949432+0000","last_undegraded":"2024-09-12T01:57:22.949432+0000","last_fullsized":"2024-09-12T01:57:22.949432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:48.599568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949836+0000","last_change":"2024-09-12T01:56:40.807872+0000","last_active":"2024-09-12T01:57:22.949836+0000","last_peered":"2024-09-12T01:57:22.949836+0000","last_clean":"2024-09-12T01:57:22.949836+0000","last_became_active":"2024-09-12T01:56:40.807422+0000","last_became_peered":"2024-09-12T01:56:40.807422+0000","last_unstale":"2024-09-12T01:57:22.949836+0000","last_undegraded":"2024-09-12T01:57:22.949836+0000","last_fullsized":"2024-09-12T01:57:22.949836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.679501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481145+0000","last_change":"2024-09-12T01:56:37.750758+0000","last_active":"2024-09-12T01:57:23.481145+0000","last_peered":"2024-09-12T01:57:23.481145+0000","last_clean":"2024-09-12T01:57:23.481145+0000","last_became_active":"2024-09-12T01:56:37.750455+0000","last_became_peered":"2024-09-12T01:56:37.750455+0000","last_unstale":"2024-09-12T01:57:23.481145+0000","last_undegraded":"2024-09-12T01:57:23.481145+0000","last_fullsized":"2024-09-12T01:57:23.481145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:44.279233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948593+0000","last_change":"2024-09-12T01:56:49.877992+0000","last_active":"2024-09-12T01:57:22.948593+0000","last_peered":"2024-09-12T01:57:22.948593+0000","last_clean":"2024-09-12T01:57:22.948593+0000","last_became_active":"2024-09-12T01:56:49.877682+0000","last_became_peered":"2024-09-12T01:56:49.877682+0000","last_unstale":"2024-09-12T01:57:22.948593+0000","last_undegraded":"2024-09-12T01:57:22.948593+0000","last_fullsized":"2024-09-12T01:57:22.948593+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:28.326232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.945922+0000","last_change":"2024-09-12T01:56:40.803688+0000","last_active":"2024-09-12T01:57:22.945922+0000","last_peered":"2024-09-12T01:57:22.945922+0000","last_clean":"2024-09-12T01:57:22.945922+0000","last_became_active":"2024-09-12T01:56:40.797538+0000","last_became_peered":"2024-09-12T01:56:40.797538+0000","last_unstale":"2024-09-12T01:57:22.945922+0000","last_undegraded":"2024-09-12T01:57:22.945922+0000","last_fullsized":"2024-09-12T01:57:22.945922+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:19.309770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954527+0000","last_change":"2024-09-12T01:56:37.756077+0000","last_active":"2024-09-12T01:57:22.954527+0000","last_peered":"2024-09-12T01:57:22.954527+0000","last_clean":"2024-09-12T01:57:22.954527+0000","last_became_active":"2024-09-12T01:56:37.754873+0000","last_became_peered":"2024-09-12T01:56:37.754873+0000","last_unstale":"2024-09-12T01:57:22.954527+0000","last_undegraded":"2024-09-12T01:57:22.954527+0000","last_fullsized":"2024-09-12T01:57:22.954527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:38.889020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480689+0000","last_change":"2024-09-12T01:56:37.752122+0000","last_active":"2024-09-12T01:57:23.480689+0000","last_peered":"2024-09-12T01:57:23.480689+0000","last_clean":"2024-09-12T01:57:23.480689+0000","last_became_active":"2024-09-12T01:56:37.751690+0000","last_became_peered":"2024-09-12T01:56:37.751690+0000","last_unstale":"2024-09-12T01:57:23.480689+0000","last_undegraded":"2024-09-12T01:57:23.480689+0000","last_fullsized":"2024-09-12T01:57:23.480689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:37.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481499+0000","last_change":"2024-09-12T01:56:40.800079+0000","last_active":"2024-09-12T01:57:23.481499+0000","last_peered":"2024-09-12T01:57:23.481499+0000","last_clean":"2024-09-12T01:57:23.481499+0000","last_became_active":"2024-09-12T01:56:40.799766+0000","last_became_peered":"2024-09-12T01:56:40.799766+0000","last_unstale":"2024-09-12T01:57:23.481499+0000","last_undegraded":"2024-09-12T01:57:23.481499+0000","last_fullsized":"2024-09-12T01:57:23.481499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:32.211511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951575+0000","last_change":"2024-09-12T01:56:49.875360+0000","last_active":"2024-09-12T01:57:22.951575+0000","last_peered":"2024-09-12T01:57:22.951575+0000","last_clean":"2024-09-12T01:57:22.951575+0000","last_became_active":"2024-09-12T01:56:49.874781+0000","last_became_peered":"2024-09-12T01:56:49.874781+0000","last_unstale":"2024-09-12T01:57:22.951575+0000","last_undegraded":"2024-09-12T01:57:22.951575+0000","last_fullsized":"2024-09-12T01:57:22.951575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.667086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481582+0000","last_change":"2024-09-12T01:56:37.751251+0000","last_active":"2024-09-12T01:57:23.481582+0000","last_peered":"2024-09-12T01:57:23.481582+0000","last_clean":"2024-09-12T01:57:23.481582+0000","last_became_active":"2024-09-12T01:56:37.750886+0000","last_became_peered":"2024-09-12T01:56:37.750886+0000","last_unstale":"2024-09-12T01:57:23.481582+0000","last_undegraded":"2024-09-12T01:57:23.481582+0000","last_fullsized":"2024-09-12T01:57:23.481582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.377703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946203+0000","last_change":"2024-09-12T01:56:40.800259+0000","last_active":"2024-09-12T01:57:22.946203+0000","last_peered":"2024-09-12T01:57:22.946203+0000","last_clean":"2024-09-12T01:57:22.946203+0000","last_became_active":"2024-09-12T01:56:40.799892+0000","last_became_peered":"2024-09-12T01:56:40.799892+0000","last_unstale":"2024-09-12T01:57:22.946203+0000","last_undegraded":"2024-09-12T01:57:22.946203+0000","last_fullsized":"2024-09-12T01:57:22.946203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:59.402783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952362+0000","last_change":"2024-09-12T01:56:49.864057+0000","last_active":"2024-09-12T01:57:22.952362+0000","last_peered":"2024-09-12T01:57:22.952362+0000","last_clean":"2024-09-12T01:57:22.952362+0000","last_became_active":"2024-09-12T01:56:49.863033+0000","last_became_peered":"2024-09-12T01:56:49.863033+0000","last_unstale":"2024-09-12T01:57:22.952362+0000","last_undegraded":"2024-09-12T01:57:22.952362+0000","last_fullsized":"2024-09-12T01:57:22.952362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:11.134060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947710+0000","last_change":"2024-09-12T01:56:40.800392+0000","last_active":"2024-09-12T01:57:22.947710+0000","last_peered":"2024-09-12T01:57:22.947710+0000","last_clean":"2024-09-12T01:57:22.947710+0000","last_became_active":"2024-09-12T01:56:40.800042+0000","last_became_peered":"2024-09-12T01:56:40.800042+0000","last_unstale":"2024-09-12T01:57:22.947710+0000","last_undegraded":"2024-09-12T01:57:22.947710+0000","last_fullsized":"2024-09-12T01:57:22.947710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:15.543600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951920+0000","last_change":"2024-09-12T01:56:40.806231+0000","last_active":"2024-09-12T01:57:22.951920+0000","last_peered":"2024-09-12T01:57:22.951920+0000","last_clean":"2024-09-12T01:57:22.951920+0000","last_became_active":"2024-09-12T01:56:40.805748+0000","last_became_peered":"2024-09-12T01:56:40.805748+0000","last_unstale":"2024-09-12T01:57:22.951920+0000","last_undegraded":"2024-09-12T01:57:22.951920+0000","last_fullsized":"2024-09-12T01:57:22.951920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:48.753339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951532+0000","last_change":"2024-09-12T01:56:40.809433+0000","last_active":"2024-09-12T01:57:22.951532+0000","last_peered":"2024-09-12T01:57:22.951532+0000","last_clean":"2024-09-12T01:57:22.951532+0000","last_became_active":"2024-09-12T01:56:40.809000+0000","last_became_peered":"2024-09-12T01:56:40.809000+0000","last_unstale":"2024-09-12T01:57:22.951532+0000","last_undegraded":"2024-09-12T01:57:22.951532+0000","last_fullsized":"2024-09-12T01:57:22.951532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:45.506511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949568+0000","last_change":"2024-09-12T01:56:40.811304+0000","last_active":"2024-09-12T01:57:22.949568+0000","last_peered":"2024-09-12T01:57:22.949568+0000","last_clean":"2024-09-12T01:57:22.949568+0000","last_became_active":"2024-09-12T01:56:40.810759+0000","last_became_peered":"2024-09-12T01:56:40.810759+0000","last_unstale":"2024-09-12T01:57:22.949568+0000","last_undegraded":"2024-09-12T01:57:22.949568+0000","last_fullsized":"2024-09-12T01:57:22.949568+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:45.093498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956119+0000","last_change":"2024-09-12T01:56:40.809009+0000","last_active":"2024-09-12T01:57:22.956119+0000","last_peered":"2024-09-12T01:57:22.956119+0000","last_clean":"2024-09-12T01:57:22.956119+0000","last_became_active":"2024-09-12T01:56:40.808523+0000","last_became_peered":"2024-09-12T01:56:40.808523+0000","last_unstale":"2024-09-12T01:57:22.956119+0000","last_undegraded":"2024-09-12T01:57:22.956119+0000","last_fullsized":"2024-09-12T01:57:22.956119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:02.312093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948450+0000","last_change":"2024-09-12T01:56:40.796468+0000","last_active":"2024-09-12T01:57:22.948450+0000","last_peered":"2024-09-12T01:57:22.948450+0000","last_clean":"2024-09-12T01:57:22.948450+0000","last_became_active":"2024-09-12T01:56:40.796128+0000","last_became_peered":"2024-09-12T01:56:40.796128+0000","last_unstale":"2024-09-12T01:57:22.948450+0000","last_undegraded":"2024-09-12T01:57:22.948450+0000","last_fullsized":"2024-09-12T01:57:22.948450+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:55.521802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952974+0000","last_change":"2024-09-12T01:56:40.800836+0000","last_active":"2024-09-12T01:57:22.952974+0000","last_peered":"2024-09-12T01:57:22.952974+0000","last_clean":"2024-09-12T01:57:22.952974+0000","last_became_active":"2024-09-12T01:56:40.800274+0000","last_became_peered":"2024-09-12T01:56:40.800274+0000","last_unstale":"2024-09-12T01:57:22.952974+0000","last_undegraded":"2024-09-12T01:57:22.952974+0000","last_fullsized":"2024-09-12T01:57:22.952974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:27.774825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946804+0000","last_change":"2024-09-12T01:56:40.804247+0000","last_active":"2024-09-12T01:57:22.946804+0000","last_peered":"2024-09-12T01:57:22.946804+0000","last_clean":"2024-09-12T01:57:22.946804+0000","last_became_active":"2024-09-12T01:56:40.803892+0000","last_became_peered":"2024-09-12T01:56:40.803892+0000","last_unstale":"2024-09-12T01:57:22.946804+0000","last_undegraded":"2024-09-12T01:57:22.946804+0000","last_fullsized":"2024-09-12T01:57:22.946804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:57.537524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480965+0000","last_change":"2024-09-12T01:56:40.805206+0000","last_active":"2024-09-12T01:57:23.480965+0000","last_peered":"2024-09-12T01:57:23.480965+0000","last_clean":"2024-09-12T01:57:23.480965+0000","last_became_active":"2024-09-12T01:56:40.804710+0000","last_became_peered":"2024-09-12T01:56:40.804710+0000","last_unstale":"2024-09-12T01:57:23.480965+0000","last_undegraded":"2024-09-12T01:57:23.480965+0000","last_fullsized":"2024-09-12T01:57:23.480965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.945986+0000","last_change":"2024-09-12T01:56:40.795793+0000","last_active":"2024-09-12T01:57:22.945986+0000","last_peered":"2024-09-12T01:57:22.945986+0000","last_clean":"2024-09-12T01:57:22.945986+0000","last_became_active":"2024-09-12T01:56:40.795389+0000","last_became_peered":"2024-09-12T01:56:40.795389+0000","last_unstale":"2024-09-12T01:57:22.945986+0000","last_undegraded":"2024-09-12T01:57:22.945986+0000","last_fullsized":"2024-09-12T01:57:22.945986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:16.413066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951131+0000","last_change":"2024-09-12T01:56:40.800624+0000","last_active":"2024-09-12T01:57:22.951131+0000","last_peered":"2024-09-12T01:57:22.951131+0000","last_clean":"2024-09-12T01:57:22.951131+0000","last_became_active":"2024-09-12T01:56:40.800203+0000","last_became_peered":"2024-09-12T01:56:40.800203+0000","last_unstale":"2024-09-12T01:57:22.951131+0000","last_undegraded":"2024-09-12T01:57:22.951131+0000","last_fullsized":"2024-09-12T01:57:22.951131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:01.688455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955164+0000","last_change":"2024-09-12T01:56:40.814818+0000","last_active":"2024-09-12T01:57:22.955164+0000","last_peered":"2024-09-12T01:57:22.955164+0000","last_clean":"2024-09-12T01:57:22.955164+0000","last_became_active":"2024-09-12T01:56:40.813521+0000","last_became_peered":"2024-09-12T01:56:40.813521+0000","last_unstale":"2024-09-12T01:57:22.955164+0000","last_undegraded":"2024-09-12T01:57:22.955164+0000","last_fullsized":"2024-09-12T01:57:22.955164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.393165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948221+0000","last_change":"2024-09-12T01:56:40.808186+0000","last_active":"2024-09-12T01:57:22.948221+0000","last_peered":"2024-09-12T01:57:22.948221+0000","last_clean":"2024-09-12T01:57:22.948221+0000","last_became_active":"2024-09-12T01:56:40.807817+0000","last_became_peered":"2024-09-12T01:56:40.807817+0000","last_unstale":"2024-09-12T01:57:22.948221+0000","last_undegraded":"2024-09-12T01:57:22.948221+0000","last_fullsized":"2024-09-12T01:57:22.948221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:21.055662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952548+0000","last_change":"2024-09-12T01:56:40.805693+0000","last_active":"2024-09-12T01:57:22.952548+0000","last_peered":"2024-09-12T01:57:22.952548+0000","last_clean":"2024-09-12T01:57:22.952548+0000","last_became_active":"2024-09-12T01:56:40.805327+0000","last_became_peered":"2024-09-12T01:56:40.805327+0000","last_unstale":"2024-09-12T01:57:22.952548+0000","last_undegraded":"2024-09-12T01:57:22.952548+0000","last_fullsized":"2024-09-12T01:57:22.952548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:40.313504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956039+0000","last_change":"2024-09-12T01:56:40.802263+0000","last_active":"2024-09-12T01:57:22.956039+0000","last_peered":"2024-09-12T01:57:22.956039+0000","last_clean":"2024-09-12T01:57:22.956039+0000","last_became_active":"2024-09-12T01:56:40.801009+0000","last_became_peered":"2024-09-12T01:56:40.801009+0000","last_unstale":"2024-09-12T01:57:22.956039+0000","last_undegraded":"2024-09-12T01:57:22.956039+0000","last_fullsized":"2024-09-12T01:57:22.956039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:03.283370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948958+0000","last_change":"2024-09-12T01:56:40.817597+0000","last_active":"2024-09-12T01:57:22.948958+0000","last_peered":"2024-09-12T01:57:22.948958+0000","last_clean":"2024-09-12T01:57:22.948958+0000","last_became_active":"2024-09-12T01:56:40.817314+0000","last_became_peered":"2024-09-12T01:56:40.817314+0000","last_unstale":"2024-09-12T01:57:22.948958+0000","last_undegraded":"2024-09-12T01:57:22.948958+0000","last_fullsized":"2024-09-12T01:57:22.948958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:33.421685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950442+0000","last_change":"2024-09-12T01:56:40.803580+0000","last_active":"2024-09-12T01:57:22.950442+0000","last_peered":"2024-09-12T01:57:22.950442+0000","last_clean":"2024-09-12T01:57:22.950442+0000","last_became_active":"2024-09-12T01:56:40.803251+0000","last_became_peered":"2024-09-12T01:56:40.803251+0000","last_unstale":"2024-09-12T01:57:22.950442+0000","last_undegraded":"2024-09-12T01:57:22.950442+0000","last_fullsized":"2024-09-12T01:57:22.950442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:48.813142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954092+0000","last_change":"2024-09-12T01:57:22.954092+0000","last_active":"2024-09-12T01:57:22.954092+0000","last_peered":"2024-09-12T01:57:22.954092+0000","last_clean":"2024-09-12T01:57:22.954092+0000","last_became_active":"2024-09-12T01:57:22.953702+0000","last_became_peered":"2024-09-12T01:57:22.953702+0000","last_unstale":"2024-09-12T01:57:22.954092+0000","last_undegraded":"2024-09-12T01:57:22.954092+0000","last_fullsized":"2024-09-12T01:57:22.954092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:21.939930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949090+0000","last_change":"2024-09-12T01:56:40.805635+0000","last_active":"2024-09-12T01:57:22.949090+0000","last_peered":"2024-09-12T01:57:22.949090+0000","last_clean":"2024-09-12T01:57:22.949090+0000","last_became_active":"2024-09-12T01:56:40.805272+0000","last_became_peered":"2024-09-12T01:56:40.805272+0000","last_unstale":"2024-09-12T01:57:22.949090+0000","last_undegraded":"2024-09-12T01:57:22.949090+0000","last_fullsized":"2024-09-12T01:57:22.949090+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:38.069722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955059+0000","last_change":"2024-09-12T01:56:40.804448+0000","last_active":"2024-09-12T01:57:22.955059+0000","last_peered":"2024-09-12T01:57:22.955059+0000","last_clean":"2024-09-12T01:57:22.955059+0000","last_became_active":"2024-09-12T01:56:40.804087+0000","last_became_peered":"2024-09-12T01:56:40.804087+0000","last_unstale":"2024-09-12T01:57:22.955059+0000","last_undegraded":"2024-09-12T01:57:22.955059+0000","last_fullsized":"2024-09-12T01:57:22.955059+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:21.840684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947614+0000","last_change":"2024-09-12T01:56:40.805791+0000","last_active":"2024-09-12T01:57:22.947614+0000","last_peered":"2024-09-12T01:57:22.947614+0000","last_clean":"2024-09-12T01:57:22.947614+0000","last_became_active":"2024-09-12T01:56:40.805240+0000","last_became_peered":"2024-09-12T01:56:40.805240+0000","last_unstale":"2024-09-12T01:57:22.947614+0000","last_undegraded":"2024-09-12T01:57:22.947614+0000","last_fullsized":"2024-09-12T01:57:22.947614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:14.060341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950705+0000","last_change":"2024-09-12T01:56:40.803546+0000","last_active":"2024-09-12T01:57:22.950705+0000","last_peered":"2024-09-12T01:57:22.950705+0000","last_clean":"2024-09-12T01:57:22.950705+0000","last_became_active":"2024-09-12T01:56:40.803235+0000","last_became_peered":"2024-09-12T01:56:40.803235+0000","last_unstale":"2024-09-12T01:57:22.950705+0000","last_undegraded":"2024-09-12T01:57:22.950705+0000","last_fullsized":"2024-09-12T01:57:22.950705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:15.758641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481136+0000","last_change":"2024-09-12T01:56:40.806725+0000","last_active":"2024-09-12T01:57:23.481136+0000","last_peered":"2024-09-12T01:57:23.481136+0000","last_clean":"2024-09-12T01:57:23.481136+0000","last_became_active":"2024-09-12T01:56:40.806378+0000","last_became_peered":"2024-09-12T01:56:40.806378+0000","last_unstale":"2024-09-12T01:57:23.481136+0000","last_undegraded":"2024-09-12T01:57:23.481136+0000","last_fullsized":"2024-09-12T01:57:23.481136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:09.124282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951505+0000","last_change":"2024-09-12T01:56:40.794601+0000","last_active":"2024-09-12T01:57:22.951505+0000","last_peered":"2024-09-12T01:57:22.951505+0000","last_clean":"2024-09-12T01:57:22.951505+0000","last_became_active":"2024-09-12T01:56:40.794281+0000","last_became_peered":"2024-09-12T01:56:40.794281+0000","last_unstale":"2024-09-12T01:57:22.951505+0000","last_undegraded":"2024-09-12T01:57:22.951505+0000","last_fullsized":"2024-09-12T01:57:22.951505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.408464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.945905+0000","last_change":"2024-09-12T01:56:40.806003+0000","last_active":"2024-09-12T01:57:22.945905+0000","last_peered":"2024-09-12T01:57:22.945905+0000","last_clean":"2024-09-12T01:57:22.945905+0000","last_became_active":"2024-09-12T01:56:40.805689+0000","last_became_peered":"2024-09-12T01:56:40.805689+0000","last_unstale":"2024-09-12T01:57:22.945905+0000","last_undegraded":"2024-09-12T01:57:22.945905+0000","last_fullsized":"2024-09-12T01:57:22.945905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:47.498654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950087+0000","last_change":"2024-09-12T01:56:40.800840+0000","last_active":"2024-09-12T01:57:22.950087+0000","last_peered":"2024-09-12T01:57:22.950087+0000","last_clean":"2024-09-12T01:57:22.950087+0000","last_became_active":"2024-09-12T01:56:40.800479+0000","last_became_peered":"2024-09-12T01:56:40.800479+0000","last_unstale":"2024-09-12T01:57:22.950087+0000","last_undegraded":"2024-09-12T01:57:22.950087+0000","last_fullsized":"2024-09-12T01:57:22.950087+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:11.789524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480654+0000","last_change":"2024-09-12T01:56:40.799488+0000","last_active":"2024-09-12T01:57:23.480654+0000","last_peered":"2024-09-12T01:57:23.480654+0000","last_clean":"2024-09-12T01:57:23.480654+0000","last_became_active":"2024-09-12T01:56:40.799131+0000","last_became_peered":"2024-09-12T01:56:40.799131+0000","last_unstale":"2024-09-12T01:57:23.480654+0000","last_undegraded":"2024-09-12T01:57:23.480654+0000","last_fullsized":"2024-09-12T01:57:23.480654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:37.722651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946176+0000","last_change":"2024-09-12T01:56:40.809821+0000","last_active":"2024-09-12T01:57:22.946176+0000","last_peered":"2024-09-12T01:57:22.946176+0000","last_clean":"2024-09-12T01:57:22.946176+0000","last_became_active":"2024-09-12T01:56:40.809500+0000","last_became_peered":"2024-09-12T01:56:40.809500+0000","last_unstale":"2024-09-12T01:57:22.946176+0000","last_undegraded":"2024-09-12T01:57:22.946176+0000","last_fullsized":"2024-09-12T01:57:22.946176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:23.271230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947610+0000","last_change":"2024-09-12T01:56:40.805722+0000","last_active":"2024-09-12T01:57:22.947610+0000","last_peered":"2024-09-12T01:57:22.947610+0000","last_clean":"2024-09-12T01:57:22.947610+0000","last_became_active":"2024-09-12T01:56:40.805406+0000","last_became_peered":"2024-09-12T01:56:40.805406+0000","last_unstale":"2024-09-12T01:57:22.947610+0000","last_undegraded":"2024-09-12T01:57:22.947610+0000","last_fullsized":"2024-09-12T01:57:22.947610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:14.214021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951499+0000","last_change":"2024-09-12T01:56:40.807957+0000","last_active":"2024-09-12T01:57:22.951499+0000","last_peered":"2024-09-12T01:57:22.951499+0000","last_clean":"2024-09-12T01:57:22.951499+0000","last_became_active":"2024-09-12T01:56:40.807635+0000","last_became_peered":"2024-09-12T01:56:40.807635+0000","last_unstale":"2024-09-12T01:57:22.951499+0000","last_undegraded":"2024-09-12T01:57:22.951499+0000","last_fullsized":"2024-09-12T01:57:22.951499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:05.378671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949492+0000","last_change":"2024-09-12T01:56:40.813995+0000","last_active":"2024-09-12T01:57:22.949492+0000","last_peered":"2024-09-12T01:57:22.949492+0000","last_clean":"2024-09-12T01:57:22.949492+0000","last_became_active":"2024-09-12T01:56:40.806665+0000","last_became_peered":"2024-09-12T01:56:40.806665+0000","last_unstale":"2024-09-12T01:57:22.949492+0000","last_undegraded":"2024-09-12T01:57:22.949492+0000","last_fullsized":"2024-09-12T01:57:22.949492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:01.652850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948866+0000","last_change":"2024-09-12T01:56:40.817591+0000","last_active":"2024-09-12T01:57:22.948866+0000","last_peered":"2024-09-12T01:57:22.948866+0000","last_clean":"2024-09-12T01:57:22.948866+0000","last_became_active":"2024-09-12T01:56:40.817281+0000","last_became_peered":"2024-09-12T01:56:40.817281+0000","last_unstale":"2024-09-12T01:57:22.948866+0000","last_undegraded":"2024-09-12T01:57:22.948866+0000","last_fullsized":"2024-09-12T01:57:22.948866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:51.933536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60526,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":50,"num_read_kb":86,"num_write":82,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":177313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514522,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":518042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743454,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32852,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712300,"statfs":{"total":95995035648,"available":95961395200,"internally_reserved":0,"allocated":1708032,"data_stored":1164236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906979,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":522720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":518646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364846,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36944,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708208,"statfs":{"total":95995035648,"available":95957204992,"internally_reserved":0,"allocated":1638400,"data_stored":1113088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1032192,"data_stored":513946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757306,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32788,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712364,"statfs":{"total":95995035648,"available":95961460736,"internally_reserved":0,"allocated":1642496,"data_stored":1108592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920831,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":518064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149764,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":514050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":569443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":573674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1036288,"data_stored":514036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":55497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":59922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:57:44.583 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:57:44.583 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T01:57:44.583 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T01:57:44.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:44 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:57:44.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:44 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:57:44.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:44 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:44.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:44 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:57:44.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:44 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:57:44.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:44 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:44.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:44 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:57:44.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:44 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:57:44.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:44 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:57:44.967 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:45.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.567+0000 7f8a13200640 1 -- 172.21.15.62:0/2686762275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a14105810 msgr2=0x7f8a1410c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.567+0000 7f8a13200640 1 --2- 172.21.15.62:0/2686762275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a14105810 0x7f8a1410c0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009ca0 tx=0x7f8a0c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.567+0000 7f8a13200640 1 -- 172.21.15.62:0/2686762275 shutdown_connections 2024-09-12T01:57:45.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.567+0000 7f8a13200640 1 --2- 172.21.15.62:0/2686762275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a14105810 0x7f8a1410c0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.567+0000 7f8a13200640 1 --2- 172.21.15.62:0/2686762275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a14104e50 0x7f8a141052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.567+0000 7f8a13200640 1 --2- 172.21.15.62:0/2686762275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a14103c50 0x7f8a14104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.567+0000 7f8a13200640 1 -- 172.21.15.62:0/2686762275 >> 172.21.15.62:0/2686762275 conn(0x7f8a140ff3e0 msgr2=0x7f8a14101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:45.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.567+0000 7f8a13200640 1 -- 172.21.15.62:0/2686762275 shutdown_connections 2024-09-12T01:57:45.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.567+0000 7f8a13200640 1 -- 172.21.15.62:0/2686762275 wait complete. 2024-09-12T01:57:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.568+0000 7f8a13200640 1 Processor -- start 2024-09-12T01:57:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.568+0000 7f8a13200640 1 -- start start 2024-09-12T01:57:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a13200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a14103c50 0x7f8a14199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a13200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a14104e50 0x7f8a1419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a13200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a14105810 0x7f8a141a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a13200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1410f900 con 0x7f8a14104e50 2024-09-12T01:57:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a13200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1410f780 con 0x7f8a14105810 2024-09-12T01:57:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a13200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1410fa80 con 0x7f8a14103c50 2024-09-12T01:57:45.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a14104e50 0x7f8a1419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a14104e50 0x7f8a1419a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34244/0 (socket says 172.21.15.62:34244) 2024-09-12T01:57:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a0be00640 1 -- 172.21.15.62:0/2996967206 learned_addr learned my addr 172.21.15.62:0/2996967206 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a11e00640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a14103c50 0x7f8a14199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.569+0000 7f8a12800640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a14105810 0x7f8a141a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a0be00640 1 -- 172.21.15.62:0/2996967206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a14103c50 msgr2=0x7f8a14199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a0be00640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a14103c50 0x7f8a14199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a0be00640 1 -- 172.21.15.62:0/2996967206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a14105810 msgr2=0x7f8a141a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a0be00640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a14105810 0x7f8a141a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a0be00640 1 -- 172.21.15.62:0/2996967206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a141a1aa0 con 0x7f8a14104e50 2024-09-12T01:57:45.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a12800640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a14105810 0x7f8a141a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:45.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a0be00640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a14104e50 0x7f8a1419a3b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00d950 tx=0x7f89fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:45.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a0aa00640 1 -- 172.21.15.62:0/2996967206 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc017030 con 0x7f8a14104e50 2024-09-12T01:57:45.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a0aa00640 1 -- 172.21.15.62:0/2996967206 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89fc004020 con 0x7f8a14104e50 2024-09-12T01:57:45.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a13200640 1 -- 172.21.15.62:0/2996967206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a141a1d90 con 0x7f8a14104e50 2024-09-12T01:57:45.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a0aa00640 1 -- 172.21.15.62:0/2996967206 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0047a0 con 0x7f8a14104e50 2024-09-12T01:57:45.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.570+0000 7f8a13200640 1 -- 172.21.15.62:0/2996967206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a141a2250 con 0x7f8a14104e50 2024-09-12T01:57:45.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.572+0000 7f8a13200640 1 -- 172.21.15.62:0/2996967206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1410af80 con 0x7f8a14104e50 2024-09-12T01:57:45.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.573+0000 7f8a0aa00640 1 -- 172.21.15.62:0/2996967206 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f89fc0041d0 con 0x7f8a14104e50 2024-09-12T01:57:45.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.575+0000 7f8a0aa00640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f89f80a2cc0 0x7f89f80a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:45.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.575+0000 7f8a0aa00640 1 -- 172.21.15.62:0/2996967206 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f89fc0ceea0 con 0x7f8a14104e50 2024-09-12T01:57:45.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.575+0000 7f8a11e00640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f89f80a2cc0 0x7f89f80a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:45.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.576+0000 7f8a11e00640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f89f80a2cc0 0x7f89f80a5180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8a14104cb0 tx=0x7f8a04005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:45.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.579+0000 7f8a0aa00640 1 -- 172.21.15.62:0/2996967206 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89fc09b8e0 con 0x7f8a14104e50 2024-09-12T01:57:45.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:45 smithi107 ceph-mon[35463]: pgmap v333: 129 pgs: 129 active+clean; 636 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-12T01:57:45.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:45 smithi107 ceph-mon[35463]: from='client.24775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:45.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:45 smithi077 ceph-mon[35095]: pgmap v333: 129 pgs: 129 active+clean; 636 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-12T01:57:45.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:45 smithi077 ceph-mon[35095]: from='client.24775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:45.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.833+0000 7f8a13200640 1 -- 172.21.15.62:0/2996967206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f8a1402da10 con 0x7f8a14104e50 2024-09-12T01:57:45.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:45 smithi062 ceph-mon[30666]: pgmap v333: 129 pgs: 129 active+clean; 636 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-12T01:57:45.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:45 smithi062 ceph-mon[30666]: from='client.24775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:45.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.837+0000 7f8a0aa00640 1 -- 172.21.15.62:0/2996967206 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f89fc0b9e20 con 0x7f8a14104e50 2024-09-12T01:57:45.838 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-09-12T01:57:45.838 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCZSuJmZhTCMRAAe8vOkAXv5rOxT0IYd6Qd1Q== 2024-09-12T01:57:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 -- 172.21.15.62:0/2996967206 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f89f80a2cc0 msgr2=0x7f89f80a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f89f80a2cc0 0x7f89f80a5180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8a14104cb0 tx=0x7f8a04005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 -- 172.21.15.62:0/2996967206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a14104e50 msgr2=0x7f8a1419a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a14104e50 0x7f8a1419a3b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00d950 tx=0x7f89fc00de10 comp rx=0 tx=0).stop 2024-09-12T01:57:45.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 -- 172.21.15.62:0/2996967206 shutdown_connections 2024-09-12T01:57:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f89f80a2cc0 0x7f89f80a5180 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a14105810 0x7f8a141a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a14104e50 0x7f8a1419a3b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 --2- 172.21.15.62:0/2996967206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a14103c50 0x7f8a14199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 -- 172.21.15.62:0/2996967206 >> 172.21.15.62:0/2996967206 conn(0x7f8a140ff3e0 msgr2=0x7f8a14108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 -- 172.21.15.62:0/2996967206 shutdown_connections 2024-09-12T01:57:45.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:45.840+0000 7f8a13200640 1 -- 172.21.15.62:0/2996967206 wait complete. 2024-09-12T01:57:46.515 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:46 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2996967206' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:57:46.515 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:46 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2996967206' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:57:46.553 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:57:46.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T01:57:46.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T01:57:46.634 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T01:57:46.634 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T01:57:46.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T01:57:46.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:46 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2996967206' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:57:46.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:46 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2996967206' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:57:46.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:46 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2996967206' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:57:46.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:46 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2996967206' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:57:47.052 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:47.494 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:47 smithi062 ceph-mon[30666]: pgmap v334: 129 pgs: 129 active+clean; 636 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.4 KiB/s wr, 4 op/s 2024-09-12T01:57:47.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.607+0000 7f6d41a00640 1 -- 172.21.15.62:0/1576820312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d3c109120 msgr2=0x7f6d3c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.607+0000 7f6d41a00640 1 --2- 172.21.15.62:0/1576820312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d3c109120 0x7f6d3c110ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009ca0 tx=0x7f6d3402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.607+0000 7f6d41a00640 1 -- 172.21.15.62:0/1576820312 shutdown_connections 2024-09-12T01:57:47.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.607+0000 7f6d41a00640 1 --2- 172.21.15.62:0/1576820312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d3c109120 0x7f6d3c110ca0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.607+0000 7f6d41a00640 1 --2- 172.21.15.62:0/1576820312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d3c1049a0 0x7f6d3c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.607+0000 7f6d41a00640 1 --2- 172.21.15.62:0/1576820312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3c103ff0 0x7f6d3c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.607+0000 7f6d41a00640 1 -- 172.21.15.62:0/1576820312 >> 172.21.15.62:0/1576820312 conn(0x7f6d3c0ffa90 msgr2=0x7f6d3c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:47.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.607+0000 7f6d41a00640 1 -- 172.21.15.62:0/1576820312 shutdown_connections 2024-09-12T01:57:47.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.608+0000 7f6d41a00640 1 -- 172.21.15.62:0/1576820312 wait complete. 2024-09-12T01:57:47.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.608+0000 7f6d41a00640 1 Processor -- start 2024-09-12T01:57:47.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d41a00640 1 -- start start 2024-09-12T01:57:47.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d41a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3c103ff0 0x7f6d3c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d41a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d3c1049a0 0x7f6d3c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d41a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d3c109120 0x7f6d3c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d41a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1141a0 con 0x7f6d3c103ff0 2024-09-12T01:57:47.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d41a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c114020 con 0x7f6d3c1049a0 2024-09-12T01:57:47.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d41a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c114320 con 0x7f6d3c109120 2024-09-12T01:57:47.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d3aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3c103ff0 0x7f6d3c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d3b400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d3c109120 0x7f6d3c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d3aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3c103ff0 0x7f6d3c19a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34256/0 (socket says 172.21.15.62:34256) 2024-09-12T01:57:47.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d3aa00640 1 -- 172.21.15.62:0/770519040 learned_addr learned my addr 172.21.15.62:0/770519040 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:47.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.609+0000 7f6d3a000640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d3c1049a0 0x7f6d3c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.610+0000 7f6d3a000640 1 -- 172.21.15.62:0/770519040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d3c109120 msgr2=0x7f6d3c19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.610+0000 7f6d3a000640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d3c109120 0x7f6d3c19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.610+0000 7f6d3a000640 1 -- 172.21.15.62:0/770519040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3c103ff0 msgr2=0x7f6d3c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.610+0000 7f6d3a000640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3c103ff0 0x7f6d3c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.610+0000 7f6d3a000640 1 -- 172.21.15.62:0/770519040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c19f570 con 0x7f6d3c1049a0 2024-09-12T01:57:47.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.610+0000 7f6d3aa00640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3c103ff0 0x7f6d3c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:47.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.610+0000 7f6d3a000640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d3c1049a0 0x7f6d3c19ab00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800e9f0 tx=0x7f6d2800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:47.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.611+0000 7f6d33400640 1 -- 172.21.15.62:0/770519040 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2800ccc0 con 0x7f6d3c1049a0 2024-09-12T01:57:47.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.611+0000 7f6d33400640 1 -- 172.21.15.62:0/770519040 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d28005020 con 0x7f6d3c1049a0 2024-09-12T01:57:47.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.611+0000 7f6d41a00640 1 -- 172.21.15.62:0/770519040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c19f860 con 0x7f6d3c1049a0 2024-09-12T01:57:47.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.611+0000 7f6d33400640 1 -- 172.21.15.62:0/770519040 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d280049e0 con 0x7f6d3c1049a0 2024-09-12T01:57:47.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.611+0000 7f6d41a00640 1 -- 172.21.15.62:0/770519040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c1a7140 con 0x7f6d3c1049a0 2024-09-12T01:57:47.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.612+0000 7f6d41a00640 1 -- 172.21.15.62:0/770519040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3c1043d0 con 0x7f6d3c1049a0 2024-09-12T01:57:47.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.614+0000 7f6d33400640 1 -- 172.21.15.62:0/770519040 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6d28005560 con 0x7f6d3c1049a0 2024-09-12T01:57:47.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.617+0000 7f6d33400640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6d200a2c90 0x7f6d200a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:47.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.617+0000 7f6d33400640 1 -- 172.21.15.62:0/770519040 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f6d280cf3a0 con 0x7f6d3c1049a0 2024-09-12T01:57:47.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.617+0000 7f6d3aa00640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6d200a2c90 0x7f6d200a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:47.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.617+0000 7f6d3aa00640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6d200a2c90 0x7f6d200a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c011550 tx=0x7f6d2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:47.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.620+0000 7f6d33400640 1 -- 172.21.15.62:0/770519040 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d280051d0 con 0x7f6d3c1049a0 2024-09-12T01:57:47.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:47 smithi107 ceph-mon[35463]: pgmap v334: 129 pgs: 129 active+clean; 636 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.4 KiB/s wr, 4 op/s 2024-09-12T01:57:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:47 smithi077 ceph-mon[35095]: pgmap v334: 129 pgs: 129 active+clean; 636 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.4 KiB/s wr, 4 op/s 2024-09-12T01:57:47.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.885+0000 7f6d41a00640 1 -- 172.21.15.62:0/770519040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6d3c1a7470 con 0x7f6d3c1049a0 2024-09-12T01:57:47.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.890+0000 7f6d33400640 1 -- 172.21.15.62:0/770519040 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263199 (secure 0 0 0) 0x7f6d2809be40 con 0x7f6d3c1049a0 2024-09-12T01:57:47.895 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:47.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 -- 172.21.15.62:0/770519040 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6d200a2c90 msgr2=0x7f6d200a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6d200a2c90 0x7f6d200a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c011550 tx=0x7f6d2c005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:47.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 -- 172.21.15.62:0/770519040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d3c1049a0 msgr2=0x7f6d3c19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:47.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d3c1049a0 0x7f6d3c19ab00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800e9f0 tx=0x7f6d2800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 -- 172.21.15.62:0/770519040 shutdown_connections 2024-09-12T01:57:47.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6d200a2c90 0x7f6d200a5150 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d3c109120 0x7f6d3c19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d3c1049a0 0x7f6d3c19ab00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 --2- 172.21.15.62:0/770519040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d3c103ff0 0x7f6d3c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:47.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 -- 172.21.15.62:0/770519040 >> 172.21.15.62:0/770519040 conn(0x7f6d3c0ffa90 msgr2=0x7f6d3c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:47.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 -- 172.21.15.62:0/770519040 shutdown_connections 2024-09-12T01:57:47.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:47.896+0000 7f6d41a00640 1 -- 172.21.15.62:0/770519040 wait complete. 2024-09-12T01:57:48.575 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:48 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/770519040' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:57:48.613 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1859863767},{"type":"v1","addr":"172.21.15.62:6801","nonce":1859863767}]},"active_addr":"172.21.15.62:6801/1859863767","active_change":"2024-09-12T01:49:21.439543+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.62:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2409675195}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2427919776}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":726819260}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":706736394}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":1178508000}]}]} 2024-09-12T01:57:48.618 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T01:57:48.618 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T01:57:48.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:57:48.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:48 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/770519040' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:57:48.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:48 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/770519040' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:57:49.021 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:49.571 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:49 smithi062 ceph-mon[30666]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-12T01:57:49.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.592+0000 7faa34400640 1 -- 172.21.15.62:0/1433508457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa2c074590 msgr2=0x7faa2c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.592+0000 7faa34400640 1 --2- 172.21.15.62:0/1433508457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa2c074590 0x7faa2c074970 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa20009900 tx=0x7faa2002a480 comp rx=0 tx=0).stop 2024-09-12T01:57:49.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.592+0000 7faa34400640 1 -- 172.21.15.62:0/1433508457 shutdown_connections 2024-09-12T01:57:49.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.592+0000 7faa34400640 1 --2- 172.21.15.62:0/1433508457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa2c112b90 0x7faa2c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.592+0000 7faa34400640 1 --2- 172.21.15.62:0/1433508457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa2c074eb0 0x7faa2c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.592+0000 7faa34400640 1 --2- 172.21.15.62:0/1433508457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa2c074590 0x7faa2c074970 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.592+0000 7faa34400640 1 -- 172.21.15.62:0/1433508457 >> 172.21.15.62:0/1433508457 conn(0x7faa2c0fd8c0 msgr2=0x7faa2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.592+0000 7faa34400640 1 -- 172.21.15.62:0/1433508457 shutdown_connections 2024-09-12T01:57:49.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.592+0000 7faa34400640 1 -- 172.21.15.62:0/1433508457 wait complete. 2024-09-12T01:57:49.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.593+0000 7faa34400640 1 Processor -- start 2024-09-12T01:57:49.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.593+0000 7faa34400640 1 -- start start 2024-09-12T01:57:49.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa34400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa2c074590 0x7faa2c1a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa34400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa2c074eb0 0x7faa2c1a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa34400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa2c112b90 0x7faa2c19e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa34400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c118550 con 0x7faa2c074590 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa34400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c1183d0 con 0x7faa2c112b90 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa34400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c1186d0 con 0x7faa2c074eb0 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa31a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa2c074590 0x7faa2c1a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa31a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa2c074590 0x7faa2c1a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34274/0 (socket says 172.21.15.62:34274) 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa31a00640 1 -- 172.21.15.62:0/2023606974 learned_addr learned my addr 172.21.15.62:0/2023606974 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa31000640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa2c074eb0 0x7faa2c1a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa32400640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa2c112b90 0x7faa2c19e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa31a00640 1 -- 172.21.15.62:0/2023606974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa2c074eb0 msgr2=0x7faa2c1a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa31a00640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa2c074eb0 0x7faa2c1a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa31a00640 1 -- 172.21.15.62:0/2023606974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa2c112b90 msgr2=0x7faa2c19e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa31a00640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa2c112b90 0x7faa2c19e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa31a00640 1 -- 172.21.15.62:0/2023606974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c19f010 con 0x7faa2c074590 2024-09-12T01:57:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.594+0000 7faa32400640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa2c112b90 0x7faa2c19e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.595+0000 7faa31a00640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa2c074590 0x7faa2c1a4720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa20006010 tx=0x7faa20004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.595+0000 7faa2a000640 1 -- 172.21.15.62:0/2023606974 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2003f030 con 0x7faa2c074590 2024-09-12T01:57:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.595+0000 7faa2a000640 1 -- 172.21.15.62:0/2023606974 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa20004440 con 0x7faa2c074590 2024-09-12T01:57:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.595+0000 7faa34400640 1 -- 172.21.15.62:0/2023606974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2c19f2a0 con 0x7faa2c074590 2024-09-12T01:57:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.595+0000 7faa2a000640 1 -- 172.21.15.62:0/2023606974 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20035070 con 0x7faa2c074590 2024-09-12T01:57:49.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.595+0000 7faa34400640 1 -- 172.21.15.62:0/2023606974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2c1ab5f0 con 0x7faa2c074590 2024-09-12T01:57:49.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.596+0000 7faa34400640 1 -- 172.21.15.62:0/2023606974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa2c074970 con 0x7faa2c074590 2024-09-12T01:57:49.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.598+0000 7faa2a000640 1 -- 172.21.15.62:0/2023606974 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faa20042030 con 0x7faa2c074590 2024-09-12T01:57:49.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.599+0000 7faa2a000640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7faa140a2c10 0x7faa140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.600+0000 7faa2a000640 1 -- 172.21.15.62:0/2023606974 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7faa200ef990 con 0x7faa2c074590 2024-09-12T01:57:49.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.600+0000 7faa31000640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7faa140a2c10 0x7faa140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.600+0000 7faa31000640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7faa140a2c10 0x7faa140a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0fff30 tx=0x7faa18005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.604+0000 7faa2a000640 1 -- 172.21.15.62:0/2023606974 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa200bc3d0 con 0x7faa2c074590 2024-09-12T01:57:49.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:49 smithi107 ceph-mon[35463]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-12T01:57:49.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:49 smithi077 ceph-mon[35095]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-12T01:57:49.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.790+0000 7faa34400640 1 -- 172.21.15.62:0/2023606974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa2c104fd0 con 0x7faa2c074590 2024-09-12T01:57:49.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.791+0000 7faa2a000640 1 -- 172.21.15.62:0/2023606974 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24723 (secure 0 0 0) 0x7faa200bbcd0 con 0x7faa2c074590 2024-09-12T01:57:49.792 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:49.793 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":92,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:57:22.942056+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 -- 172.21.15.62:0/2023606974 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7faa140a2c10 msgr2=0x7faa140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7faa140a2c10 0x7faa140a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0fff30 tx=0x7faa18005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 -- 172.21.15.62:0/2023606974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa2c074590 msgr2=0x7faa2c1a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa2c074590 0x7faa2c1a4720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa20006010 tx=0x7faa20004040 comp rx=0 tx=0).stop 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 -- 172.21.15.62:0/2023606974 shutdown_connections 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7faa140a2c10 0x7faa140a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa2c112b90 0x7faa2c19e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa2c074eb0 0x7faa2c1a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 --2- 172.21.15.62:0/2023606974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa2c074590 0x7faa2c1a4720 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 -- 172.21.15.62:0/2023606974 >> 172.21.15.62:0/2023606974 conn(0x7faa2c0fd8c0 msgr2=0x7faa2c0ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 -- 172.21.15.62:0/2023606974 shutdown_connections 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:49.794+0000 7faa34400640 1 -- 172.21.15.62:0/2023606974 wait complete. 2024-09-12T01:57:50.546 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T01:57:50.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:57:50.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:50 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2023606974' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:50.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:50 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2023606974' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:50.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:50 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2023606974' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:50.927 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:51.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.449+0000 7f49a6c00640 1 -- 172.21.15.62:0/2503900416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49a0101de0 msgr2=0x7f49a01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.449+0000 7f49a6c00640 1 --2- 172.21.15.62:0/2503900416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49a0101de0 0x7f49a01021c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4990009860 tx=0x7f499002a340 comp rx=0 tx=0).stop 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.450+0000 7f49a6c00640 1 -- 172.21.15.62:0/2503900416 shutdown_connections 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.450+0000 7f49a6c00640 1 --2- 172.21.15.62:0/2503900416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a0106f10 0x7f49a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.450+0000 7f49a6c00640 1 --2- 172.21.15.62:0/2503900416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a0102790 0x7f49a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.450+0000 7f49a6c00640 1 --2- 172.21.15.62:0/2503900416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49a0101de0 0x7f49a01021c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.450+0000 7f49a6c00640 1 -- 172.21.15.62:0/2503900416 >> 172.21.15.62:0/2503900416 conn(0x7f49a00fd8c0 msgr2=0x7f49a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.450+0000 7f49a6c00640 1 -- 172.21.15.62:0/2503900416 shutdown_connections 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.450+0000 7f49a6c00640 1 -- 172.21.15.62:0/2503900416 wait complete. 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.451+0000 7f49a6c00640 1 Processor -- start 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.451+0000 7f49a6c00640 1 -- start start 2024-09-12T01:57:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.451+0000 7f49a6c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a0101de0 0x7f49a019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.451+0000 7f49a6c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49a0102790 0x7f49a019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.451+0000 7f49a6c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a0106f10 0x7f49a019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.451+0000 7f49a6c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f49a0111f30 con 0x7f49a0106f10 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.451+0000 7f49a6c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49a0111db0 con 0x7f49a0102790 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.451+0000 7f49a6c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01120b0 con 0x7f49a0101de0 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f499fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a0101de0 0x7f49a019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f49a4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a0106f10 0x7f49a019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f499fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a0101de0 0x7f49a019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:57454/0 (socket says 172.21.15.62:57454) 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f499fe00640 1 -- 172.21.15.62:0/2190228261 learned_addr learned my addr 172.21.15.62:0/2190228261 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f499f400640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49a0102790 0x7f49a019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f499fe00640 1 -- 172.21.15.62:0/2190228261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49a0102790 msgr2=0x7f49a019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f499fe00640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49a0102790 0x7f49a019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f499fe00640 1 -- 172.21.15.62:0/2190228261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a0106f10 msgr2=0x7f49a019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f499fe00640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a0106f10 0x7f49a019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f499fe00640 1 -- 172.21.15.62:0/2190228261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a019f630 con 0x7f49a0101de0 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.452+0000 7f499fe00640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a0101de0 0x7f49a019a680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4990035040 tx=0x7f4990033b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.453+0000 7f499cc00640 1 -- 172.21.15.62:0/2190228261 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990037040 con 0x7f49a0101de0 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.453+0000 7f49a6c00640 1 -- 172.21.15.62:0/2190228261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a019f8c0 con 0x7f49a0101de0 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.453+0000 7f499cc00640 1 -- 172.21.15.62:0/2190228261 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4990040070 con 0x7f49a0101de0 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.453+0000 7f499cc00640 1 -- 172.21.15.62:0/2190228261 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900039b0 con 0x7f49a0101de0 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.453+0000 7f49a6c00640 1 -- 172.21.15.62:0/2190228261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a01a7200 con 0x7f49a0101de0 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.454+0000 7f49a6c00640 1 -- 172.21.15.62:0/2190228261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a01032c0 con 0x7f49a0101de0 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.456+0000 7f499cc00640 1 -- 172.21.15.62:0/2190228261 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f49900305e0 con 0x7f49a0101de0 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.457+0000 7f499cc00640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f49840a2c10 0x7f49840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.457+0000 7f499cc00640 1 -- 172.21.15.62:0/2190228261 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f49900ef3c0 con 0x7f49a0101de0 2024-09-12T01:57:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.457+0000 7f499f400640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f49840a2c10 0x7f49840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.458+0000 7f499f400640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f49840a2c10 0x7f49840a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49a00ff7a0 tx=0x7f498c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.461+0000 7f499cc00640 1 -- 172.21.15.62:0/2190228261 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49900bbf10 con 0x7f49a0101de0 2024-09-12T01:57:51.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:51 smithi062 ceph-mon[30666]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-12T01:57:51.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.648+0000 7f49a6c00640 1 -- 172.21.15.62:0/2190228261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49a01a7420 con 0x7f49a0101de0 2024-09-12T01:57:51.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.650+0000 7f499cc00640 1 -- 172.21.15.62:0/2190228261 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24723 (secure 0 0 0) 0x7f49900bb810 con 0x7f49a0101de0 2024-09-12T01:57:51.651 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:57:51.651 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":92,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:57:22.942056+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:51.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 -- 172.21.15.62:0/2190228261 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f49840a2c10 msgr2=0x7f49840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f49840a2c10 0x7f49840a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49a00ff7a0 tx=0x7f498c009260 comp rx=0 tx=0).stop 2024-09-12T01:57:51.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 -- 172.21.15.62:0/2190228261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a0101de0 msgr2=0x7f49a019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:51.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a0101de0 0x7f49a019a680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4990035040 tx=0x7f4990033b60 comp rx=0 tx=0).stop 2024-09-12T01:57:51.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 -- 172.21.15.62:0/2190228261 shutdown_connections 2024-09-12T01:57:51.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f49840a2c10 0x7f49840a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a0106f10 0x7f49a019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49a0102790 0x7f49a019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 --2- 172.21.15.62:0/2190228261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a0101de0 0x7f49a019a680 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:51.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 -- 172.21.15.62:0/2190228261 >> 172.21.15.62:0/2190228261 conn(0x7f49a00fd8c0 msgr2=0x7f49a00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:51.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 -- 172.21.15.62:0/2190228261 shutdown_connections 2024-09-12T01:57:51.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:51.653+0000 7f49a6c00640 1 -- 172.21.15.62:0/2190228261 wait complete. 2024-09-12T01:57:51.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:51 smithi107 ceph-mon[35463]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-12T01:57:51.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:51 smithi077 ceph-mon[35095]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-12T01:57:52.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T01:57:52.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T01:57:52.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T01:57:52.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T01:57:52.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T01:57:52.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T01:57:52.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T01:57:52.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T01:57:52.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T01:57:52.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T01:57:52.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T01:57:52.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T01:57:52.571 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:52 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2190228261' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:52.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:52 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2190228261' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:52.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:52 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2190228261' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:53.290 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:53.384 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:53.664 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:53.678 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:53.683 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:53.688 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:53.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:53 smithi107 ceph-mon[35463]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-12T01:57:53.713 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:53 smithi062 ceph-mon[30666]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-12T01:57:53.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:53 smithi077 ceph-mon[35095]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-12T01:57:54.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.175+0000 7f362b200640 1 -- 172.21.15.62:0/3464164905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3624102b90 msgr2=0x7f3624102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.175+0000 7f362b200640 1 --2- 172.21.15.62:0/3464164905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3624102b90 0x7f3624102f70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3618009900 tx=0x7f361802a480 comp rx=0 tx=0).stop 2024-09-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.176+0000 7f362b200640 1 -- 172.21.15.62:0/3464164905 shutdown_connections 2024-09-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.176+0000 7f362b200640 1 --2- 172.21.15.62:0/3464164905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362410bfc0 0x7f362410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.176+0000 7f362b200640 1 --2- 172.21.15.62:0/3464164905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36241034b0 0x7f362410b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.176+0000 7f362b200640 1 --2- 172.21.15.62:0/3464164905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3624102b90 0x7f3624102f70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.176+0000 7f362b200640 1 -- 172.21.15.62:0/3464164905 >> 172.21.15.62:0/3464164905 conn(0x7f36240fc610 msgr2=0x7f36240fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.176+0000 7f362b200640 1 -- 172.21.15.62:0/3464164905 shutdown_connections 2024-09-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.176+0000 7f362b200640 1 -- 172.21.15.62:0/3464164905 wait complete. 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.177+0000 7f362b200640 1 Processor -- start 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.177+0000 7f362b200640 1 -- start start 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.177+0000 7f362b200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3624102b90 0x7f362419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.177+0000 7f362b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36241034b0 0x7f362419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.177+0000 7f362b200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362410bfc0 0x7f362419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.177+0000 7f362b200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3624111e10 con 0x7f362410bfc0 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.177+0000 7f362b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3624111c90 con 0x7f36241034b0 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.177+0000 7f362b200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3624111f90 con 0x7f3624102b90 2024-09-12T01:57:54.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.178+0000 7f3629400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36241034b0 0x7f362419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.178+0000 7f362a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362410bfc0 0x7f362419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.178+0000 7f3629400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36241034b0 0x7f362419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:37986/0 (socket says 172.21.15.62:37986) 2024-09-12T01:57:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.178+0000 7f362a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362410bfc0 0x7f362419ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51568/0 (socket says 172.21.15.62:51568) 2024-09-12T01:57:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.178+0000 7f3629400640 1 -- 172.21.15.62:0/2975405333 learned_addr learned my addr 172.21.15.62:0/2975405333 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.178+0000 7f3629e00640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3624102b90 0x7f362419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.179+0000 7f3629400640 1 -- 172.21.15.62:0/2975405333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3624102b90 msgr2=0x7f362419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.179+0000 7f3629400640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3624102b90 0x7f362419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.179+0000 7f3629400640 1 -- 172.21.15.62:0/2975405333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362410bfc0 msgr2=0x7f362419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.179+0000 7f3629400640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362410bfc0 0x7f362419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.179+0000 7f3629400640 1 -- 172.21.15.62:0/2975405333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362419f430 con 0x7f36241034b0 2024-09-12T01:57:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.179+0000 7f362a800640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362410bfc0 0x7f362419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:54.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.179+0000 7f3629e00640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3624102b90 0x7f362419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:54.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.179+0000 7f3629400640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36241034b0 0x7f362419a9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f361400e9f0 tx=0x7f361400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.180+0000 7f361ea00640 1 -- 172.21.15.62:0/2975405333 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361400ccc0 con 0x7f36241034b0 2024-09-12T01:57:54.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.180+0000 7f361ea00640 1 -- 172.21.15.62:0/2975405333 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f361400ce60 con 0x7f36241034b0 2024-09-12T01:57:54.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.180+0000 7f361ea00640 1 -- 172.21.15.62:0/2975405333 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3614010690 con 0x7f36241034b0 2024-09-12T01:57:54.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.180+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f362419f720 con 0x7f36241034b0 2024-09-12T01:57:54.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.180+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36241a7000 con 0x7f36241034b0 2024-09-12T01:57:54.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.181+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36241022a0 con 0x7f36241034b0 2024-09-12T01:57:54.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.185+0000 7f361ea00640 1 -- 172.21.15.62:0/2975405333 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f36140046c0 con 0x7f36241034b0 2024-09-12T01:57:54.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.187+0000 7f361ea00640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f360c0a2c90 0x7f360c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.187+0000 7f361ea00640 1 -- 172.21.15.62:0/2975405333 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f36140cfa30 con 0x7f36241034b0 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.187+0000 7f361ea00640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] conn(0x7f360c0ade60 0x7f360c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.187+0000 7f361ea00640 1 -- 172.21.15.62:0/2975405333 --> [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3614019e70 con 0x7f360c0ade60 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.187+0000 7f361ea00640 1 -- 172.21.15.62:0/2975405333 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f36140cfe80 con 0x7f36241034b0 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.188+0000 7f3629e00640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f360c0a2c90 0x7f360c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.188+0000 7f362a800640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] conn(0x7f360c0ade60 0x7f360c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.189+0000 7f3629e00640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f360c0a2c90 0x7f360c0a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3618005ab0 tx=0x7f3618000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.189+0000 7f362a800640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] conn(0x7f360c0ade60 0x7f360c0b0300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.190+0000 7f361ea00640 1 -- 172.21.15.62:0/2975405333 <== osd.2 v2:172.21.15.107:6800/1089319427 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3614019e70 con 0x7f360c0ade60 2024-09-12T01:57:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.206+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 --> [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f362406a850 con 0x7f360c0ade60 2024-09-12T01:57:54.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.206+0000 7f361ea00640 1 -- 172.21.15.62:0/2975405333 <== osd.2 v2:172.21.15.107:6800/1089319427 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f362406a850 con 0x7f360c0ade60 2024-09-12T01:57:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 >> [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] conn(0x7f360c0ade60 msgr2=0x7f360c0b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362b200640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] conn(0x7f360c0ade60 0x7f360c0b0300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f360c0a2c90 msgr2=0x7f360c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362b200640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f360c0a2c90 0x7f360c0a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3618005ab0 tx=0x7f3618000bc0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36241034b0 msgr2=0x7f362419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362b200640 1 --2- 172.21.15.62:0/2975405333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36241034b0 0x7f362419a9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f361400e9f0 tx=0x7f361400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362a800640 1 -- 172.21.15.62:0/2975405333 reap_dead start 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 shutdown_connections 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 >> 172.21.15.62:0/2975405333 conn(0x7f36240fc610 msgr2=0x7f362410d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 shutdown_connections 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.207+0000 7f362b200640 1 -- 172.21.15.62:0/2975405333 wait complete. 2024-09-12T01:57:54.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.812+0000 7fbbbac00640 1 -- 172.21.15.62:0/1418390663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb4104010 msgr2=0x7fbbb41043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.812+0000 7fbbbac00640 1 --2- 172.21.15.62:0/1418390663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb4104010 0x7fbbb41043f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009900 tx=0x7fbba402a410 comp rx=0 tx=0).stop 2024-09-12T01:57:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.813+0000 7fbbbac00640 1 -- 172.21.15.62:0/1418390663 shutdown_connections 2024-09-12T01:57:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.813+0000 7fbbbac00640 1 --2- 172.21.15.62:0/1418390663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb4109140 0x7fbbb4110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.813+0000 7fbbbac00640 1 --2- 172.21.15.62:0/1418390663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbb41049c0 0x7fbbb4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.813+0000 7fbbbac00640 1 --2- 172.21.15.62:0/1418390663 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb4104010 0x7fbbb41043f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.813+0000 7fbbbac00640 1 -- 172.21.15.62:0/1418390663 >> 172.21.15.62:0/1418390663 conn(0x7fbbb40ffa50 msgr2=0x7fbbb4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.813+0000 7fbbbac00640 1 -- 172.21.15.62:0/1418390663 shutdown_connections 2024-09-12T01:57:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.813+0000 7fbbbac00640 1 -- 172.21.15.62:0/1418390663 wait complete. 2024-09-12T01:57:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.814+0000 7fbbbac00640 1 Processor -- start 2024-09-12T01:57:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.814+0000 7fbbbac00640 1 -- start start 2024-09-12T01:57:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.814+0000 7fbbbac00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb4104010 0x7fbbb419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.814+0000 7fbbbac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbb41049c0 0x7fbbb419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.814+0000 7fbbbac00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb4109140 0x7fbbb419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.814+0000 7fbbbac00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41141c0 con 0x7fbbb4109140 2024-09-12T01:57:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.814+0000 7fbbbac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4114040 con 0x7fbbb41049c0 2024-09-12T01:57:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.814+0000 7fbbbac00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4114340 con 0x7fbbb4104010 2024-09-12T01:57:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.815+0000 7fbbb3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb4104010 0x7fbbb419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.815+0000 7fbbb3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb4104010 0x7fbbb419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:40312/0 (socket says 172.21.15.62:40312) 2024-09-12T01:57:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.815+0000 7fbbb3e00640 1 -- 172.21.15.62:0/245014787 learned_addr learned my addr 172.21.15.62:0/245014787 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.815+0000 7fbbabe00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbb41049c0 0x7fbbb419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.815+0000 7fbbb8c00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb4109140 0x7fbbb419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.815+0000 7fbbb3e00640 1 -- 172.21.15.62:0/245014787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbb41049c0 msgr2=0x7fbbb419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.815+0000 7fbbb3e00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbbb41049c0 0x7fbbb419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.815+0000 7fbbb3e00640 1 -- 172.21.15.62:0/245014787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb4109140 msgr2=0x7fbbb419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.815+0000 7fbbb3e00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb4109140 0x7fbbb419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.815+0000 7fbbb3e00640 1 -- 172.21.15.62:0/245014787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb419f5d0 con 0x7fbbb4104010 2024-09-12T01:57:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.816+0000 7fbbb3e00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb4104010 0x7fbbb419a620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbba4004770 tx=0x7fbba4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.816+0000 7fbbb1600640 1 -- 172.21.15.62:0/245014787 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba403f070 con 0x7fbbb4104010 2024-09-12T01:57:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.816+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb419f860 con 0x7fbbb4104010 2024-09-12T01:57:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.816+0000 7fbbb1600640 1 -- 172.21.15.62:0/245014787 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba4031ca0 con 0x7fbbb4104010 2024-09-12T01:57:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.816+0000 7fbbb1600640 1 -- 172.21.15.62:0/245014787 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4035030 con 0x7fbbb4104010 2024-09-12T01:57:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.816+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb41a71a0 con 0x7fbbb4104010 2024-09-12T01:57:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.817+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbbb4062940 con 0x7fbbb4104010 2024-09-12T01:57:54.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.819+0000 7fbbb1600640 1 -- 172.21.15.62:0/245014787 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbba4042070 con 0x7fbbb4104010 2024-09-12T01:57:54.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.820+0000 7fbbb1600640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fbb980a2c10 0x7fbb980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.820+0000 7fbbb1600640 1 -- 172.21.15.62:0/245014787 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fbba40efe90 con 0x7fbbb4104010 2024-09-12T01:57:54.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.820+0000 7fbbabe00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fbb980a2c10 0x7fbb980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.821+0000 7fbbb1600640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] conn(0x7fbb980adde0 0x7fbb980b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.821+0000 7fbbb1600640 1 -- 172.21.15.62:0/245014787 --> [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb980b0950 con 0x7fbb980adde0 2024-09-12T01:57:54.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.821+0000 7fbbb1600640 1 -- 172.21.15.62:0/245014787 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fbba40f0240 con 0x7fbbb4104010 2024-09-12T01:57:54.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.821+0000 7fbbb8c00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] conn(0x7fbb980adde0 0x7fbb980b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.821+0000 7fbbabe00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fbb980a2c10 0x7fbb980a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40ffe70 tx=0x7fbb9c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.822+0000 7fbbb8c00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] conn(0x7fbb980adde0 0x7fbb980b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.823+0000 7fbbb1600640 1 -- 172.21.15.62:0/245014787 <== osd.8 v2:172.21.15.107:6816/3632359823 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb980b0950 con 0x7fbb980adde0 2024-09-12T01:57:54.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.837+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 --> [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbbb4062dc0 con 0x7fbb980adde0 2024-09-12T01:57:54.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.838+0000 7fbbb1600640 1 -- 172.21.15.62:0/245014787 <== osd.8 v2:172.21.15.107:6816/3632359823 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbbb4062dc0 con 0x7fbb980adde0 2024-09-12T01:57:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.838+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 >> [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] conn(0x7fbb980adde0 msgr2=0x7fbb980b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.838+0000 7fbbbac00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] conn(0x7fbb980adde0 0x7fbb980b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.838+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fbb980a2c10 msgr2=0x7fbb980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.838+0000 7fbbbac00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fbb980a2c10 0x7fbb980a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40ffe70 tx=0x7fbb9c00b410 comp rx=0 tx=0).stop 2024-09-12T01:57:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.838+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb4104010 msgr2=0x7fbbb419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.838+0000 7fbbbac00640 1 --2- 172.21.15.62:0/245014787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb4104010 0x7fbbb419a620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbba4004770 tx=0x7fbba4003c10 comp rx=0 tx=0).stop 2024-09-12T01:57:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.838+0000 7fbbb8c00640 1 -- 172.21.15.62:0/245014787 reap_dead start 2024-09-12T01:57:54.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.839+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 shutdown_connections 2024-09-12T01:57:54.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.839+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 >> 172.21.15.62:0/245014787 conn(0x7fbbb40ffa50 msgr2=0x7fbbb4100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.839+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 shutdown_connections 2024-09-12T01:57:54.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:54.839+0000 7fbbbac00640 1 -- 172.21.15.62:0/245014787 wait complete. 2024-09-12T01:57:55.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:55 smithi077 ceph-mon[35095]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-12T01:57:55.756 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:55 smithi062 ceph-mon[30666]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-12T01:57:55.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:55 smithi107 ceph-mon[35463]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-12T01:57:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.240+0000 7f7b73800640 1 -- 172.21.15.62:0/3160112655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b6c1049a0 msgr2=0x7f7b6c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.240+0000 7f7b73800640 1 --2- 172.21.15.62:0/3160112655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b6c1049a0 0x7f7b6c1089f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009900 tx=0x7f7b5402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.240+0000 7f7b73800640 1 -- 172.21.15.62:0/3160112655 shutdown_connections 2024-09-12T01:57:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.240+0000 7f7b73800640 1 --2- 172.21.15.62:0/3160112655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b6c109120 0x7f7b6c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.240+0000 7f7b73800640 1 --2- 172.21.15.62:0/3160112655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b6c1049a0 0x7f7b6c1089f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.240+0000 7f7b73800640 1 --2- 172.21.15.62:0/3160112655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c103ff0 0x7f7b6c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.240+0000 7f7b73800640 1 -- 172.21.15.62:0/3160112655 >> 172.21.15.62:0/3160112655 conn(0x7f7b6c0ffa90 msgr2=0x7f7b6c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.240+0000 7f7b73800640 1 -- 172.21.15.62:0/3160112655 shutdown_connections 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.240+0000 7f7b73800640 1 -- 172.21.15.62:0/3160112655 wait complete. 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.241+0000 7f7b73800640 1 Processor -- start 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.241+0000 7f7b73800640 1 -- start start 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b73800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b6c103ff0 0x7f7b6c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b73800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b6c1049a0 0x7f7b6c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b73800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c109120 0x7f7b6c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b73800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c114170 con 0x7f7b6c1049a0 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b73800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c113ff0 con 0x7f7b6c109120 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b73800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c1142f0 con 0x7f7b6c103ff0 2024-09-12T01:57:55.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b70e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b6c103ff0 0x7f7b6c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b63e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b6c1049a0 0x7f7b6c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b63e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b6c1049a0 0x7f7b6c19ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51604/0 (socket says 172.21.15.62:51604) 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b63e00640 1 -- 172.21.15.62:0/639571439 learned_addr learned my addr 172.21.15.62:0/639571439 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.242+0000 7f7b71800640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c109120 0x7f7b6c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b70e00640 1 -- 172.21.15.62:0/639571439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c109120 msgr2=0x7f7b6c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b70e00640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c109120 0x7f7b6c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b70e00640 1 -- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b6c1049a0 msgr2=0x7f7b6c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b70e00640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b6c1049a0 0x7f7b6c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b70e00640 1 -- 172.21.15.62:0/639571439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6c19f5e0 con 0x7f7b6c103ff0 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b70e00640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b6c103ff0 0x7f7b6c19a630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00e9f0 tx=0x7f7b5c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b6a000640 1 -- 172.21.15.62:0/639571439 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00ccc0 con 0x7f7b6c103ff0 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b6a000640 1 -- 172.21.15.62:0/639571439 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b5c010910 con 0x7f7b6c103ff0 2024-09-12T01:57:55.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b6c19f8d0 con 0x7f7b6c103ff0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b6a000640 1 -- 172.21.15.62:0/639571439 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c018960 con 0x7f7b6c103ff0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.243+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b6c1a71b0 con 0x7f7b6c103ff0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.244+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b6c062980 con 0x7f7b6c103ff0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.247+0000 7f7b6a000640 1 -- 172.21.15.62:0/639571439 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7b5c010ac0 con 0x7f7b6c103ff0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.248+0000 7f7b6a000640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7b500a2c10 0x7f7b500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.248+0000 7f7b6a000640 1 -- 172.21.15.62:0/639571439 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f7b5c0d0140 con 0x7f7b6c103ff0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.248+0000 7f7b63e00640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7b500a2c10 0x7f7b500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.248+0000 7f7b6a000640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] conn(0x7f7b500adde0 0x7f7b500b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.248+0000 7f7b6a000640 1 -- 172.21.15.62:0/639571439 --> [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b5c028ea0 con 0x7f7b500adde0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.248+0000 7f7b6a000640 1 -- 172.21.15.62:0/639571439 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f7b5c0d04f0 con 0x7f7b6c103ff0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.249+0000 7f7b71800640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] conn(0x7f7b500adde0 0x7f7b500b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.249+0000 7f7b63e00640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7b500a2c10 0x7f7b500a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7b540096c0 tx=0x7f7b540046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.249+0000 7f7b71800640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] conn(0x7f7b500adde0 0x7f7b500b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.250+0000 7f7b6a000640 1 -- 172.21.15.62:0/639571439 <== osd.6 v2:172.21.15.62:6818/2615132641 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b5c028ea0 con 0x7f7b500adde0 2024-09-12T01:57:55.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.264+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 --> [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b6c062d80 con 0x7f7b500adde0 2024-09-12T01:57:55.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.265+0000 7f7b6a000640 1 -- 172.21.15.62:0/639571439 <== osd.6 v2:172.21.15.62:6818/2615132641 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7b6c062d80 con 0x7f7b500adde0 2024-09-12T01:57:55.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.265+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] conn(0x7f7b500adde0 msgr2=0x7f7b500b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.265+0000 7f7b73800640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] conn(0x7f7b500adde0 0x7f7b500b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.265+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7b500a2c10 msgr2=0x7f7b500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.265+0000 7f7b73800640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7b500a2c10 0x7f7b500a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7b540096c0 tx=0x7f7b540046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.265+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b6c103ff0 msgr2=0x7f7b6c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.265+0000 7f7b73800640 1 --2- 172.21.15.62:0/639571439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7b6c103ff0 0x7f7b6c19a630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00e9f0 tx=0x7f7b5c00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.265+0000 7f7b71800640 1 -- 172.21.15.62:0/639571439 reap_dead start 2024-09-12T01:57:55.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.265+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 shutdown_connections 2024-09-12T01:57:55.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.265+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 >> 172.21.15.62:0/639571439 conn(0x7f7b6c0ffa90 msgr2=0x7f7b6c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.266+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 shutdown_connections 2024-09-12T01:57:55.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:55.266+0000 7f7b73800640 1 -- 172.21.15.62:0/639571439 wait complete. 2024-09-12T01:57:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.399+0000 7f6a33400640 1 -- 172.21.15.62:0/1644905292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c1049a0 msgr2=0x7f6a2c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.399+0000 7f6a33400640 1 --2- 172.21.15.62:0/1644905292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c1049a0 0x7f6a2c1089f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009900 tx=0x7f6a1802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.399+0000 7f6a33400640 1 -- 172.21.15.62:0/1644905292 shutdown_connections 2024-09-12T01:57:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.399+0000 7f6a33400640 1 --2- 172.21.15.62:0/1644905292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c109120 0x7f6a2c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.399+0000 7f6a33400640 1 --2- 172.21.15.62:0/1644905292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c1049a0 0x7f6a2c1089f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.399+0000 7f6a33400640 1 --2- 172.21.15.62:0/1644905292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a2c103ff0 0x7f6a2c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.399+0000 7f6a33400640 1 -- 172.21.15.62:0/1644905292 >> 172.21.15.62:0/1644905292 conn(0x7f6a2c0ffa90 msgr2=0x7f6a2c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:56.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.399+0000 7f6a33400640 1 -- 172.21.15.62:0/1644905292 shutdown_connections 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.400+0000 7f6a33400640 1 -- 172.21.15.62:0/1644905292 wait complete. 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.400+0000 7f6a33400640 1 Processor -- start 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a33400640 1 -- start start 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a33400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a2c103ff0 0x7f6a2c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a33400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c1049a0 0x7f6a2c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a33400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c109120 0x7f6a2c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a33400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c114190 con 0x7f6a2c103ff0 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a33400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c114010 con 0x7f6a2c1049a0 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a33400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c114310 con 0x7f6a2c109120 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a30a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a2c103ff0 0x7f6a2c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a30a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a2c103ff0 0x7f6a2c19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51622/0 (socket says 172.21.15.62:51622) 2024-09-12T01:57:56.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a30a00640 1 -- 172.21.15.62:0/1734942125 learned_addr learned my addr 172.21.15.62:0/1734942125 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a31400640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c109120 0x7f6a2c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.401+0000 7f6a2be00640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c1049a0 0x7f6a2c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a30a00640 1 -- 172.21.15.62:0/1734942125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c109120 msgr2=0x7f6a2c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a30a00640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c109120 0x7f6a2c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a30a00640 1 -- 172.21.15.62:0/1734942125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c1049a0 msgr2=0x7f6a2c19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a30a00640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c1049a0 0x7f6a2c19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a30a00640 1 -- 172.21.15.62:0/1734942125 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c19f600 con 0x7f6a2c103ff0 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a31400640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c109120 0x7f6a2c19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a30a00640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a2c103ff0 0x7f6a2c19a650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000ea60 tx=0x7f6a2000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a29600640 1 -- 172.21.15.62:0/1734942125 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000cde0 con 0x7f6a2c103ff0 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a29600640 1 -- 172.21.15.62:0/1734942125 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a200035f0 con 0x7f6a2c103ff0 2024-09-12T01:57:56.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a29600640 1 -- 172.21.15.62:0/1734942125 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20010670 con 0x7f6a2c103ff0 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.402+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2c19f8f0 con 0x7f6a2c103ff0 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.403+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2c1a71d0 con 0x7f6a2c103ff0 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.403+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a2c062940 con 0x7f6a2c103ff0 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.405+0000 7f6a29600640 1 -- 172.21.15.62:0/1734942125 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6a200037a0 con 0x7f6a2c103ff0 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.407+0000 7f6a29600640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6a140a2c10 0x7f6a140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.407+0000 7f6a29600640 1 -- 172.21.15.62:0/1734942125 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f6a200cfb20 con 0x7f6a2c103ff0 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.407+0000 7f6a2be00640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6a140a2c10 0x7f6a140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.407+0000 7f6a29600640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] conn(0x7f6a140adde0 0x7f6a140b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.407+0000 7f6a29600640 1 -- 172.21.15.62:0/1734942125 --> [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a2001aec0 con 0x7f6a140adde0 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.407+0000 7f6a29600640 1 -- 172.21.15.62:0/1734942125 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f6a200cfed0 con 0x7f6a2c103ff0 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.408+0000 7f6a31400640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] conn(0x7f6a140adde0 0x7f6a140b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:56.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.408+0000 7f6a2be00640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6a140a2c10 0x7f6a140a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000c00 tx=0x7f6a18005b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.408+0000 7f6a31400640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] conn(0x7f6a140adde0 0x7f6a140b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:56.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.409+0000 7f6a29600640 1 -- 172.21.15.62:0/1734942125 <== osd.0 v2:172.21.15.62:6802/2091859274 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a2001aec0 con 0x7f6a140adde0 2024-09-12T01:57:56.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.424+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 --> [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6a2c062d40 con 0x7f6a140adde0 2024-09-12T01:57:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.424+0000 7f6a29600640 1 -- 172.21.15.62:0/1734942125 <== osd.0 v2:172.21.15.62:6802/2091859274 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6a2c062d40 con 0x7f6a140adde0 2024-09-12T01:57:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] conn(0x7f6a140adde0 msgr2=0x7f6a140b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a33400640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] conn(0x7f6a140adde0 0x7f6a140b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6a140a2c10 msgr2=0x7f6a140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a33400640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f6a140a2c10 0x7f6a140a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000c00 tx=0x7f6a18005b50 comp rx=0 tx=0).stop 2024-09-12T01:57:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a2c103ff0 msgr2=0x7f6a2c19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a33400640 1 --2- 172.21.15.62:0/1734942125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a2c103ff0 0x7f6a2c19a650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000ea60 tx=0x7f6a2000ef20 comp rx=0 tx=0).stop 2024-09-12T01:57:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a31400640 1 -- 172.21.15.62:0/1734942125 reap_dead start 2024-09-12T01:57:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 shutdown_connections 2024-09-12T01:57:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 >> 172.21.15.62:0/1734942125 conn(0x7f6a2c0ffa90 msgr2=0x7f6a2c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 shutdown_connections 2024-09-12T01:57:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:56.425+0000 7f6a33400640 1 -- 172.21.15.62:0/1734942125 wait complete. 2024-09-12T01:57:57.661 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:57.661 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:57.662 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:57.703 INFO:teuthology.orchestra.run.smithi062.stdout:77309411405 2024-09-12T01:57:57.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T01:57:57.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:57 smithi077 ceph-mon[35095]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:57:57.757 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:57 smithi062 ceph-mon[30666]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:57:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.872+0000 7fc263400640 1 -- 172.21.15.62:0/2603527223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc25c103ff0 msgr2=0x7fc25c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.872+0000 7fc263400640 1 --2- 172.21.15.62:0/2603527223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc25c103ff0 0x7fc25c1043d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc250009900 tx=0x7fc25002a410 comp rx=0 tx=0).stop 2024-09-12T01:57:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.872+0000 7fc263400640 1 -- 172.21.15.62:0/2603527223 shutdown_connections 2024-09-12T01:57:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.872+0000 7fc263400640 1 --2- 172.21.15.62:0/2603527223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc25c109120 0x7fc25c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.872+0000 7fc263400640 1 --2- 172.21.15.62:0/2603527223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c1049a0 0x7fc25c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.872+0000 7fc263400640 1 --2- 172.21.15.62:0/2603527223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc25c103ff0 0x7fc25c1043d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.872+0000 7fc263400640 1 -- 172.21.15.62:0/2603527223 >> 172.21.15.62:0/2603527223 conn(0x7fc25c0ffa90 msgr2=0x7fc25c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.872+0000 7fc263400640 1 -- 172.21.15.62:0/2603527223 shutdown_connections 2024-09-12T01:57:57.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.872+0000 7fc263400640 1 -- 172.21.15.62:0/2603527223 wait complete. 2024-09-12T01:57:57.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.873+0000 7fc263400640 1 Processor -- start 2024-09-12T01:57:57.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.874+0000 7fc263400640 1 -- start start 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.874+0000 7fc263400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c103ff0 0x7fc25c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.874+0000 7fc263400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc25c1049a0 0x7fc25c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.874+0000 7fc263400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc25c109120 0x7fc25c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.874+0000 7fc263400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c114190 con 0x7fc25c109120 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.874+0000 7fc263400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c114010 con 0x7fc25c1049a0 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.874+0000 7fc263400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c114310 con 0x7fc25c103ff0 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc25be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc25c1049a0 0x7fc25c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc260a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c103ff0 0x7fc25c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc261400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc25c109120 0x7fc25c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc260a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c103ff0 0x7fc25c19a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:40376/0 (socket says 172.21.15.62:40376) 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc25be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc25c1049a0 0x7fc25c19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:38050/0 (socket says 172.21.15.62:38050) 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc260a00640 1 -- 172.21.15.62:0/1813282128 learned_addr learned my addr 172.21.15.62:0/1813282128 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc25be00640 1 -- 172.21.15.62:0/1813282128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c103ff0 msgr2=0x7fc25c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc25be00640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c103ff0 0x7fc25c19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc25be00640 1 -- 172.21.15.62:0/1813282128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc25c109120 msgr2=0x7fc25c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc25be00640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc25c109120 0x7fc25c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc25be00640 1 -- 172.21.15.62:0/1813282128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c19f640 con 0x7fc25c1049a0 2024-09-12T01:57:57.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.875+0000 7fc25be00640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc25c1049a0 0x7fc25c19abd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc24800e9f0 tx=0x7fc24800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.876+0000 7fc259600640 1 -- 172.21.15.62:0/1813282128 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24800ccc0 con 0x7fc25c1049a0 2024-09-12T01:57:57.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.876+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25c19f930 con 0x7fc25c1049a0 2024-09-12T01:57:57.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.876+0000 7fc259600640 1 -- 172.21.15.62:0/1813282128 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc248005020 con 0x7fc25c1049a0 2024-09-12T01:57:57.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.876+0000 7fc259600640 1 -- 172.21.15.62:0/1813282128 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2480049e0 con 0x7fc25c1049a0 2024-09-12T01:57:57.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.876+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc25c1a7210 con 0x7fc25c1049a0 2024-09-12T01:57:57.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.877+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc25c062900 con 0x7fc25c1049a0 2024-09-12T01:57:57.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.880+0000 7fc259600640 1 -- 172.21.15.62:0/1813282128 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc248005560 con 0x7fc25c1049a0 2024-09-12T01:57:57.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.881+0000 7fc259600640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc2440a2c10 0x7fc2440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.881+0000 7fc259600640 1 -- 172.21.15.62:0/1813282128 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc2480cf7a0 con 0x7fc25c1049a0 2024-09-12T01:57:57.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.882+0000 7fc260a00640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc2440a2c10 0x7fc2440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.882+0000 7fc259600640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] conn(0x7fc2440adde0 0x7fc2440b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.882+0000 7fc259600640 1 -- 172.21.15.62:0/1813282128 --> [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2440b0950 con 0x7fc2440adde0 2024-09-12T01:57:57.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.882+0000 7fc259600640 1 -- 172.21.15.62:0/1813282128 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fc2480cfb50 con 0x7fc25c1049a0 2024-09-12T01:57:57.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.882+0000 7fc261400640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] conn(0x7fc2440adde0 0x7fc2440b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.883+0000 7fc260a00640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc2440a2c10 0x7fc2440a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc2500096c0 tx=0x7fc2500046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.883+0000 7fc261400640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] conn(0x7fc2440adde0 0x7fc2440b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.884+0000 7fc259600640 1 -- 172.21.15.62:0/1813282128 <== osd.11 v2:172.21.15.107:6824/2990277085 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2440b0950 con 0x7fc2440adde0 2024-09-12T01:57:57.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.898+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 --> [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc25c062d00 con 0x7fc2440adde0 2024-09-12T01:57:57.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.899+0000 7fc259600640 1 -- 172.21.15.62:0/1813282128 <== osd.11 v2:172.21.15.107:6824/2990277085 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc25c062d00 con 0x7fc2440adde0 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.899+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 >> [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] conn(0x7fc2440adde0 msgr2=0x7fc2440b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.899+0000 7fc263400640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] conn(0x7fc2440adde0 0x7fc2440b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.899+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc2440a2c10 msgr2=0x7fc2440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.899+0000 7fc263400640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc2440a2c10 0x7fc2440a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc2500096c0 tx=0x7fc2500046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.899+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc25c1049a0 msgr2=0x7fc25c19abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.899+0000 7fc263400640 1 --2- 172.21.15.62:0/1813282128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc25c1049a0 0x7fc25c19abd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc24800e9f0 tx=0x7fc24800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.899+0000 7fc261400640 1 -- 172.21.15.62:0/1813282128 reap_dead start 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.899+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 shutdown_connections 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.899+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 >> 172.21.15.62:0/1813282128 conn(0x7fc25c0ffa90 msgr2=0x7fc25c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.900+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 shutdown_connections 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:57.900+0000 7fc263400640 1 -- 172.21.15.62:0/1813282128 wait complete. 2024-09-12T01:57:57.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:57 smithi107 ceph-mon[35463]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:57:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.441+0000 7f82b7200640 1 -- 172.21.15.62:0/3411567465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82b8102b90 msgr2=0x7f82b8102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.441+0000 7f82b7200640 1 --2- 172.21.15.62:0/3411567465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82b8102b90 0x7f82b8102f70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009900 tx=0x7f82a802a480 comp rx=0 tx=0).stop 2024-09-12T01:57:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.441+0000 7f82b7200640 1 -- 172.21.15.62:0/3411567465 shutdown_connections 2024-09-12T01:57:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.441+0000 7f82b7200640 1 --2- 172.21.15.62:0/3411567465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82b810bfc0 0x7f82b810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.441+0000 7f82b7200640 1 --2- 172.21.15.62:0/3411567465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b81034b0 0x7f82b810b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.441+0000 7f82b7200640 1 --2- 172.21.15.62:0/3411567465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82b8102b90 0x7f82b8102f70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.441+0000 7f82b7200640 1 -- 172.21.15.62:0/3411567465 >> 172.21.15.62:0/3411567465 conn(0x7f82b80fc610 msgr2=0x7f82b80fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.441+0000 7f82b7200640 1 -- 172.21.15.62:0/3411567465 shutdown_connections 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.441+0000 7f82b7200640 1 -- 172.21.15.62:0/3411567465 wait complete. 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.442+0000 7f82b7200640 1 Processor -- start 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.442+0000 7f82b7200640 1 -- start start 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b7200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82b8102b90 0x7f82b819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b81034b0 0x7f82b819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b7200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82b810bfc0 0x7f82b819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b7200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8111dc0 con 0x7f82b810bfc0 2024-09-12T01:57:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8111c40 con 0x7f82b81034b0 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b7200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8111f40 con 0x7f82b8102b90 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b6800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82b810bfc0 0x7f82b819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b5e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82b8102b90 0x7f82b819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b6800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82b810bfc0 0x7f82b819ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51672/0 (socket says 172.21.15.62:51672) 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b5400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b81034b0 0x7f82b819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b6800640 1 -- 172.21.15.62:0/2823085818 learned_addr learned my addr 172.21.15.62:0/2823085818 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b5e00640 1 -- 172.21.15.62:0/2823085818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b81034b0 msgr2=0x7f82b819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b5e00640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b81034b0 0x7f82b819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b5e00640 1 -- 172.21.15.62:0/2823085818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82b810bfc0 msgr2=0x7f82b819ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b5e00640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82b810bfc0 0x7f82b819ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b5e00640 1 -- 172.21.15.62:0/2823085818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b819f4f0 con 0x7f82b8102b90 2024-09-12T01:57:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.443+0000 7f82b6800640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82b810bfc0 0x7f82b819ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.444+0000 7f82b5400640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b81034b0 0x7f82b819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.444+0000 7f82b5e00640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82b8102b90 0x7f82b819a540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005940 tx=0x7f82a80040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.444+0000 7f82aea00640 1 -- 172.21.15.62:0/2823085818 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a803f030 con 0x7f82b8102b90 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.444+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b819f780 con 0x7f82b8102b90 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.444+0000 7f82aea00640 1 -- 172.21.15.62:0/2823085818 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82a80044c0 con 0x7f82b8102b90 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.444+0000 7f82aea00640 1 -- 172.21.15.62:0/2823085818 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a8035070 con 0x7f82b8102b90 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.444+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b81a70c0 con 0x7f82b8102b90 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.445+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82b8102220 con 0x7f82b8102b90 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.448+0000 7f82aea00640 1 -- 172.21.15.62:0/2823085818 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f82a8042030 con 0x7f82b8102b90 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.449+0000 7f82aea00640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f829c0a2c10 0x7f829c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.449+0000 7f82aea00640 1 -- 172.21.15.62:0/2823085818 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f82a80eff70 con 0x7f82b8102b90 2024-09-12T01:57:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.449+0000 7f82b5400640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f829c0a2c10 0x7f829c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.449+0000 7f82aea00640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] conn(0x7f829c0adde0 0x7f829c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.449+0000 7f82aea00640 1 -- 172.21.15.62:0/2823085818 --> [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82a8040e70 con 0x7f829c0adde0 2024-09-12T01:57:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.449+0000 7f82aea00640 1 -- 172.21.15.62:0/2823085818 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f82a80f0320 con 0x7f82b8102b90 2024-09-12T01:57:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.450+0000 7f82b6800640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] conn(0x7f829c0adde0 0x7f829c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.450+0000 7f82b5400640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f829c0a2c10 0x7f829c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f82b810e8f0 tx=0x7f82a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.450+0000 7f82b6800640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] conn(0x7f829c0adde0 0x7f829c0b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.451+0000 7f82aea00640 1 -- 172.21.15.62:0/2823085818 <== osd.1 v2:172.21.15.77:6800/2738000605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82a8040e70 con 0x7f829c0adde0 2024-09-12T01:57:58.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.467+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 --> [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82b806a850 con 0x7f829c0adde0 2024-09-12T01:57:58.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.467+0000 7f82aea00640 1 -- 172.21.15.62:0/2823085818 <== osd.1 v2:172.21.15.77:6800/2738000605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f82b806a850 con 0x7f829c0adde0 2024-09-12T01:57:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.468+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 >> [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] conn(0x7f829c0adde0 msgr2=0x7f829c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.468+0000 7f82b7200640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] conn(0x7f829c0adde0 0x7f829c0b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.468+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f829c0a2c10 msgr2=0x7f829c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.468+0000 7f82b7200640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f829c0a2c10 0x7f829c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f82b810e8f0 tx=0x7f82a4005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.468+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82b8102b90 msgr2=0x7f82b819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.468+0000 7f82b7200640 1 --2- 172.21.15.62:0/2823085818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82b8102b90 0x7f82b819a540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005940 tx=0x7f82a80040c0 comp rx=0 tx=0).stop 2024-09-12T01:57:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.468+0000 7f82b6800640 1 -- 172.21.15.62:0/2823085818 reap_dead start 2024-09-12T01:57:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.468+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 shutdown_connections 2024-09-12T01:57:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.468+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 >> 172.21.15.62:0/2823085818 conn(0x7f82b80fc610 msgr2=0x7f82b810d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.469+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 shutdown_connections 2024-09-12T01:57:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:57:58.469+0000 7f82b7200640 1 -- 172.21.15.62:0/2823085818 wait complete. 2024-09-12T01:57:59.207 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:59.239 INFO:teuthology.orchestra.run.smithi062.stdout:244813135915 2024-09-12T01:57:59.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T01:57:59.593 INFO:teuthology.orchestra.run.smithi062.stdout:34359738456 2024-09-12T01:57:59.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T01:57:59.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:57:59 smithi077 ceph-mon[35095]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:57:59.777 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:57:59 smithi062 ceph-mon[30666]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:57:59.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:57:59 smithi107 ceph-mon[35463]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:58:00.079 INFO:teuthology.orchestra.run.smithi062.stdout:55834574930 2024-09-12T01:58:00.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T01:58:00.262 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:00.291 INFO:teuthology.orchestra.run.smithi062.stdout:193273528376 2024-09-12T01:58:00.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T01:58:00.402 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi062.stdout:326417514526 2024-09-12T01:58:01.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T01:58:01.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:01 smithi062 ceph-mon[30666]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:01.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:01 smithi107 ceph-mon[35463]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:01.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:01 smithi077 ceph-mon[35095]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:02.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.326+0000 7f8c1f200640 1 -- 172.21.15.62:0/481974438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c20102b90 msgr2=0x7f8c20102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.326+0000 7f8c1f200640 1 --2- 172.21.15.62:0/481974438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c20102b90 0x7f8c20102f70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009900 tx=0x7f8c1002a480 comp rx=0 tx=0).stop 2024-09-12T01:58:02.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.326+0000 7f8c1f200640 1 -- 172.21.15.62:0/481974438 shutdown_connections 2024-09-12T01:58:02.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.326+0000 7f8c1f200640 1 --2- 172.21.15.62:0/481974438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c2010bfc0 0x7f8c2010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.326+0000 7f8c1f200640 1 --2- 172.21.15.62:0/481974438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c201034b0 0x7f8c2010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.326+0000 7f8c1f200640 1 --2- 172.21.15.62:0/481974438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c20102b90 0x7f8c20102f70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.326+0000 7f8c1f200640 1 -- 172.21.15.62:0/481974438 >> 172.21.15.62:0/481974438 conn(0x7f8c200fc610 msgr2=0x7f8c200fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:02.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.326+0000 7f8c1f200640 1 -- 172.21.15.62:0/481974438 shutdown_connections 2024-09-12T01:58:02.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.326+0000 7f8c1f200640 1 -- 172.21.15.62:0/481974438 wait complete. 2024-09-12T01:58:02.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.327+0000 7f8c1f200640 1 Processor -- start 2024-09-12T01:58:02.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.327+0000 7f8c1f200640 1 -- start start 2024-09-12T01:58:02.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.327+0000 7f8c1f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c20102b90 0x7f8c20198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.327+0000 7f8c1f200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c201034b0 0x7f8c201987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.327+0000 7f8c1f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c2010bfc0 0x7f8c2019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.327+0000 7f8c1f200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20111e10 con 0x7f8c201034b0 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.327+0000 7f8c1f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20111c90 con 0x7f8c2010bfc0 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.327+0000 7f8c1f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20111f90 con 0x7f8c20102b90 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c20102b90 0x7f8c20198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c2010bfc0 0x7f8c2019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c20102b90 0x7f8c20198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:41198/0 (socket says 172.21.15.62:41198) 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1de00640 1 -- 172.21.15.62:0/4206290925 learned_addr learned my addr 172.21.15.62:0/4206290925 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1d400640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c201034b0 0x7f8c201987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1e800640 1 -- 172.21.15.62:0/4206290925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c20102b90 msgr2=0x7f8c20198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1e800640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c20102b90 0x7f8c20198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1e800640 1 -- 172.21.15.62:0/4206290925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c201034b0 msgr2=0x7f8c201987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1e800640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c201034b0 0x7f8c201987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1e800640 1 -- 172.21.15.62:0/4206290925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2019d220 con 0x7f8c2010bfc0 2024-09-12T01:58:02.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1d400640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c201034b0 0x7f8c201987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:02.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.328+0000 7f8c1e800640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c2010bfc0 0x7f8c2019cb40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800e940 tx=0x7f8c1800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.329+0000 7f8c16a00640 1 -- 172.21.15.62:0/4206290925 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c18004d20 con 0x7f8c2010bfc0 2024-09-12T01:58:02.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.329+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2019d510 con 0x7f8c2010bfc0 2024-09-12T01:58:02.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.329+0000 7f8c16a00640 1 -- 172.21.15.62:0/4206290925 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c18005020 con 0x7f8c2010bfc0 2024-09-12T01:58:02.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.329+0000 7f8c16a00640 1 -- 172.21.15.62:0/4206290925 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180116b0 con 0x7f8c2010bfc0 2024-09-12T01:58:02.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.329+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c201a4df0 con 0x7f8c2010bfc0 2024-09-12T01:58:02.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.330+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c20062980 con 0x7f8c2010bfc0 2024-09-12T01:58:02.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.332+0000 7f8c16a00640 1 -- 172.21.15.62:0/4206290925 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8c180054d0 con 0x7f8c2010bfc0 2024-09-12T01:58:02.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.333+0000 7f8c16a00640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8c040a2c10 0x7f8c040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.334+0000 7f8c16a00640 1 -- 172.21.15.62:0/4206290925 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f8c180cfa20 con 0x7f8c2010bfc0 2024-09-12T01:58:02.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.334+0000 7f8c1de00640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8c040a2c10 0x7f8c040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.334+0000 7f8c16a00640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] conn(0x7f8c040adde0 0x7f8c040b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.334+0000 7f8c16a00640 1 -- 172.21.15.62:0/4206290925 --> [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c18014ec0 con 0x7f8c040adde0 2024-09-12T01:58:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.334+0000 7f8c16a00640 1 -- 172.21.15.62:0/4206290925 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f8c180cfdd0 con 0x7f8c2010bfc0 2024-09-12T01:58:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.335+0000 7f8c1d400640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] conn(0x7f8c040adde0 0x7f8c040b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.335+0000 7f8c1de00640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8c040a2c10 0x7f8c040a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c100096c0 tx=0x7f8c100046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.335+0000 7f8c1d400640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] conn(0x7f8c040adde0 0x7f8c040b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.336+0000 7f8c16a00640 1 -- 172.21.15.62:0/4206290925 <== osd.5 v2:172.21.15.107:6808/2023940642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c18014ec0 con 0x7f8c040adde0 2024-09-12T01:58:02.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.351+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 --> [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c20062e00 con 0x7f8c040adde0 2024-09-12T01:58:02.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.351+0000 7f8c16a00640 1 -- 172.21.15.62:0/4206290925 <== osd.5 v2:172.21.15.107:6808/2023940642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8c20062e00 con 0x7f8c040adde0 2024-09-12T01:58:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 >> [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] conn(0x7f8c040adde0 msgr2=0x7f8c040b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1f200640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] conn(0x7f8c040adde0 0x7f8c040b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8c040a2c10 msgr2=0x7f8c040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1f200640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f8c040a2c10 0x7f8c040a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c100096c0 tx=0x7f8c100046c0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c2010bfc0 msgr2=0x7f8c2019cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1f200640 1 --2- 172.21.15.62:0/4206290925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c2010bfc0 0x7f8c2019cb40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800e940 tx=0x7f8c1800ee00 comp rx=0 tx=0).stop 2024-09-12T01:58:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1e800640 1 -- 172.21.15.62:0/4206290925 reap_dead start 2024-09-12T01:58:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 shutdown_connections 2024-09-12T01:58:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 >> 172.21.15.62:0/4206290925 conn(0x7f8c200fc610 msgr2=0x7f8c200fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:02.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 shutdown_connections 2024-09-12T01:58:02.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.352+0000 7f8c1f200640 1 -- 172.21.15.62:0/4206290925 wait complete. 2024-09-12T01:58:02.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.196+0000 7f95cbe00640 1 -- 172.21.15.62:0/3325246307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc102370 msgr2=0x7f95cc10e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.196+0000 7f95cbe00640 1 --2- 172.21.15.62:0/3325246307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc102370 0x7f95cc10e8a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009c10 tx=0x7f95c402a6f0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.196+0000 7f95cbe00640 1 -- 172.21.15.62:0/3325246307 shutdown_connections 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.196+0000 7f95cbe00640 1 --2- 172.21.15.62:0/3325246307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc102370 0x7f95cc10e8a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.196+0000 7f95cbe00640 1 --2- 172.21.15.62:0/3325246307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc1019d0 0x7f95cc101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.196+0000 7f95cbe00640 1 --2- 172.21.15.62:0/3325246307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95cc1079d0 0x7f95cc107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.196+0000 7f95cbe00640 1 -- 172.21.15.62:0/3325246307 >> 172.21.15.62:0/3325246307 conn(0x7f95cc0fd710 msgr2=0x7f95cc0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.196+0000 7f95cbe00640 1 -- 172.21.15.62:0/3325246307 shutdown_connections 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.196+0000 7f95cbe00640 1 -- 172.21.15.62:0/3325246307 wait complete. 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.197+0000 7f95cbe00640 1 Processor -- start 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95cbe00640 1 -- start start 2024-09-12T01:58:02.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95cbe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc1019d0 0x7f95cc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95cbe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95cc102370 0x7f95cc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95cbe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc1079d0 0x7f95cc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95cbe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc111dd0 con 0x7f95cc1079d0 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95cbe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc111c50 con 0x7f95cc102370 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95cbe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc111f50 con 0x7f95cc1019d0 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95caa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc1019d0 0x7f95cc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95caa00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc1019d0 0x7f95cc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:41182/0 (socket says 172.21.15.62:41182) 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95caa00640 1 -- 172.21.15.62:0/287197586 learned_addr learned my addr 172.21.15.62:0/287197586 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95c3e00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95cc102370 0x7f95cc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.198+0000 7f95cb400640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc1079d0 0x7f95cc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.199+0000 7f95caa00640 1 -- 172.21.15.62:0/287197586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95cc102370 msgr2=0x7f95cc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.199+0000 7f95caa00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95cc102370 0x7f95cc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.199+0000 7f95caa00640 1 -- 172.21.15.62:0/287197586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc1079d0 msgr2=0x7f95cc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.199+0000 7f95caa00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc1079d0 0x7f95cc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.199+0000 7f95caa00640 1 -- 172.21.15.62:0/287197586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc1a66f0 con 0x7f95cc1019d0 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.199+0000 7f95caa00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc1019d0 0x7f95cc0744f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00e9f0 tx=0x7f95bc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.199+0000 7f95d0a00640 1 -- 172.21.15.62:0/287197586 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00ccc0 con 0x7f95cc1019d0 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.200+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc1a69e0 con 0x7f95cc1019d0 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.200+0000 7f95d0a00640 1 -- 172.21.15.62:0/287197586 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95bc010910 con 0x7f95cc1019d0 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.200+0000 7f95d0a00640 1 -- 172.21.15.62:0/287197586 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0188a0 con 0x7f95cc1019d0 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.200+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95cc1a6f70 con 0x7f95cc1019d0 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.200+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95cc0ff7e0 con 0x7f95cc1019d0 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.203+0000 7f95d0a00640 1 -- 172.21.15.62:0/287197586 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f95bc010ac0 con 0x7f95cc1019d0 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.204+0000 7f95d0a00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95b00a2c10 0x7f95b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.204+0000 7f95d0a00640 1 -- 172.21.15.62:0/287197586 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f95bc0d0130 con 0x7f95cc1019d0 2024-09-12T01:58:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.204+0000 7f95c3e00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95b00a2c10 0x7f95b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.204+0000 7f95d0a00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] conn(0x7f95b00adde0 0x7f95b00b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.204+0000 7f95d0a00640 1 -- 172.21.15.62:0/287197586 --> [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95bc028ea0 con 0x7f95b00adde0 2024-09-12T01:58:02.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.204+0000 7f95d0a00640 1 -- 172.21.15.62:0/287197586 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f95bc0d04e0 con 0x7f95cc1019d0 2024-09-12T01:58:02.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.205+0000 7f95cb400640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] conn(0x7f95b00adde0 0x7f95b00b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.205+0000 7f95c3e00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95b00a2c10 0x7f95b00a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95cc075f80 tx=0x7f95b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.205+0000 7f95cb400640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] conn(0x7f95b00adde0 0x7f95b00b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.206+0000 7f95d0a00640 1 -- 172.21.15.62:0/287197586 <== osd.4 v2:172.21.15.77:6808/1516569462 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95bc028ea0 con 0x7f95b00adde0 2024-09-12T01:58:02.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.221+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 --> [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f95cc103110 con 0x7f95b00adde0 2024-09-12T01:58:02.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.222+0000 7f95d0a00640 1 -- 172.21.15.62:0/287197586 <== osd.4 v2:172.21.15.77:6808/1516569462 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f95cc103110 con 0x7f95b00adde0 2024-09-12T01:58:02.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.222+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 >> [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] conn(0x7f95b00adde0 msgr2=0x7f95b00b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.222+0000 7f95cbe00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] conn(0x7f95b00adde0 0x7f95b00b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.222+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95b00a2c10 msgr2=0x7f95b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.222+0000 7f95cbe00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f95b00a2c10 0x7f95b00a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95cc075f80 tx=0x7f95b4009260 comp rx=0 tx=0).stop 2024-09-12T01:58:02.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.222+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc1019d0 msgr2=0x7f95cc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.222+0000 7f95cbe00640 1 --2- 172.21.15.62:0/287197586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95cc1019d0 0x7f95cc0744f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00e9f0 tx=0x7f95bc00edf0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.222+0000 7f95cb400640 1 -- 172.21.15.62:0/287197586 reap_dead start 2024-09-12T01:58:02.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.222+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 shutdown_connections 2024-09-12T01:58:02.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.222+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 >> 172.21.15.62:0/287197586 conn(0x7f95cc0fd710 msgr2=0x7f95cc0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:02.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.223+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 shutdown_connections 2024-09-12T01:58:02.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.223+0000 7f95cbe00640 1 -- 172.21.15.62:0/287197586 wait complete. 2024-09-12T01:58:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.970+0000 7f355ac00640 1 -- 172.21.15.62:0/1392847245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3554109120 msgr2=0x7f3554110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.970+0000 7f355ac00640 1 --2- 172.21.15.62:0/1392847245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3554109120 0x7f3554110ca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f354c009ca0 tx=0x7f354c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.970+0000 7f355ac00640 1 -- 172.21.15.62:0/1392847245 shutdown_connections 2024-09-12T01:58:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.970+0000 7f355ac00640 1 --2- 172.21.15.62:0/1392847245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3554109120 0x7f3554110ca0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.970+0000 7f355ac00640 1 --2- 172.21.15.62:0/1392847245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35541049a0 0x7f35541089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.970+0000 7f355ac00640 1 --2- 172.21.15.62:0/1392847245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3554103ff0 0x7f35541043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.970+0000 7f355ac00640 1 -- 172.21.15.62:0/1392847245 >> 172.21.15.62:0/1392847245 conn(0x7f35540ffa90 msgr2=0x7f3554101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.970+0000 7f355ac00640 1 -- 172.21.15.62:0/1392847245 shutdown_connections 2024-09-12T01:58:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.970+0000 7f355ac00640 1 -- 172.21.15.62:0/1392847245 wait complete. 2024-09-12T01:58:02.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.972+0000 7f355ac00640 1 Processor -- start 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.972+0000 7f355ac00640 1 -- start start 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.972+0000 7f355ac00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3554103ff0 0x7f355419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.972+0000 7f355ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35541049a0 0x7f355419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.972+0000 7f355ac00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3554109120 0x7f355419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.972+0000 7f355ac00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3554114150 con 0x7f3554103ff0 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.972+0000 7f355ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3554113fd0 con 0x7f35541049a0 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.972+0000 7f355ac00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f35541142d0 con 0x7f3554109120 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3553e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3554103ff0 0x7f355419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3553e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3554103ff0 0x7f355419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59980/0 (socket says 172.21.15.62:59980) 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3553e00640 1 -- 172.21.15.62:0/4279096439 learned_addr learned my addr 172.21.15.62:0/4279096439 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:02.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3553400640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35541049a0 0x7f355419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3558c00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3554109120 0x7f355419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3553e00640 1 -- 172.21.15.62:0/4279096439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3554109120 msgr2=0x7f355419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3553e00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3554109120 0x7f355419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3553e00640 1 -- 172.21.15.62:0/4279096439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35541049a0 msgr2=0x7f355419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3553e00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35541049a0 0x7f355419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3553e00640 1 -- 172.21.15.62:0/4279096439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355419f5c0 con 0x7f3554103ff0 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.973+0000 7f3553e00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3554103ff0 0x7f355419a610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f354400e9f0 tx=0x7f354400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.974+0000 7f3550c00640 1 -- 172.21.15.62:0/4279096439 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354400cd80 con 0x7f3554103ff0 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.974+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355419f8b0 con 0x7f3554103ff0 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.974+0000 7f3550c00640 1 -- 172.21.15.62:0/4279096439 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3544005500 con 0x7f3554103ff0 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.974+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35541a7190 con 0x7f3554103ff0 2024-09-12T01:58:02.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.974+0000 7f3550c00640 1 -- 172.21.15.62:0/4279096439 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544018630 con 0x7f3554103ff0 2024-09-12T01:58:02.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.975+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3554062980 con 0x7f3554103ff0 2024-09-12T01:58:02.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.977+0000 7f3550c00640 1 -- 172.21.15.62:0/4279096439 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f35440046c0 con 0x7f3554103ff0 2024-09-12T01:58:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.979+0000 7f3550c00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f35380a2c10 0x7f35380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.979+0000 7f3550c00640 1 -- 172.21.15.62:0/4279096439 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f35440d0340 con 0x7f3554103ff0 2024-09-12T01:58:02.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.979+0000 7f3553400640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f35380a2c10 0x7f35380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.979+0000 7f3550c00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] conn(0x7f35380adde0 0x7f35380b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.979+0000 7f3550c00640 1 -- 172.21.15.62:0/4279096439 --> [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3544004470 con 0x7f35380adde0 2024-09-12T01:58:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.979+0000 7f3550c00640 1 -- 172.21.15.62:0/4279096439 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f35440d06f0 con 0x7f3554103ff0 2024-09-12T01:58:02.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.980+0000 7f3558c00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] conn(0x7f35380adde0 0x7f35380b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.980+0000 7f3553400640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f35380a2c10 0x7f35380a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f35540ffeb0 tx=0x7f3540005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.980+0000 7f3558c00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] conn(0x7f35380adde0 0x7f35380b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.982+0000 7f3550c00640 1 -- 172.21.15.62:0/4279096439 <== osd.3 v2:172.21.15.62:6810/1756749723 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3544004470 con 0x7f35380adde0 2024-09-12T01:58:02.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.998+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 --> [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3554062d80 con 0x7f35380adde0 2024-09-12T01:58:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.999+0000 7f3550c00640 1 -- 172.21.15.62:0/4279096439 <== osd.3 v2:172.21.15.62:6810/1756749723 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3554062d80 con 0x7f35380adde0 2024-09-12T01:58:02.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.999+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] conn(0x7f35380adde0 msgr2=0x7f35380b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.999+0000 7f355ac00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] conn(0x7f35380adde0 0x7f35380b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.999+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f35380a2c10 msgr2=0x7f35380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.999+0000 7f355ac00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f35380a2c10 0x7f35380a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f35540ffeb0 tx=0x7f3540005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:03.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.999+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3554103ff0 msgr2=0x7f355419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.999+0000 7f355ac00640 1 --2- 172.21.15.62:0/4279096439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3554103ff0 0x7f355419a610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f354400e9f0 tx=0x7f354400edf0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.999+0000 7f3558c00640 1 -- 172.21.15.62:0/4279096439 reap_dead start 2024-09-12T01:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:03.000+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 shutdown_connections 2024-09-12T01:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:03.000+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 >> 172.21.15.62:0/4279096439 conn(0x7f35540ffa90 msgr2=0x7f3554100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:03.000+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 shutdown_connections 2024-09-12T01:58:03.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:03.000+0000 7f355ac00640 1 -- 172.21.15.62:0/4279096439 wait complete. 2024-09-12T01:58:03.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.863+0000 7f4cf6200640 1 -- 172.21.15.62:0/1290922896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf01049c0 msgr2=0x7f4cf0108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.863+0000 7f4cf6200640 1 --2- 172.21.15.62:0/1290922896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf01049c0 0x7f4cf0108a10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009900 tx=0x7f4cdc02a410 comp rx=0 tx=0).stop 2024-09-12T01:58:03.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.863+0000 7f4cf6200640 1 -- 172.21.15.62:0/1290922896 shutdown_connections 2024-09-12T01:58:03.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.864+0000 7f4cf6200640 1 --2- 172.21.15.62:0/1290922896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf0109140 0x7f4cf0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.864+0000 7f4cf6200640 1 --2- 172.21.15.62:0/1290922896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf01049c0 0x7f4cf0108a10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.864+0000 7f4cf6200640 1 --2- 172.21.15.62:0/1290922896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf0104010 0x7f4cf01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.864+0000 7f4cf6200640 1 -- 172.21.15.62:0/1290922896 >> 172.21.15.62:0/1290922896 conn(0x7f4cf00ffa50 msgr2=0x7f4cf0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.864+0000 7f4cf6200640 1 -- 172.21.15.62:0/1290922896 shutdown_connections 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.864+0000 7f4cf6200640 1 -- 172.21.15.62:0/1290922896 wait complete. 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.865+0000 7f4cf6200640 1 Processor -- start 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.865+0000 7f4cf6200640 1 -- start start 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4cf6200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf0104010 0x7f4cf019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4cf6200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf01049c0 0x7f4cf019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4cf6200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf0109140 0x7f4cf019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4cf6200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf01141b0 con 0x7f4cf0104010 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4cf6200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0114030 con 0x7f4cf01049c0 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4cf6200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0114330 con 0x7f4cf0109140 2024-09-12T01:58:03.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4ceea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf01049c0 0x7f4cf019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4cefe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf0109140 0x7f4cf019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4cef400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf0104010 0x7f4cf019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4ceea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf01049c0 0x7f4cf019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:48894/0 (socket says 172.21.15.62:48894) 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4ceea00640 1 -- 172.21.15.62:0/2899534258 learned_addr learned my addr 172.21.15.62:0/2899534258 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.866+0000 7f4cefe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf0109140 0x7f4cf019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:41220/0 (socket says 172.21.15.62:41220) 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.867+0000 7f4ceea00640 1 -- 172.21.15.62:0/2899534258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf0109140 msgr2=0x7f4cf019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.867+0000 7f4ceea00640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf0109140 0x7f4cf019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.867+0000 7f4ceea00640 1 -- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf0104010 msgr2=0x7f4cf019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.867+0000 7f4ceea00640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cf0104010 0x7f4cf019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.867+0000 7f4ceea00640 1 -- 172.21.15.62:0/2899534258 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf019f660 con 0x7f4cf01049c0 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.867+0000 7f4ceea00640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf01049c0 0x7f4cf019abf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc004770 tx=0x7f4cdc003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.867+0000 7f4ce7e00640 1 -- 172.21.15.62:0/2899534258 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc03f070 con 0x7f4cf01049c0 2024-09-12T01:58:03.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.867+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf019f8f0 con 0x7f4cf01049c0 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.867+0000 7f4ce7e00640 1 -- 172.21.15.62:0/2899534258 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cdc031ca0 con 0x7f4cf01049c0 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.867+0000 7f4ce7e00640 1 -- 172.21.15.62:0/2899534258 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc035030 con 0x7f4cf01049c0 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.868+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf01a7230 con 0x7f4cf01049c0 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.868+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4cf0062900 con 0x7f4cf01049c0 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.870+0000 7f4ce7e00640 1 -- 172.21.15.62:0/2899534258 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4cdc042070 con 0x7f4cf01049c0 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.872+0000 7f4ce7e00640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cd40a2c90 0x7f4cd40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.872+0000 7f4ce7e00640 1 -- 172.21.15.62:0/2899534258 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f4cdc0f0100 con 0x7f4cf01049c0 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.872+0000 7f4cef400640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cd40a2c90 0x7f4cd40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.872+0000 7f4ce7e00640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] conn(0x7f4cd40add30 0x7f4cd40b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.872+0000 7f4ce7e00640 1 -- 172.21.15.62:0/2899534258 --> [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cdc032e50 con 0x7f4cd40add30 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.872+0000 7f4ce7e00640 1 -- 172.21.15.62:0/2899534258 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f4cdc0f04b0 con 0x7f4cf01049c0 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.872+0000 7f4cefe00640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] conn(0x7f4cd40add30 0x7f4cd40b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:03.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.873+0000 7f4cef400640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cd40a2c90 0x7f4cd40a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009bd0 tx=0x7f4ce0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.873+0000 7f4cefe00640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] conn(0x7f4cd40add30 0x7f4cd40b01d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:03.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.874+0000 7f4ce7e00640 1 -- 172.21.15.62:0/2899534258 <== osd.9 v2:172.21.15.62:6826/2067861247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4cdc032e50 con 0x7f4cd40add30 2024-09-12T01:58:03.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.889+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 --> [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4cf0062d00 con 0x7f4cd40add30 2024-09-12T01:58:03.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.889+0000 7f4ce7e00640 1 -- 172.21.15.62:0/2899534258 <== osd.9 v2:172.21.15.62:6826/2067861247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4cf0062d00 con 0x7f4cd40add30 2024-09-12T01:58:03.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.889+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] conn(0x7f4cd40add30 msgr2=0x7f4cd40b01d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.889+0000 7f4cf6200640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] conn(0x7f4cd40add30 0x7f4cd40b01d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.890+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cd40a2c90 msgr2=0x7f4cd40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.890+0000 7f4cf6200640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cd40a2c90 0x7f4cd40a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009bd0 tx=0x7f4ce0005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.890+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf01049c0 msgr2=0x7f4cf019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.890+0000 7f4cf6200640 1 --2- 172.21.15.62:0/2899534258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf01049c0 0x7f4cf019abf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc004770 tx=0x7f4cdc003c10 comp rx=0 tx=0).stop 2024-09-12T01:58:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.890+0000 7f4cefe00640 1 -- 172.21.15.62:0/2899534258 reap_dead start 2024-09-12T01:58:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.890+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 shutdown_connections 2024-09-12T01:58:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.890+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 >> 172.21.15.62:0/2899534258 conn(0x7f4cf00ffa50 msgr2=0x7f4cf0100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.890+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 shutdown_connections 2024-09-12T01:58:03.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:02.890+0000 7f4cf6200640 1 -- 172.21.15.62:0/2899534258 wait complete. 2024-09-12T01:58:03.781 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:03 smithi062 ceph-mon[30666]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:03.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:03 smithi107 ceph-mon[35463]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:03.967 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:03 smithi077 ceph-mon[35095]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.266+0000 7fc994a00640 1 -- 172.21.15.62:0/217760755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc990103e30 msgr2=0x7fc990104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.266+0000 7fc994a00640 1 --2- 172.21.15.62:0/217760755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc990103e30 0x7fc990104210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc980009900 tx=0x7fc98002a3f0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.266+0000 7fc994a00640 1 -- 172.21.15.62:0/217760755 shutdown_connections 2024-09-12T01:58:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.266+0000 7fc994a00640 1 --2- 172.21.15.62:0/217760755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc990108f60 0x7fc990110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.266+0000 7fc994a00640 1 --2- 172.21.15.62:0/217760755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9901047e0 0x7fc990108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.266+0000 7fc994a00640 1 --2- 172.21.15.62:0/217760755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc990103e30 0x7fc990104210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.266+0000 7fc994a00640 1 -- 172.21.15.62:0/217760755 >> 172.21.15.62:0/217760755 conn(0x7fc9900ff8d0 msgr2=0x7fc990101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.266+0000 7fc994a00640 1 -- 172.21.15.62:0/217760755 shutdown_connections 2024-09-12T01:58:04.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.266+0000 7fc994a00640 1 -- 172.21.15.62:0/217760755 wait complete. 2024-09-12T01:58:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.267+0000 7fc994a00640 1 Processor -- start 2024-09-12T01:58:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.267+0000 7fc994a00640 1 -- start start 2024-09-12T01:58:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.267+0000 7fc994a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc990103e30 0x7fc99019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc994a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9901047e0 0x7fc99019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc994a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc990108f60 0x7fc99019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc994a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc990113fc0 con 0x7fc990103e30 2024-09-12T01:58:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc994a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc990113e40 con 0x7fc9901047e0 2024-09-12T01:58:04.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc994a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc990114140 con 0x7fc990108f60 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc98f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc990103e30 0x7fc99019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc98f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc990103e30 0x7fc99019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59998/0 (socket says 172.21.15.62:59998) 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc98f400640 1 -- 172.21.15.62:0/417260431 learned_addr learned my addr 172.21.15.62:0/417260431 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc98ea00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9901047e0 0x7fc99019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc98fe00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc990108f60 0x7fc99019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc98f400640 1 -- 172.21.15.62:0/417260431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc990108f60 msgr2=0x7fc99019ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc98f400640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc990108f60 0x7fc99019ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc98f400640 1 -- 172.21.15.62:0/417260431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9901047e0 msgr2=0x7fc99019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc98f400640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9901047e0 0x7fc99019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.268+0000 7fc98f400640 1 -- 172.21.15.62:0/417260431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99019f450 con 0x7fc990103e30 2024-09-12T01:58:04.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.269+0000 7fc98f400640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc990103e30 0x7fc99019a4a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc980006010 tx=0x7fc9800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.269+0000 7fc987e00640 1 -- 172.21.15.62:0/417260431 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98003f030 con 0x7fc990103e30 2024-09-12T01:58:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.269+0000 7fc987e00640 1 -- 172.21.15.62:0/417260431 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc980003ce0 con 0x7fc990103e30 2024-09-12T01:58:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.269+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99019f6e0 con 0x7fc990103e30 2024-09-12T01:58:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.269+0000 7fc987e00640 1 -- 172.21.15.62:0/417260431 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980035070 con 0x7fc990103e30 2024-09-12T01:58:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.269+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9901a7020 con 0x7fc990103e30 2024-09-12T01:58:04.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.270+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc990062980 con 0x7fc990103e30 2024-09-12T01:58:04.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.272+0000 7fc987e00640 1 -- 172.21.15.62:0/417260431 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc980042030 con 0x7fc990103e30 2024-09-12T01:58:04.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.274+0000 7fc987e00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc9740a2c90 0x7fc9740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.274+0000 7fc987e00640 1 -- 172.21.15.62:0/417260431 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc9800effc0 con 0x7fc990103e30 2024-09-12T01:58:04.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.274+0000 7fc98ea00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc9740a2c90 0x7fc9740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.274+0000 7fc987e00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] conn(0x7fc9740ade60 0x7fc9740b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.274+0000 7fc987e00640 1 -- 172.21.15.62:0/417260431 --> [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9740b09d0 con 0x7fc9740ade60 2024-09-12T01:58:04.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.274+0000 7fc987e00640 1 -- 172.21.15.62:0/417260431 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fc9800f0410 con 0x7fc990103e30 2024-09-12T01:58:04.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.275+0000 7fc98fe00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] conn(0x7fc9740ade60 0x7fc9740b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.275+0000 7fc98ea00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc9740a2c90 0x7fc9740a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc9900ffd60 tx=0x7fc97c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.275+0000 7fc98fe00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] conn(0x7fc9740ade60 0x7fc9740b0300 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.276+0000 7fc987e00640 1 -- 172.21.15.62:0/417260431 <== osd.7 v2:172.21.15.77:6816/1202278855 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9740b09d0 con 0x7fc9740ade60 2024-09-12T01:58:04.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.293+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 --> [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc990062d80 con 0x7fc9740ade60 2024-09-12T01:58:04.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.293+0000 7fc987e00640 1 -- 172.21.15.62:0/417260431 <== osd.7 v2:172.21.15.77:6816/1202278855 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc990062d80 con 0x7fc9740ade60 2024-09-12T01:58:04.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 >> [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] conn(0x7fc9740ade60 msgr2=0x7fc9740b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc994a00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] conn(0x7fc9740ade60 0x7fc9740b0300 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc9740a2c90 msgr2=0x7fc9740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc994a00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc9740a2c90 0x7fc9740a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc9900ffd60 tx=0x7fc97c005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:04.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc990103e30 msgr2=0x7fc99019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc994a00640 1 --2- 172.21.15.62:0/417260431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc990103e30 0x7fc99019a4a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc980006010 tx=0x7fc9800042f0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc98fe00640 1 -- 172.21.15.62:0/417260431 reap_dead start 2024-09-12T01:58:04.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 shutdown_connections 2024-09-12T01:58:04.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 >> 172.21.15.62:0/417260431 conn(0x7fc9900ff8d0 msgr2=0x7fc990100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 shutdown_connections 2024-09-12T01:58:04.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:04.294+0000 7fc994a00640 1 -- 172.21.15.62:0/417260431 wait complete. 2024-09-12T01:58:04.876 INFO:teuthology.orchestra.run.smithi062.stdout:274877906984 2024-09-12T01:58:04.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T01:58:05.781 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:05 smithi062 ceph-mon[30666]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:05.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.813+0000 7fd2d5000640 1 -- 172.21.15.62:0/678187899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d0108f60 msgr2=0x7fd2d0110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.813+0000 7fd2d5000640 1 --2- 172.21.15.62:0/678187899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d0108f60 0x7fd2d0110ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009ca0 tx=0x7fd2c802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.813+0000 7fd2d5000640 1 -- 172.21.15.62:0/678187899 shutdown_connections 2024-09-12T01:58:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.813+0000 7fd2d5000640 1 --2- 172.21.15.62:0/678187899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d0108f60 0x7fd2d0110ae0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.813+0000 7fd2d5000640 1 --2- 172.21.15.62:0/678187899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d01047e0 0x7fd2d0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.813+0000 7fd2d5000640 1 --2- 172.21.15.62:0/678187899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d0103e30 0x7fd2d0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.813+0000 7fd2d5000640 1 -- 172.21.15.62:0/678187899 >> 172.21.15.62:0/678187899 conn(0x7fd2d00ff8d0 msgr2=0x7fd2d0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.813+0000 7fd2d5000640 1 -- 172.21.15.62:0/678187899 shutdown_connections 2024-09-12T01:58:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.813+0000 7fd2d5000640 1 -- 172.21.15.62:0/678187899 wait complete. 2024-09-12T01:58:05.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.814+0000 7fd2d5000640 1 Processor -- start 2024-09-12T01:58:05.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.814+0000 7fd2d5000640 1 -- start start 2024-09-12T01:58:05.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2d5000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d0103e30 0x7fd2d0110950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2d5000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d01047e0 0x7fd2d010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2d5000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d0108f60 0x7fd2d010df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2d5000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0113fc0 con 0x7fd2d01047e0 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2d5000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0113e40 con 0x7fd2d0103e30 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2d5000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0114140 con 0x7fd2d0108f60 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2c7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d01047e0 0x7fd2d010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2cfe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d0108f60 0x7fd2d010df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2cf400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d0103e30 0x7fd2d0110950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2cfe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d0108f60 0x7fd2d010df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:41258/0 (socket says 172.21.15.62:41258) 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2cf400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d0103e30 0x7fd2d0110950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:48960/0 (socket says 172.21.15.62:48960) 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2cfe00640 1 -- 172.21.15.62:0/429474862 learned_addr learned my addr 172.21.15.62:0/429474862 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:05.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.815+0000 7fd2c7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d01047e0 0x7fd2d010da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60026/0 (socket says 172.21.15.62:60026) 2024-09-12T01:58:05.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.816+0000 7fd2cf400640 1 -- 172.21.15.62:0/429474862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d0108f60 msgr2=0x7fd2d010df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.816+0000 7fd2cf400640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d0108f60 0x7fd2d010df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.816+0000 7fd2cf400640 1 -- 172.21.15.62:0/429474862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d01047e0 msgr2=0x7fd2d010da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.816+0000 7fd2cf400640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2d01047e0 0x7fd2d010da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.816+0000 7fd2cf400640 1 -- 172.21.15.62:0/429474862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d010e7d0 con 0x7fd2d0103e30 2024-09-12T01:58:05.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.816+0000 7fd2cfe00640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d0108f60 0x7fd2d010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:05.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.816+0000 7fd2cf400640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d0103e30 0x7fd2d0110950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000e9f0 tx=0x7fd2c000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.816+0000 7fd2ccc00640 1 -- 172.21.15.62:0/429474862 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c000ccc0 con 0x7fd2d0103e30 2024-09-12T01:58:05.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.816+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d01aad60 con 0x7fd2d0103e30 2024-09-12T01:58:05.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.816+0000 7fd2ccc00640 1 -- 172.21.15.62:0/429474862 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2c0010910 con 0x7fd2d0103e30 2024-09-12T01:58:05.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.817+0000 7fd2ccc00640 1 -- 172.21.15.62:0/429474862 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0018960 con 0x7fd2d0103e30 2024-09-12T01:58:05.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.817+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d01ab2c0 con 0x7fd2d0103e30 2024-09-12T01:58:05.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.817+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2d0062900 con 0x7fd2d0103e30 2024-09-12T01:58:05.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.821+0000 7fd2ccc00640 1 -- 172.21.15.62:0/429474862 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd2c0010ac0 con 0x7fd2d0103e30 2024-09-12T01:58:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.824+0000 7fd2ccc00640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd2b40a2c90 0x7fd2b40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.824+0000 7fd2ccc00640 1 -- 172.21.15.62:0/429474862 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd2c00d00e0 con 0x7fd2d0103e30 2024-09-12T01:58:05.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.824+0000 7fd2c7e00640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd2b40a2c90 0x7fd2b40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.824+0000 7fd2ccc00640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] conn(0x7fd2b40ade60 0x7fd2b40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:05.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.824+0000 7fd2ccc00640 1 -- 172.21.15.62:0/429474862 --> [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2c001bec0 con 0x7fd2b40ade60 2024-09-12T01:58:05.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.824+0000 7fd2ccc00640 1 -- 172.21.15.62:0/429474862 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fd2c00d0490 con 0x7fd2d0103e30 2024-09-12T01:58:05.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.825+0000 7fd2cfe00640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] conn(0x7fd2b40ade60 0x7fd2b40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.825+0000 7fd2c7e00640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd2b40a2c90 0x7fd2b40a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd2d010f1c0 tx=0x7fd2b800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.825+0000 7fd2cfe00640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] conn(0x7fd2b40ade60 0x7fd2b40b0300 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:05.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.826+0000 7fd2ccc00640 1 -- 172.21.15.62:0/429474862 <== osd.10 v2:172.21.15.77:6824/454508594 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2c001bec0 con 0x7fd2b40ade60 2024-09-12T01:58:05.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.841+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 --> [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd2d0062d80 con 0x7fd2b40ade60 2024-09-12T01:58:05.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2ccc00640 1 -- 172.21.15.62:0/429474862 <== osd.10 v2:172.21.15.77:6824/454508594 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd2d0062d80 con 0x7fd2b40ade60 2024-09-12T01:58:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 >> [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] conn(0x7fd2b40ade60 msgr2=0x7fd2b40b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2d5000640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] conn(0x7fd2b40ade60 0x7fd2b40b0300 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd2b40a2c90 msgr2=0x7fd2b40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2d5000640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd2b40a2c90 0x7fd2b40a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd2d010f1c0 tx=0x7fd2b800b410 comp rx=0 tx=0).stop 2024-09-12T01:58:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d0103e30 msgr2=0x7fd2d0110950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2d5000640 1 --2- 172.21.15.62:0/429474862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d0103e30 0x7fd2d0110950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000e9f0 tx=0x7fd2c000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:58:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2cfe00640 1 -- 172.21.15.62:0/429474862 reap_dead start 2024-09-12T01:58:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 shutdown_connections 2024-09-12T01:58:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 >> 172.21.15.62:0/429474862 conn(0x7fd2d00ff8d0 msgr2=0x7fd2d0100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:05.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 shutdown_connections 2024-09-12T01:58:05.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:05.842+0000 7fd2d5000640 1 -- 172.21.15.62:0/429474862 wait complete. 2024-09-12T01:58:05.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:05 smithi107 ceph-mon[35463]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:05.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:05 smithi077 ceph-mon[35095]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:06.249 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:06.249 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:06.271 INFO:teuthology.orchestra.run.smithi062.stdout:163208757311 2024-09-12T01:58:06.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T01:58:07.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.315+0000 7f43ecc00640 1 -- 172.21.15.62:0/2878742606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e81079c0 msgr2=0x7f43e8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.315+0000 7f43ecc00640 1 --2- 172.21.15.62:0/2878742606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e81079c0 0x7f43e8107da0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009930 tx=0x7f43d802a440 comp rx=0 tx=0).stop 2024-09-12T01:58:07.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.315+0000 7f43ecc00640 1 -- 172.21.15.62:0/2878742606 shutdown_connections 2024-09-12T01:58:07.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.315+0000 7f43ecc00640 1 --2- 172.21.15.62:0/2878742606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e8102360 0x7f43e810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.315+0000 7f43ecc00640 1 --2- 172.21.15.62:0/2878742606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43e81019c0 0x7f43e8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.315+0000 7f43ecc00640 1 --2- 172.21.15.62:0/2878742606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e81079c0 0x7f43e8107da0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.315+0000 7f43ecc00640 1 -- 172.21.15.62:0/2878742606 >> 172.21.15.62:0/2878742606 conn(0x7f43e80fd740 msgr2=0x7f43e80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.315+0000 7f43ecc00640 1 -- 172.21.15.62:0/2878742606 shutdown_connections 2024-09-12T01:58:07.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.315+0000 7f43ecc00640 1 -- 172.21.15.62:0/2878742606 wait complete. 2024-09-12T01:58:07.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.316+0000 7f43ecc00640 1 Processor -- start 2024-09-12T01:58:07.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.317+0000 7f43ecc00640 1 -- start start 2024-09-12T01:58:07.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.317+0000 7f43ecc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e81019c0 0x7f43e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.317+0000 7f43ecc00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43e8102360 0x7f43e8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.317+0000 7f43ecc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e81079c0 0x7f43e8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.317+0000 7f43ecc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f43e8111dc0 con 0x7f43e81019c0 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.317+0000 7f43ecc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43e8111c40 con 0x7f43e81079c0 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.317+0000 7f43ecc00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f43e8111f40 con 0x7f43e8102360 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.317+0000 7f43e7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e81019c0 0x7f43e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.317+0000 7f43e7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e81019c0 0x7f43e80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60054/0 (socket says 172.21.15.62:60054) 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.318+0000 7f43e7400640 1 -- 172.21.15.62:0/24784218 learned_addr learned my addr 172.21.15.62:0/24784218 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.318+0000 7f43e6a00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43e8102360 0x7f43e8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.318+0000 7f43e7e00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e81079c0 0x7f43e8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.318+0000 7f43e7400640 1 -- 172.21.15.62:0/24784218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43e8102360 msgr2=0x7f43e8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.318+0000 7f43e7400640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43e8102360 0x7f43e8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.318+0000 7f43e7400640 1 -- 172.21.15.62:0/24784218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e81079c0 msgr2=0x7f43e8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.318+0000 7f43e7400640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e81079c0 0x7f43e8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.318+0000 7f43e7400640 1 -- 172.21.15.62:0/24784218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e81a6760 con 0x7f43e81019c0 2024-09-12T01:58:07.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.318+0000 7f43e6a00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43e8102360 0x7f43e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:07.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.318+0000 7f43e7400640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e81019c0 0x7f43e80744f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009230 tx=0x7f43d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.319+0000 7f43dfe00640 1 -- 172.21.15.62:0/24784218 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d803f030 con 0x7f43e81019c0 2024-09-12T01:58:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.319+0000 7f43dfe00640 1 -- 172.21.15.62:0/24784218 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d8003ad0 con 0x7f43e81019c0 2024-09-12T01:58:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.319+0000 7f43ecc00640 1 -- 172.21.15.62:0/24784218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e81a69f0 con 0x7f43e81019c0 2024-09-12T01:58:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.319+0000 7f43dfe00640 1 -- 172.21.15.62:0/24784218 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8035070 con 0x7f43e81019c0 2024-09-12T01:58:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.319+0000 7f43ecc00640 1 -- 172.21.15.62:0/24784218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e81a6f20 con 0x7f43e81019c0 2024-09-12T01:58:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.320+0000 7f43ecc00640 1 -- 172.21.15.62:0/24784218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e8101e20 con 0x7f43e81019c0 2024-09-12T01:58:07.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.322+0000 7f43dfe00640 1 -- 172.21.15.62:0/24784218 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f43d8042030 con 0x7f43e81019c0 2024-09-12T01:58:07.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.323+0000 7f43dfe00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f43cc0a2c90 0x7f43cc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.323+0000 7f43dfe00640 1 -- 172.21.15.62:0/24784218 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f43d80ef5d0 con 0x7f43e81019c0 2024-09-12T01:58:07.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.323+0000 7f43e6a00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f43cc0a2c90 0x7f43cc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.324+0000 7f43e6a00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f43cc0a2c90 0x7f43cc0a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f43e8075f80 tx=0x7f43d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.327+0000 7f43dfe00640 1 -- 172.21.15.62:0/24784218 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43d80bb9c0 con 0x7f43e81019c0 2024-09-12T01:58:07.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.514+0000 7f43ecc00640 1 -- 172.21.15.62:0/24784218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f43e81099a0 con 0x7f43e81019c0 2024-09-12T01:58:07.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.514+0000 7f43dfe00640 1 -- 172.21.15.62:0/24784218 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f43d80bfcc0 con 0x7f43e81019c0 2024-09-12T01:58:07.514 INFO:teuthology.orchestra.run.smithi062.stdout:244813135917 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.516+0000 7f43ecc00640 1 -- 172.21.15.62:0/24784218 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f43cc0a2c90 msgr2=0x7f43cc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.516+0000 7f43ecc00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f43cc0a2c90 0x7f43cc0a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f43e8075f80 tx=0x7f43d400b410 comp rx=0 tx=0).stop 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.517+0000 7f43ecc00640 1 -- 172.21.15.62:0/24784218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e81019c0 msgr2=0x7f43e80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.517+0000 7f43ecc00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e81019c0 0x7f43e80744f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009230 tx=0x7f43d8004270 comp rx=0 tx=0).stop 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.517+0000 7f43ecc00640 1 -- 172.21.15.62:0/24784218 shutdown_connections 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.517+0000 7f43ecc00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f43cc0a2c90 0x7f43cc0a5150 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.517+0000 7f43ecc00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e81079c0 0x7f43e8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.517+0000 7f43ecc00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43e8102360 0x7f43e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.517+0000 7f43ecc00640 1 --2- 172.21.15.62:0/24784218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43e81019c0 0x7f43e80744f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.517+0000 7f43ecc00640 1 -- 172.21.15.62:0/24784218 >> 172.21.15.62:0/24784218 conn(0x7f43e80fd740 msgr2=0x7f43e80ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.517+0000 7f43ecc00640 1 -- 172.21.15.62:0/24784218 shutdown_connections 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:07.517+0000 7f43ecc00640 1 -- 172.21.15.62:0/24784218 wait complete. 2024-09-12T01:58:07.571 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:07 smithi062 ceph-mon[30666]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:07.755 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:07 smithi107 ceph-mon[35463]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:07.766 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:07 smithi077 ceph-mon[35095]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:08.129 INFO:teuthology.orchestra.run.smithi062.stdout:214748364851 2024-09-12T01:58:08.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T01:58:08.609 INFO:teuthology.orchestra.run.smithi062.stdout:111669149768 2024-09-12T01:58:08.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T01:58:08.730 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:08 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/24784218' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:58:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.849+0000 7f674d000640 1 -- 172.21.15.62:0/1313188835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67481019c0 msgr2=0x7f6748101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.849+0000 7f674d000640 1 --2- 172.21.15.62:0/1313188835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67481019c0 0x7f6748101e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6734009930 tx=0x7f673402a420 comp rx=0 tx=0).stop 2024-09-12T01:58:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.849+0000 7f674d000640 1 -- 172.21.15.62:0/1313188835 shutdown_connections 2024-09-12T01:58:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.849+0000 7f674d000640 1 --2- 172.21.15.62:0/1313188835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6748102360 0x7f674810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.849+0000 7f674d000640 1 --2- 172.21.15.62:0/1313188835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67481019c0 0x7f6748101e20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:08.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.849+0000 7f674d000640 1 --2- 172.21.15.62:0/1313188835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67481079c0 0x7f6748107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:08.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.849+0000 7f674d000640 1 -- 172.21.15.62:0/1313188835 >> 172.21.15.62:0/1313188835 conn(0x7f67480fd740 msgr2=0x7f67480ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:08.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.849+0000 7f674d000640 1 -- 172.21.15.62:0/1313188835 shutdown_connections 2024-09-12T01:58:08.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.849+0000 7f674d000640 1 -- 172.21.15.62:0/1313188835 wait complete. 2024-09-12T01:58:08.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.851+0000 7f674d000640 1 Processor -- start 2024-09-12T01:58:08.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.851+0000 7f674d000640 1 -- start start 2024-09-12T01:58:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.851+0000 7f674d000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67481019c0 0x7f6748198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.851+0000 7f674d000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6748102360 0x7f6748198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.851+0000 7f674d000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67481079c0 0x7f674819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.851+0000 7f674d000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6748111e10 con 0x7f67481079c0 2024-09-12T01:58:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.851+0000 7f674d000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6748111c90 con 0x7f6748102360 2024-09-12T01:58:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.851+0000 7f674d000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6748111f90 con 0x7f67481019c0 2024-09-12T01:58:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6747400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67481019c0 0x7f6748198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6747400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67481019c0 0x7f6748198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:41284/0 (socket says 172.21.15.62:41284) 2024-09-12T01:58:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6747400640 1 -- 172.21.15.62:0/417945032 learned_addr learned my addr 172.21.15.62:0/417945032 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6746a00640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6748102360 0x7f6748198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6747e00640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67481079c0 0x7f674819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6747400640 1 -- 172.21.15.62:0/417945032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6748102360 msgr2=0x7f6748198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6747400640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6748102360 0x7f6748198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6747400640 1 -- 172.21.15.62:0/417945032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67481079c0 msgr2=0x7f674819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6747400640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67481079c0 0x7f674819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6747400640 1 -- 172.21.15.62:0/417945032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674819d2c0 con 0x7f67481019c0 2024-09-12T01:58:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.852+0000 7f6746a00640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6748102360 0x7f6748198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.853+0000 7f6747400640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67481019c0 0x7f6748198310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f673800e9f0 tx=0x7f673800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.853+0000 7f673fe00640 1 -- 172.21.15.62:0/417945032 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673800cd80 con 0x7f67481019c0 2024-09-12T01:58:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.853+0000 7f674d000640 1 -- 172.21.15.62:0/417945032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674819d5b0 con 0x7f67481019c0 2024-09-12T01:58:08.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.853+0000 7f673fe00640 1 -- 172.21.15.62:0/417945032 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6738005500 con 0x7f67481019c0 2024-09-12T01:58:08.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.853+0000 7f673fe00640 1 -- 172.21.15.62:0/417945032 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738010690 con 0x7f67481019c0 2024-09-12T01:58:08.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.853+0000 7f674d000640 1 -- 172.21.15.62:0/417945032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67481a4e90 con 0x7f67481019c0 2024-09-12T01:58:08.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.855+0000 7f674d000640 1 -- 172.21.15.62:0/417945032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6748101e20 con 0x7f67481019c0 2024-09-12T01:58:08.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.856+0000 7f673fe00640 1 -- 172.21.15.62:0/417945032 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f67380046c0 con 0x7f67481019c0 2024-09-12T01:58:08.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.858+0000 7f673fe00640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f672c0a2c10 0x7f672c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:08.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.858+0000 7f673fe00640 1 -- 172.21.15.62:0/417945032 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f67380cf930 con 0x7f67481019c0 2024-09-12T01:58:08.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.858+0000 7f6746a00640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f672c0a2c10 0x7f672c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:08.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.859+0000 7f6746a00640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f672c0a2c10 0x7f672c0a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6734006010 tx=0x7f6734031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:08.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:08.862+0000 7f673fe00640 1 -- 172.21.15.62:0/417945032 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f673809c370 con 0x7f67481019c0 2024-09-12T01:58:08.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:08 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/24784218' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:58:08.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:08 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/24784218' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:58:09.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.064+0000 7f674d000640 1 -- 172.21.15.62:0/417945032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6748109f30 con 0x7f67481019c0 2024-09-12T01:58:09.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.065+0000 7f673fe00640 1 -- 172.21.15.62:0/417945032 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f673809bc70 con 0x7f67481019c0 2024-09-12T01:58:09.064 INFO:teuthology.orchestra.run.smithi062.stdout:77309411407 2024-09-12T01:58:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 -- 172.21.15.62:0/417945032 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f672c0a2c10 msgr2=0x7f672c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f672c0a2c10 0x7f672c0a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6734006010 tx=0x7f6734031510 comp rx=0 tx=0).stop 2024-09-12T01:58:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 -- 172.21.15.62:0/417945032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67481019c0 msgr2=0x7f6748198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67481019c0 0x7f6748198310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f673800e9f0 tx=0x7f673800edf0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 -- 172.21.15.62:0/417945032 shutdown_connections 2024-09-12T01:58:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f672c0a2c10 0x7f672c0a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67481079c0 0x7f674819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6748102360 0x7f6748198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 --2- 172.21.15.62:0/417945032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67481019c0 0x7f6748198310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:09.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 -- 172.21.15.62:0/417945032 >> 172.21.15.62:0/417945032 conn(0x7f67480fd740 msgr2=0x7f67480fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:09.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.067+0000 7f674d000640 1 -- 172.21.15.62:0/417945032 shutdown_connections 2024-09-12T01:58:09.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:09.068+0000 7f674d000640 1 -- 172.21.15.62:0/417945032 wait complete. 2024-09-12T01:58:09.586 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135915 got 244813135917 for osd.8 2024-09-12T01:58:09.586 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:09.782 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:09 smithi062 ceph-mon[30666]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:09.782 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:09 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/417945032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:58:09.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:09 smithi107 ceph-mon[35463]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:09.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:09 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/417945032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:58:09.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:09 smithi077 ceph-mon[35095]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:09.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:09 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/417945032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:58:10.086 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411405 got 77309411407 for osd.2 2024-09-12T01:58:10.087 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:296352743459 2024-09-12T01:58:10.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T01:58:10.745 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:10.754 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:10.795 INFO:teuthology.orchestra.run.smithi062.stdout:141733920836 2024-09-12T01:58:10.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T01:58:11.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.491+0000 7ff45ca00640 1 -- 172.21.15.62:0/3405756429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff458074e30 msgr2=0x7ff45810dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.491+0000 7ff45ca00640 1 --2- 172.21.15.62:0/3405756429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff458074e30 0x7ff45810dd40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff440009900 tx=0x7ff44002a480 comp rx=0 tx=0).stop 2024-09-12T01:58:11.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.491+0000 7ff45ca00640 1 -- 172.21.15.62:0/3405756429 shutdown_connections 2024-09-12T01:58:11.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.491+0000 7ff45ca00640 1 --2- 172.21.15.62:0/3405756429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff45810e280 0x7ff458110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.491+0000 7ff45ca00640 1 --2- 172.21.15.62:0/3405756429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff458074e30 0x7ff45810dd40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.491+0000 7ff45ca00640 1 --2- 172.21.15.62:0/3405756429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff458074510 0x7ff4580748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.491+0000 7ff45ca00640 1 -- 172.21.15.62:0/3405756429 >> 172.21.15.62:0/3405756429 conn(0x7ff4580fd740 msgr2=0x7ff4580ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.491+0000 7ff45ca00640 1 -- 172.21.15.62:0/3405756429 shutdown_connections 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.491+0000 7ff45ca00640 1 -- 172.21.15.62:0/3405756429 wait complete. 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.492+0000 7ff45ca00640 1 Processor -- start 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.492+0000 7ff45ca00640 1 -- start start 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.492+0000 7ff45ca00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff458074510 0x7ff45819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.492+0000 7ff45ca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff458074e30 0x7ff45819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.492+0000 7ff45ca00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff45810e280 0x7ff45819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.492+0000 7ff45ca00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff458113f70 con 0x7ff458074510 2024-09-12T01:58:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.492+0000 7ff45ca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff458113df0 con 0x7ff458074e30 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.492+0000 7ff45ca00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff4581140f0 con 0x7ff45810e280 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff456800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff458074510 0x7ff45819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff456800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff458074510 0x7ff45819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60102/0 (socket says 172.21.15.62:60102) 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff456800640 1 -- 172.21.15.62:0/1257426505 learned_addr learned my addr 172.21.15.62:0/1257426505 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff44de00640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff458074e30 0x7ff45819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff457200640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff45810e280 0x7ff45819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff456800640 1 -- 172.21.15.62:0/1257426505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff45810e280 msgr2=0x7ff45819eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff456800640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff45810e280 0x7ff45819eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff456800640 1 -- 172.21.15.62:0/1257426505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff458074e30 msgr2=0x7ff45819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff456800640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff458074e30 0x7ff45819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff456800640 1 -- 172.21.15.62:0/1257426505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45819f480 con 0x7ff458074510 2024-09-12T01:58:11.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff457200640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff45810e280 0x7ff45819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.493+0000 7ff456800640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff458074510 0x7ff45819a4d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff448009d50 tx=0x7ff44800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.494+0000 7ff44fe00640 1 -- 172.21.15.62:0/1257426505 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448003b70 con 0x7ff458074510 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.494+0000 7ff45ca00640 1 -- 172.21.15.62:0/1257426505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45819f770 con 0x7ff458074510 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.494+0000 7ff44fe00640 1 -- 172.21.15.62:0/1257426505 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff448003d10 con 0x7ff458074510 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.494+0000 7ff44fe00640 1 -- 172.21.15.62:0/1257426505 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448010a20 con 0x7ff458074510 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.494+0000 7ff45ca00640 1 -- 172.21.15.62:0/1257426505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4581a7050 con 0x7ff458074510 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.495+0000 7ff45ca00640 1 -- 172.21.15.62:0/1257426505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4580748f0 con 0x7ff458074510 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.497+0000 7ff44fe00640 1 -- 172.21.15.62:0/1257426505 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff448003ec0 con 0x7ff458074510 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.498+0000 7ff44fe00640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff43c0a2c10 0x7ff43c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.498+0000 7ff44fe00640 1 -- 172.21.15.62:0/1257426505 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7ff4480cfcf0 con 0x7ff458074510 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.498+0000 7ff44de00640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff43c0a2c10 0x7ff43c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.499+0000 7ff44de00640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff43c0a2c10 0x7ff43c0a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff440009230 tx=0x7ff4400058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:11.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.502+0000 7ff44fe00640 1 -- 172.21.15.62:0/1257426505 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff44809c730 con 0x7ff458074510 2024-09-12T01:58:11.661 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:11 smithi062 ceph-mon[30666]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:11.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.693+0000 7ff45ca00640 1 -- 172.21.15.62:0/1257426505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff45819b830 con 0x7ff458074510 2024-09-12T01:58:11.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.693+0000 7ff44fe00640 1 -- 172.21.15.62:0/1257426505 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff44809c030 con 0x7ff458074510 2024-09-12T01:58:11.693 INFO:teuthology.orchestra.run.smithi062.stdout:193273528379 2024-09-12T01:58:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 -- 172.21.15.62:0/1257426505 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff43c0a2c10 msgr2=0x7ff43c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff43c0a2c10 0x7ff43c0a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff440009230 tx=0x7ff4400058d0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 -- 172.21.15.62:0/1257426505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff458074510 msgr2=0x7ff45819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff458074510 0x7ff45819a4d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff448009d50 tx=0x7ff44800c6a0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 -- 172.21.15.62:0/1257426505 shutdown_connections 2024-09-12T01:58:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff43c0a2c10 0x7ff43c0a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff45810e280 0x7ff45819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff458074e30 0x7ff45819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 --2- 172.21.15.62:0/1257426505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff458074510 0x7ff45819a4d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 -- 172.21.15.62:0/1257426505 >> 172.21.15.62:0/1257426505 conn(0x7ff4580fd740 msgr2=0x7ff4580fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 -- 172.21.15.62:0/1257426505 shutdown_connections 2024-09-12T01:58:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:11.696+0000 7ff45ca00640 1 -- 172.21.15.62:0/1257426505 wait complete. 2024-09-12T01:58:11.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:11 smithi107 ceph-mon[35463]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:11.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:11 smithi077 ceph-mon[35095]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:12.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.187+0000 7fb699200640 1 -- 172.21.15.62:0/3746977677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb694102360 msgr2=0x7fb69410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.187+0000 7fb699200640 1 --2- 172.21.15.62:0/3746977677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb694102360 0x7fb69410e890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009cd0 tx=0x7fb68c02a8f0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.187+0000 7fb699200640 1 -- 172.21.15.62:0/3746977677 shutdown_connections 2024-09-12T01:58:12.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.187+0000 7fb699200640 1 --2- 172.21.15.62:0/3746977677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb694102360 0x7fb69410e890 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.187+0000 7fb699200640 1 --2- 172.21.15.62:0/3746977677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6941019c0 0x7fb694101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.187+0000 7fb699200640 1 --2- 172.21.15.62:0/3746977677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6941079c0 0x7fb694107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.187+0000 7fb699200640 1 -- 172.21.15.62:0/3746977677 >> 172.21.15.62:0/3746977677 conn(0x7fb6940fd740 msgr2=0x7fb6940ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:12.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.187+0000 7fb699200640 1 -- 172.21.15.62:0/3746977677 shutdown_connections 2024-09-12T01:58:12.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.187+0000 7fb699200640 1 -- 172.21.15.62:0/3746977677 wait complete. 2024-09-12T01:58:12.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.189+0000 7fb699200640 1 Processor -- start 2024-09-12T01:58:12.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.189+0000 7fb699200640 1 -- start start 2024-09-12T01:58:12.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.189+0000 7fb699200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6941019c0 0x7fb6940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.190+0000 7fb699200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb694102360 0x7fb694074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.190+0000 7fb699200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6941079c0 0x7fb694074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.190+0000 7fb699200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb694111dc0 con 0x7fb6941019c0 2024-09-12T01:58:12.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.190+0000 7fb699200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb694111c40 con 0x7fb694102360 2024-09-12T01:58:12.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.190+0000 7fb699200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb694111f40 con 0x7fb6941079c0 2024-09-12T01:58:12.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.190+0000 7fb692a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb694102360 0x7fb694074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.190+0000 7fb692a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb694102360 0x7fb694074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:40146/0 (socket says 172.21.15.62:40146) 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.190+0000 7fb692a00640 1 -- 172.21.15.62:0/1332226228 learned_addr learned my addr 172.21.15.62:0/1332226228 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.190+0000 7fb693e00640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6941079c0 0x7fb694074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.190+0000 7fb693400640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6941019c0 0x7fb6940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.191+0000 7fb693e00640 1 -- 172.21.15.62:0/1332226228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb694102360 msgr2=0x7fb694074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.191+0000 7fb693e00640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb694102360 0x7fb694074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.191+0000 7fb693e00640 1 -- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6941019c0 msgr2=0x7fb6940744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.191+0000 7fb693e00640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6941019c0 0x7fb6940744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.191+0000 7fb693e00640 1 -- 172.21.15.62:0/1332226228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6941a6730 con 0x7fb6941079c0 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.191+0000 7fb693400640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6941019c0 0x7fb6940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:12.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.191+0000 7fb693e00640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6941079c0 0x7fb694074f70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb68c02ae10 tx=0x7fb68c030ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.192+0000 7fb68be00640 1 -- 172.21.15.62:0/1332226228 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c003d80 con 0x7fb6941079c0 2024-09-12T01:58:12.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.192+0000 7fb68be00640 1 -- 172.21.15.62:0/1332226228 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb68c040070 con 0x7fb6941079c0 2024-09-12T01:58:12.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.192+0000 7fb699200640 1 -- 172.21.15.62:0/1332226228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6941a69c0 con 0x7fb6941079c0 2024-09-12T01:58:12.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.192+0000 7fb699200640 1 -- 172.21.15.62:0/1332226228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6941a6f50 con 0x7fb6941079c0 2024-09-12T01:58:12.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.192+0000 7fb68be00640 1 -- 172.21.15.62:0/1332226228 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c045ad0 con 0x7fb6941079c0 2024-09-12T01:58:12.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.194+0000 7fb699200640 1 -- 172.21.15.62:0/1332226228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb674005290 con 0x7fb6941079c0 2024-09-12T01:58:12.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.197+0000 7fb68be00640 1 -- 172.21.15.62:0/1332226228 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb68c004040 con 0x7fb6941079c0 2024-09-12T01:58:12.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.200+0000 7fb68be00640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb6780a2c90 0x7fb6780a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:12.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.200+0000 7fb68be00640 1 -- 172.21.15.62:0/1332226228 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb68c0f08b0 con 0x7fb6941079c0 2024-09-12T01:58:12.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.200+0000 7fb68be00640 1 -- 172.21.15.62:0/1332226228 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb68c04a060 con 0x7fb6941079c0 2024-09-12T01:58:12.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.200+0000 7fb693400640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb6780a2c90 0x7fb6780a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:12.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.201+0000 7fb693400640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb6780a2c90 0x7fb6780a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb684009ad0 tx=0x7fb684005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:12.207 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:12.344 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:12.348 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:12.348 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:12.348 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:12.349 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:12.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.432+0000 7fb699200640 1 -- 172.21.15.62:0/1332226228 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb674005850 con 0x7fb6941079c0 2024-09-12T01:58:12.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.433+0000 7fb68be00640 1 -- 172.21.15.62:0/1332226228 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb68c0bd400 con 0x7fb6941079c0 2024-09-12T01:58:12.433 INFO:teuthology.orchestra.run.smithi062.stdout:55834574932 2024-09-12T01:58:12.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 -- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb6780a2c90 msgr2=0x7fb6780a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb6780a2c90 0x7fb6780a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb684009ad0 tx=0x7fb684005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:12.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 -- 172.21.15.62:0/1332226228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6941079c0 msgr2=0x7fb694074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:12.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6941079c0 0x7fb694074f70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb68c02ae10 tx=0x7fb68c030ed0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 -- 172.21.15.62:0/1332226228 shutdown_connections 2024-09-12T01:58:12.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb6780a2c90 0x7fb6780a5150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6941079c0 0x7fb694074f70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb694102360 0x7fb694074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 --2- 172.21.15.62:0/1332226228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6941019c0 0x7fb6940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:12.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 -- 172.21.15.62:0/1332226228 >> 172.21.15.62:0/1332226228 conn(0x7fb6940fd740 msgr2=0x7fb6940fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:12.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.435+0000 7fb699200640 1 -- 172.21.15.62:0/1332226228 shutdown_connections 2024-09-12T01:58:12.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:12.436+0000 7fb699200640 1 -- 172.21.15.62:0/1332226228 wait complete. 2024-09-12T01:58:12.763 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:12 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1257426505' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:58:12.763 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:12 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1332226228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:58:12.779 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:12.812 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528376 got 193273528379 for osd.6 2024-09-12T01:58:12.812 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:12.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:12 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1257426505' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:58:12.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:12 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1332226228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:58:12.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:12 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1257426505' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:58:12.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:12 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1332226228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:58:13.553 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574930 got 55834574932 for osd.1 2024-09-12T01:58:13.553 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:13.762 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:13 smithi062 ceph-mon[30666]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:13.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:13 smithi107 ceph-mon[35463]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:13.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:13 smithi077 ceph-mon[35095]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.275+0000 7fb637200640 1 -- 172.21.15.62:0/3878814941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6381019d0 msgr2=0x7fb638101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.275+0000 7fb637200640 1 --2- 172.21.15.62:0/3878814941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6381019d0 0x7fb638101e30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb624009930 tx=0x7fb62402a420 comp rx=0 tx=0).stop 2024-09-12T01:58:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.275+0000 7fb637200640 1 -- 172.21.15.62:0/3878814941 shutdown_connections 2024-09-12T01:58:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.275+0000 7fb637200640 1 --2- 172.21.15.62:0/3878814941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb638102370 0x7fb63810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.275+0000 7fb637200640 1 --2- 172.21.15.62:0/3878814941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6381019d0 0x7fb638101e30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.275+0000 7fb637200640 1 --2- 172.21.15.62:0/3878814941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6381079d0 0x7fb638107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.275+0000 7fb637200640 1 -- 172.21.15.62:0/3878814941 >> 172.21.15.62:0/3878814941 conn(0x7fb6380fd710 msgr2=0x7fb6380ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.275+0000 7fb637200640 1 -- 172.21.15.62:0/3878814941 shutdown_connections 2024-09-12T01:58:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.275+0000 7fb637200640 1 -- 172.21.15.62:0/3878814941 wait complete. 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.276+0000 7fb637200640 1 Processor -- start 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.277+0000 7fb637200640 1 -- start start 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.277+0000 7fb637200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6381019d0 0x7fb63819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.277+0000 7fb637200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb638102370 0x7fb63819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.277+0000 7fb637200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6381079d0 0x7fb63819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.277+0000 7fb637200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb638111d90 con 0x7fb6381079d0 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.277+0000 7fb637200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb638111c10 con 0x7fb6381019d0 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.277+0000 7fb637200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb638111f10 con 0x7fb638102370 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6381019d0 0x7fb63819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb638102370 0x7fb63819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:14.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb636800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6381079d0 0x7fb63819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb638102370 0x7fb63819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:54700/0 (socket says 172.21.15.62:54700) 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6381019d0 0x7fb63819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:40164/0 (socket says 172.21.15.62:40164) 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb636800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6381079d0 0x7fb63819ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47282/0 (socket says 172.21.15.62:47282) 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635400640 1 -- 172.21.15.62:0/1397451978 learned_addr learned my addr 172.21.15.62:0/1397451978 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635400640 1 -- 172.21.15.62:0/1397451978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6381019d0 msgr2=0x7fb63819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635400640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6381019d0 0x7fb63819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635400640 1 -- 172.21.15.62:0/1397451978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6381079d0 msgr2=0x7fb63819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635400640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6381079d0 0x7fb63819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635400640 1 -- 172.21.15.62:0/1397451978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63819f440 con 0x7fb638102370 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635e00640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6381019d0 0x7fb63819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:14.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb636800640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6381079d0 0x7fb63819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.278+0000 7fb635400640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb638102370 0x7fb63819a9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb624009230 tx=0x7fb624004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.279+0000 7fb62ea00640 1 -- 172.21.15.62:0/1397451978 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62403f030 con 0x7fb638102370 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.279+0000 7fb637200640 1 -- 172.21.15.62:0/1397451978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63819f6d0 con 0x7fb638102370 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.279+0000 7fb62ea00640 1 -- 172.21.15.62:0/1397451978 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb624004440 con 0x7fb638102370 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.279+0000 7fb62ea00640 1 -- 172.21.15.62:0/1397451978 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624035070 con 0x7fb638102370 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.279+0000 7fb637200640 1 -- 172.21.15.62:0/1397451978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6381a7010 con 0x7fb638102370 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.280+0000 7fb637200640 1 -- 172.21.15.62:0/1397451978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb638101e30 con 0x7fb638102370 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.282+0000 7fb62ea00640 1 -- 172.21.15.62:0/1397451978 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb624042030 con 0x7fb638102370 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.283+0000 7fb62ea00640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb61c0a2c10 0x7fb61c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.283+0000 7fb62ea00640 1 -- 172.21.15.62:0/1397451978 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb6240ef8e0 con 0x7fb638102370 2024-09-12T01:58:14.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.284+0000 7fb635e00640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb61c0a2c10 0x7fb61c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.284+0000 7fb635e00640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb61c0a2c10 0x7fb61c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb628009f40 tx=0x7fb628005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:14.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.286+0000 7fb62ea00640 1 -- 172.21.15.62:0/1397451978 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6240bbcd0 con 0x7fb638102370 2024-09-12T01:58:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.471+0000 7fb637200640 1 -- 172.21.15.62:0/1397451978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fb6381a7210 con 0x7fb638102370 2024-09-12T01:58:14.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.472+0000 7fb62ea00640 1 -- 172.21.15.62:0/1397451978 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fb6240bffd0 con 0x7fb638102370 2024-09-12T01:58:14.473 INFO:teuthology.orchestra.run.smithi062.stdout:326417514528 2024-09-12T01:58:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.474+0000 7fb637200640 1 -- 172.21.15.62:0/1397451978 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb61c0a2c10 msgr2=0x7fb61c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.474+0000 7fb637200640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb61c0a2c10 0x7fb61c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb628009f40 tx=0x7fb628005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.474+0000 7fb637200640 1 -- 172.21.15.62:0/1397451978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb638102370 msgr2=0x7fb63819a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.474+0000 7fb637200640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb638102370 0x7fb63819a9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb624009230 tx=0x7fb624004040 comp rx=0 tx=0).stop 2024-09-12T01:58:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.475+0000 7fb637200640 1 -- 172.21.15.62:0/1397451978 shutdown_connections 2024-09-12T01:58:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.475+0000 7fb637200640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fb61c0a2c10 0x7fb61c0a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.475+0000 7fb637200640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6381079d0 0x7fb63819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.475+0000 7fb637200640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb638102370 0x7fb63819a9d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.475+0000 7fb637200640 1 --2- 172.21.15.62:0/1397451978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6381019d0 0x7fb63819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.475+0000 7fb637200640 1 -- 172.21.15.62:0/1397451978 >> 172.21.15.62:0/1397451978 conn(0x7fb6380fd710 msgr2=0x7fb63810d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.475+0000 7fb637200640 1 -- 172.21.15.62:0/1397451978 shutdown_connections 2024-09-12T01:58:14.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:14.475+0000 7fb637200640 1 -- 172.21.15.62:0/1397451978 wait complete. 2024-09-12T01:58:14.834 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:14 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1397451978' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:58:14.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:14 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1397451978' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:58:14.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:14 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1397451978' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:58:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.425+0000 7f9b31400640 1 -- 172.21.15.62:0/2186762620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b2c102b90 msgr2=0x7f9b2c102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.425+0000 7f9b31400640 1 --2- 172.21.15.62:0/2186762620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b2c102b90 0x7f9b2c102f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009900 tx=0x7f9b1c02a480 comp rx=0 tx=0).stop 2024-09-12T01:58:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.425+0000 7f9b31400640 1 -- 172.21.15.62:0/2186762620 shutdown_connections 2024-09-12T01:58:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.425+0000 7f9b31400640 1 --2- 172.21.15.62:0/2186762620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b2c10bfc0 0x7f9b2c10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.425+0000 7f9b31400640 1 --2- 172.21.15.62:0/2186762620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b2c1034b0 0x7f9b2c10b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.425+0000 7f9b31400640 1 --2- 172.21.15.62:0/2186762620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b2c102b90 0x7f9b2c102f70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.425+0000 7f9b31400640 1 -- 172.21.15.62:0/2186762620 >> 172.21.15.62:0/2186762620 conn(0x7f9b2c0fc610 msgr2=0x7f9b2c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.425+0000 7f9b31400640 1 -- 172.21.15.62:0/2186762620 shutdown_connections 2024-09-12T01:58:15.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.425+0000 7f9b31400640 1 -- 172.21.15.62:0/2186762620 wait complete. 2024-09-12T01:58:15.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.426+0000 7f9b31400640 1 Processor -- start 2024-09-12T01:58:15.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.426+0000 7f9b31400640 1 -- start start 2024-09-12T01:58:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.426+0000 7f9b31400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b2c102b90 0x7f9b2c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b31400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b2c1034b0 0x7f9b2c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b31400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b2c10bfc0 0x7f9b2c19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b31400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c111dc0 con 0x7f9b2c1034b0 2024-09-12T01:58:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b31400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c111c40 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b31400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c111f40 con 0x7f9b2c102b90 2024-09-12T01:58:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b2be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b2c102b90 0x7f9b2c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b2be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b2c102b90 0x7f9b2c19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:54750/0 (socket says 172.21.15.62:54750) 2024-09-12T01:58:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b2be00640 1 -- 172.21.15.62:0/2304588349 learned_addr learned my addr 172.21.15.62:0/2304588349 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b2b400640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b2c1034b0 0x7f9b2c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b30a00640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b2c10bfc0 0x7f9b2c19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b30a00640 1 -- 172.21.15.62:0/2304588349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b2c102b90 msgr2=0x7f9b2c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b30a00640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b2c102b90 0x7f9b2c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b30a00640 1 -- 172.21.15.62:0/2304588349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b2c1034b0 msgr2=0x7f9b2c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b30a00640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b2c1034b0 0x7f9b2c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.427+0000 7f9b30a00640 1 -- 172.21.15.62:0/2304588349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c19f490 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.428+0000 7f9b30a00640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b2c10bfc0 0x7f9b2c19edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9b24009fd0 tx=0x7f9b2400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.428+0000 7f9b28c00640 1 -- 172.21.15.62:0/2304588349 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2400ce20 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.428+0000 7f9b28c00640 1 -- 172.21.15.62:0/2304588349 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b24005020 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.428+0000 7f9b31400640 1 -- 172.21.15.62:0/2304588349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2c19f780 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.428+0000 7f9b28c00640 1 -- 172.21.15.62:0/2304588349 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24010720 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.428+0000 7f9b31400640 1 -- 172.21.15.62:0/2304588349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2c1a7060 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.430+0000 7f9b31400640 1 -- 172.21.15.62:0/2304588349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2c102f70 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.431+0000 7f9b28c00640 1 -- 172.21.15.62:0/2304588349 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9b24005540 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.434+0000 7f9b28c00640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9b100a2c90 0x7f9b100a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.434+0000 7f9b28c00640 1 -- 172.21.15.62:0/2304588349 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f9b240cf780 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.434+0000 7f9b2be00640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9b100a2c90 0x7f9b100a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.435+0000 7f9b2be00640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9b100a2c90 0x7f9b100a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0096c0 tx=0x7f9b1c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.437+0000 7f9b28c00640 1 -- 172.21.15.62:0/2304588349 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b2409c1c0 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.344+0000 7ffa89e00640 1 -- 172.21.15.62:0/1733275768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa8410e430 msgr2=0x7ffa84110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.344+0000 7ffa89e00640 1 --2- 172.21.15.62:0/1733275768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa8410e430 0x7ffa84110820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009ca0 tx=0x7ffa7c02a950 comp rx=0 tx=0).stop 2024-09-12T01:58:15.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.344+0000 7ffa89e00640 1 -- 172.21.15.62:0/1733275768 shutdown_connections 2024-09-12T01:58:15.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.345+0000 7ffa89e00640 1 --2- 172.21.15.62:0/1733275768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa8410e430 0x7ffa84110820 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.345+0000 7ffa89e00640 1 --2- 172.21.15.62:0/1733275768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa84074ee0 0x7ffa8410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.345+0000 7ffa89e00640 1 --2- 172.21.15.62:0/1733275768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa840745c0 0x7ffa840749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.345+0000 7ffa89e00640 1 -- 172.21.15.62:0/1733275768 >> 172.21.15.62:0/1733275768 conn(0x7ffa840fd8b0 msgr2=0x7ffa840ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.345+0000 7ffa89e00640 1 -- 172.21.15.62:0/1733275768 shutdown_connections 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.345+0000 7ffa89e00640 1 -- 172.21.15.62:0/1733275768 wait complete. 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.346+0000 7ffa89e00640 1 Processor -- start 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.346+0000 7ffa89e00640 1 -- start start 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa89e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa840745c0 0x7ffa8419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa89e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84074ee0 0x7ffa8419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa89e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa8410e430 0x7ffa8419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa89e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffa841141d0 con 0x7ffa84074ee0 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa89e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffa84114050 con 0x7ffa8410e430 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa89e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffa84114350 con 0x7ffa840745c0 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa82000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84074ee0 0x7ffa8419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa82000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84074ee0 0x7ffa8419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47300/0 (socket says 172.21.15.62:47300) 2024-09-12T01:58:15.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa82000640 1 -- 172.21.15.62:0/1780226431 learned_addr learned my addr 172.21.15.62:0/1780226431 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa82a00640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa840745c0 0x7ffa8419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa83400640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa8410e430 0x7ffa8419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa82000640 1 -- 172.21.15.62:0/1780226431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa840745c0 msgr2=0x7ffa8419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa82000640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa840745c0 0x7ffa8419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa82000640 1 -- 172.21.15.62:0/1780226431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa8410e430 msgr2=0x7ffa8419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa82000640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa8410e430 0x7ffa8419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.347+0000 7ffa82000640 1 -- 172.21.15.62:0/1780226431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8419f620 con 0x7ffa84074ee0 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.348+0000 7ffa82000640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84074ee0 0x7ffa8419abb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000e9f0 tx=0x7ffa7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.348+0000 7ffa88a00640 1 -- 172.21.15.62:0/1780226431 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7000cd80 con 0x7ffa84074ee0 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.348+0000 7ffa88a00640 1 -- 172.21.15.62:0/1780226431 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa70005500 con 0x7ffa84074ee0 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.348+0000 7ffa88a00640 1 -- 172.21.15.62:0/1780226431 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa70010690 con 0x7ffa84074ee0 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.348+0000 7ffa89e00640 1 -- 172.21.15.62:0/1780226431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8419f910 con 0x7ffa84074ee0 2024-09-12T01:58:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.348+0000 7ffa89e00640 1 -- 172.21.15.62:0/1780226431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa841a71f0 con 0x7ffa84074ee0 2024-09-12T01:58:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.349+0000 7ffa89e00640 1 -- 172.21.15.62:0/1780226431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa840749a0 con 0x7ffa84074ee0 2024-09-12T01:58:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.354+0000 7ffa88a00640 1 -- 172.21.15.62:0/1780226431 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffa700046c0 con 0x7ffa84074ee0 2024-09-12T01:58:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.355+0000 7ffa88a00640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa680a2c10 0x7ffa680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.356+0000 7ffa88a00640 1 -- 172.21.15.62:0/1780226431 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7ffa700cfb40 con 0x7ffa84074ee0 2024-09-12T01:58:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.356+0000 7ffa82a00640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa680a2c10 0x7ffa680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.357+0000 7ffa82a00640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa680a2c10 0x7ffa680a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009bd0 tx=0x7ffa74005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.358+0000 7ffa88a00640 1 -- 172.21.15.62:0/1780226431 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa7009c580 con 0x7ffa84074ee0 2024-09-12T01:58:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.552+0000 7ffa89e00640 1 -- 172.21.15.62:0/1780226431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ffa8419b9d0 con 0x7ffa84074ee0 2024-09-12T01:58:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.552+0000 7ffa88a00640 1 -- 172.21.15.62:0/1780226431 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ffa8419b9d0 con 0x7ffa84074ee0 2024-09-12T01:58:15.558 INFO:teuthology.orchestra.run.smithi062.stdout:274877906986 2024-09-12T01:58:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.554+0000 7ffa89e00640 1 -- 172.21.15.62:0/1780226431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa680a2c10 msgr2=0x7ffa680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.554+0000 7ffa89e00640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa680a2c10 0x7ffa680a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009bd0 tx=0x7ffa74005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.554+0000 7ffa89e00640 1 -- 172.21.15.62:0/1780226431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84074ee0 msgr2=0x7ffa8419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.554+0000 7ffa89e00640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84074ee0 0x7ffa8419abb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000e9f0 tx=0x7ffa7000edf0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.554+0000 7ffa89e00640 1 -- 172.21.15.62:0/1780226431 shutdown_connections 2024-09-12T01:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.555+0000 7ffa89e00640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ffa680a2c10 0x7ffa680a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.555+0000 7ffa89e00640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa8410e430 0x7ffa8419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.555+0000 7ffa89e00640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa84074ee0 0x7ffa8419abb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.555+0000 7ffa89e00640 1 --2- 172.21.15.62:0/1780226431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa840745c0 0x7ffa8419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.555+0000 7ffa89e00640 1 -- 172.21.15.62:0/1780226431 >> 172.21.15.62:0/1780226431 conn(0x7ffa840fd8b0 msgr2=0x7ffa840fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.555+0000 7ffa89e00640 1 -- 172.21.15.62:0/1780226431 shutdown_connections 2024-09-12T01:58:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.555+0000 7ffa89e00640 1 -- 172.21.15.62:0/1780226431 wait complete. 2024-09-12T01:58:15.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.633+0000 7f9b31400640 1 -- 172.21.15.62:0/2304588349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9b2c1a72c0 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.633+0000 7f9b28c00640 1 -- 172.21.15.62:0/2304588349 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9b2409bac0 con 0x7f9b2c10bfc0 2024-09-12T01:58:15.634 INFO:teuthology.orchestra.run.smithi062.stdout:214748364853 2024-09-12T01:58:15.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 -- 172.21.15.62:0/2304588349 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9b100a2c90 msgr2=0x7f9b100a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9b100a2c90 0x7f9b100a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0096c0 tx=0x7f9b1c005a20 comp rx=0 tx=0).stop 2024-09-12T01:58:15.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 -- 172.21.15.62:0/2304588349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b2c10bfc0 msgr2=0x7f9b2c19edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:15.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b2c10bfc0 0x7f9b2c19edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9b24009fd0 tx=0x7f9b2400ef10 comp rx=0 tx=0).stop 2024-09-12T01:58:15.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 -- 172.21.15.62:0/2304588349 shutdown_connections 2024-09-12T01:58:15.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9b100a2c90 0x7f9b100a5150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b2c10bfc0 0x7f9b2c19edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b2c1034b0 0x7f9b2c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 --2- 172.21.15.62:0/2304588349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b2c102b90 0x7f9b2c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:15.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 -- 172.21.15.62:0/2304588349 >> 172.21.15.62:0/2304588349 conn(0x7f9b2c0fc610 msgr2=0x7f9b2c10d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:15.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 -- 172.21.15.62:0/2304588349 shutdown_connections 2024-09-12T01:58:15.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:15.636+0000 7f9b31400640 1 -- 172.21.15.62:0/2304588349 wait complete. 2024-09-12T01:58:15.779 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:15 smithi062 ceph-mon[30666]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:15.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:15 smithi107 ceph-mon[35463]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:15.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:15 smithi077 ceph-mon[35095]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:16.450 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514526 got 326417514528 for osd.11 2024-09-12T01:58:16.450 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:16.712 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:16 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/1780226431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:58:16.712 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:16 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2304588349' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:58:16.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:16 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/1780226431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:58:16.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:16 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2304588349' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:58:16.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.894+0000 7fc1afe00640 1 -- 172.21.15.62:0/302397170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1b01010d0 msgr2=0x7fc1b010dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.894+0000 7fc1afe00640 1 --2- 172.21.15.62:0/302397170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1b01010d0 0x7fc1b010dd90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009900 tx=0x7fc19c02a410 comp rx=0 tx=0).stop 2024-09-12T01:58:16.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.894+0000 7fc1afe00640 1 -- 172.21.15.62:0/302397170 shutdown_connections 2024-09-12T01:58:16.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.894+0000 7fc1afe00640 1 --2- 172.21.15.62:0/302397170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b010e2d0 0x7fc1b01106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.894+0000 7fc1afe00640 1 --2- 172.21.15.62:0/302397170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1b01010d0 0x7fc1b010dd90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.894+0000 7fc1afe00640 1 --2- 172.21.15.62:0/302397170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1b0100720 0x7fc1b0100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.894+0000 7fc1afe00640 1 -- 172.21.15.62:0/302397170 >> 172.21.15.62:0/302397170 conn(0x7fc1b00fc610 msgr2=0x7fc1b00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.894+0000 7fc1afe00640 1 -- 172.21.15.62:0/302397170 shutdown_connections 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.894+0000 7fc1afe00640 1 -- 172.21.15.62:0/302397170 wait complete. 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.895+0000 7fc1afe00640 1 Processor -- start 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.895+0000 7fc1afe00640 1 -- start start 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1afe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b0100720 0x7fc1b019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1afe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1b01010d0 0x7fc1b019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1afe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1b010e2d0 0x7fc1b019ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1afe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b0114020 con 0x7fc1b010e2d0 2024-09-12T01:58:16.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1afe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b0113ea0 con 0x7fc1b0100720 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1afe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b01141a0 con 0x7fc1b01010d0 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1af400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1b010e2d0 0x7fc1b019ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1af400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1b010e2d0 0x7fc1b019ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47344/0 (socket says 172.21.15.62:47344) 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1af400640 1 -- 172.21.15.62:0/3344717795 learned_addr learned my addr 172.21.15.62:0/3344717795 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1ae000640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1b01010d0 0x7fc1b019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.896+0000 7fc1aea00640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b0100720 0x7fc1b019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1af400640 1 -- 172.21.15.62:0/3344717795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1b01010d0 msgr2=0x7fc1b019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1af400640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1b01010d0 0x7fc1b019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1af400640 1 -- 172.21.15.62:0/3344717795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b0100720 msgr2=0x7fc1b019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1af400640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b0100720 0x7fc1b019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1af400640 1 -- 172.21.15.62:0/3344717795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b019f4c0 con 0x7fc1b010e2d0 2024-09-12T01:58:16.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1af400640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1b010e2d0 0x7fc1b019ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800eb10 tx=0x7fc1a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1a7400640 1 -- 172.21.15.62:0/3344717795 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8004b20 con 0x7fc1b010e2d0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1a7400640 1 -- 172.21.15.62:0/3344717795 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a8004cc0 con 0x7fc1b010e2d0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1a7400640 1 -- 172.21.15.62:0/3344717795 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8010790 con 0x7fc1b010e2d0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1afe00640 1 -- 172.21.15.62:0/3344717795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b019f7b0 con 0x7fc1b010e2d0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.897+0000 7fc1afe00640 1 -- 172.21.15.62:0/3344717795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b01a7090 con 0x7fc1b010e2d0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.899+0000 7fc1afe00640 1 -- 172.21.15.62:0/3344717795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b0100b00 con 0x7fc1b010e2d0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.901+0000 7fc1a7400640 1 -- 172.21.15.62:0/3344717795 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc1a8010930 con 0x7fc1b010e2d0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.902+0000 7fc1a7400640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1940a2c90 0x7fc1940a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.902+0000 7fc1a7400640 1 -- 172.21.15.62:0/3344717795 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc1a80cfc50 con 0x7fc1b010e2d0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.902+0000 7fc1aea00640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1940a2c90 0x7fc1940a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.903+0000 7fc1aea00640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1940a2c90 0x7fc1940a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc1a00095f0 tx=0x7fc1a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.904+0000 7fc1a7400640 1 -- 172.21.15.62:0/3344717795 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1a809c690 con 0x7fc1b010e2d0 2024-09-12T01:58:16.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:16 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/1780226431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:58:16.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:16 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2304588349' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:58:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.095+0000 7fc1afe00640 1 -- 172.21.15.62:0/3344717795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fc1b019b870 con 0x7fc1b010e2d0 2024-09-12T01:58:17.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.096+0000 7fc1a7400640 1 -- 172.21.15.62:0/3344717795 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc1b019b870 con 0x7fc1b010e2d0 2024-09-12T01:58:17.096 INFO:teuthology.orchestra.run.smithi062.stdout:296352743461 2024-09-12T01:58:17.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 -- 172.21.15.62:0/3344717795 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1940a2c90 msgr2=0x7fc1940a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1940a2c90 0x7fc1940a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc1a00095f0 tx=0x7fc1a0005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 -- 172.21.15.62:0/3344717795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1b010e2d0 msgr2=0x7fc1b019ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1b010e2d0 0x7fc1b019ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800eb10 tx=0x7fc1a800c2d0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 -- 172.21.15.62:0/3344717795 shutdown_connections 2024-09-12T01:58:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1940a2c90 0x7fc1940a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1b010e2d0 0x7fc1b019ede0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1b01010d0 0x7fc1b019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 --2- 172.21.15.62:0/3344717795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b0100720 0x7fc1b019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:17.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 -- 172.21.15.62:0/3344717795 >> 172.21.15.62:0/3344717795 conn(0x7fc1b00fc610 msgr2=0x7fc1b00fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:17.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.098+0000 7fc1afe00640 1 -- 172.21.15.62:0/3344717795 shutdown_connections 2024-09-12T01:58:17.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.099+0000 7fc1afe00640 1 -- 172.21.15.62:0/3344717795 wait complete. 2024-09-12T01:58:17.601 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:17 smithi062 ceph-mon[30666]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:17.602 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:17 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3344717795' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:58:17.602 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:17 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/522980147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:58:17.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:17 smithi107 ceph-mon[35463]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:17.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:17 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3344717795' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:58:17.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:17 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/522980147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:58:17.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:17 smithi077 ceph-mon[35095]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:17.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:17 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3344717795' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:58:17.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:17 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/522980147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:58:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.977+0000 7fdbb9400640 1 -- 172.21.15.62:0/2503073921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb410e260 msgr2=0x7fdbb4110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.977+0000 7fdbb9400640 1 --2- 172.21.15.62:0/2503073921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb410e260 0x7fdbb4110650 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009be0 tx=0x7fdbac02a750 comp rx=0 tx=0).stop 2024-09-12T01:58:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.977+0000 7fdbb9400640 1 -- 172.21.15.62:0/2503073921 shutdown_connections 2024-09-12T01:58:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.977+0000 7fdbb9400640 1 --2- 172.21.15.62:0/2503073921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb410e260 0x7fdbb4110650 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.977+0000 7fdbb9400640 1 --2- 172.21.15.62:0/2503073921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbb4074ee0 0x7fdbb410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.977+0000 7fdbb9400640 1 --2- 172.21.15.62:0/2503073921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbb40745c0 0x7fdbb40749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.977+0000 7fdbb9400640 1 -- 172.21.15.62:0/2503073921 >> 172.21.15.62:0/2503073921 conn(0x7fdbb40fd740 msgr2=0x7fdbb40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.977+0000 7fdbb9400640 1 -- 172.21.15.62:0/2503073921 shutdown_connections 2024-09-12T01:58:18.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.977+0000 7fdbb9400640 1 -- 172.21.15.62:0/2503073921 wait complete. 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.979+0000 7fdbb9400640 1 Processor -- start 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.979+0000 7fdbb9400640 1 -- start start 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.979+0000 7fdbb9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbb40745c0 0x7fdbb419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.979+0000 7fdbb9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb4074ee0 0x7fdbb419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.979+0000 7fdbb9400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbb410e260 0x7fdbb419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.979+0000 7fdbb9400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb4113f90 con 0x7fdbb40745c0 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.979+0000 7fdbb9400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb4113e10 con 0x7fdbb410e260 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.979+0000 7fdbb9400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb4114110 con 0x7fdbb4074ee0 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.980+0000 7fdbb3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbb40745c0 0x7fdbb419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.980+0000 7fdbb3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbb40745c0 0x7fdbb419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47364/0 (socket says 172.21.15.62:47364) 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.980+0000 7fdbb3e00640 1 -- 172.21.15.62:0/522980147 learned_addr learned my addr 172.21.15.62:0/522980147 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.980+0000 7fdbb8a00640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbb410e260 0x7fdbb419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.980+0000 7fdbb3400640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb4074ee0 0x7fdbb419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.980+0000 7fdbb3e00640 1 -- 172.21.15.62:0/522980147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb4074ee0 msgr2=0x7fdbb419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.135 INFO:teuthology.orchestra.run.smithi062.stdout:111669149771 2024-09-12T01:58:18.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.980+0000 7fdbb3e00640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb4074ee0 0x7fdbb419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.980+0000 7fdbb3e00640 1 -- 172.21.15.62:0/522980147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbb410e260 msgr2=0x7fdbb419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.980+0000 7fdbb3e00640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbb410e260 0x7fdbb419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.980+0000 7fdbb3e00640 1 -- 172.21.15.62:0/522980147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb419f420 con 0x7fdbb40745c0 2024-09-12T01:58:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.981+0000 7fdbb3e00640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbb40745c0 0x7fdbb419a470 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdba400e9c0 tx=0x7fdba400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.981+0000 7fdbb0c00640 1 -- 172.21.15.62:0/522980147 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba400ccc0 con 0x7fdbb40745c0 2024-09-12T01:58:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.981+0000 7fdbb0c00640 1 -- 172.21.15.62:0/522980147 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdba4005500 con 0x7fdbb40745c0 2024-09-12T01:58:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.981+0000 7fdbb0c00640 1 -- 172.21.15.62:0/522980147 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4010430 con 0x7fdbb40745c0 2024-09-12T01:58:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.981+0000 7fdbb9400640 1 -- 172.21.15.62:0/522980147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb419f710 con 0x7fdbb40745c0 2024-09-12T01:58:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.981+0000 7fdbb9400640 1 -- 172.21.15.62:0/522980147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb41a6ff0 con 0x7fdbb40745c0 2024-09-12T01:58:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.982+0000 7fdbb9400640 1 -- 172.21.15.62:0/522980147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb40749a0 con 0x7fdbb40745c0 2024-09-12T01:58:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.984+0000 7fdbb0c00640 1 -- 172.21.15.62:0/522980147 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdba40046c0 con 0x7fdbb40745c0 2024-09-12T01:58:18.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.986+0000 7fdbb0c00640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fdb980a2c90 0x7fdb980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.987+0000 7fdbb0c00640 1 -- 172.21.15.62:0/522980147 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fdba40cf9d0 con 0x7fdbb40745c0 2024-09-12T01:58:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.987+0000 7fdbb3400640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fdb980a2c90 0x7fdb980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.988+0000 7fdbb3400640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fdb980a2c90 0x7fdb980a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdbb410f5f0 tx=0x7fdba0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:16.989+0000 7fdbb0c00640 1 -- 172.21.15.62:0/522980147 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdba40541b0 con 0x7fdbb40745c0 2024-09-12T01:58:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.178+0000 7fdbb9400640 1 -- 172.21.15.62:0/522980147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fdbb4108e50 con 0x7fdbb40745c0 2024-09-12T01:58:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.179+0000 7fdbb0c00640 1 -- 172.21.15.62:0/522980147 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdba409c410 con 0x7fdbb40745c0 2024-09-12T01:58:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 -- 172.21.15.62:0/522980147 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fdb980a2c90 msgr2=0x7fdb980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fdb980a2c90 0x7fdb980a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdbb410f5f0 tx=0x7fdba0005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 -- 172.21.15.62:0/522980147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbb40745c0 msgr2=0x7fdbb419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbb40745c0 0x7fdbb419a470 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdba400e9c0 tx=0x7fdba400ee80 comp rx=0 tx=0).stop 2024-09-12T01:58:18.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 -- 172.21.15.62:0/522980147 shutdown_connections 2024-09-12T01:58:18.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fdb980a2c90 0x7fdb980a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbb410e260 0x7fdbb419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdbb4074ee0 0x7fdbb419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 --2- 172.21.15.62:0/522980147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbb40745c0 0x7fdbb419a470 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 -- 172.21.15.62:0/522980147 >> 172.21.15.62:0/522980147 conn(0x7fdbb40fd740 msgr2=0x7fdbb40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 -- 172.21.15.62:0/522980147 shutdown_connections 2024-09-12T01:58:18.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:17.181+0000 7fdbb9400640 1 -- 172.21.15.62:0/522980147 wait complete. 2024-09-12T01:58:18.382 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906984 got 274877906986 for osd.9 2024-09-12T01:58:18.383 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:18.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.578+0000 7fac4f400640 1 -- 172.21.15.62:0/2780789518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac48109140 msgr2=0x7fac48110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.578+0000 7fac4f400640 1 --2- 172.21.15.62:0/2780789518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac48109140 0x7fac48110cc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac40009be0 tx=0x7fac4002a6c0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.578+0000 7fac4f400640 1 -- 172.21.15.62:0/2780789518 shutdown_connections 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.578+0000 7fac4f400640 1 --2- 172.21.15.62:0/2780789518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac48109140 0x7fac48110cc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.578+0000 7fac4f400640 1 --2- 172.21.15.62:0/2780789518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac481049c0 0x7fac48108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.578+0000 7fac4f400640 1 --2- 172.21.15.62:0/2780789518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac48104010 0x7fac481043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.578+0000 7fac4f400640 1 -- 172.21.15.62:0/2780789518 >> 172.21.15.62:0/2780789518 conn(0x7fac480ffa50 msgr2=0x7fac48101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.578+0000 7fac4f400640 1 -- 172.21.15.62:0/2780789518 shutdown_connections 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.578+0000 7fac4f400640 1 -- 172.21.15.62:0/2780789518 wait complete. 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.579+0000 7fac4f400640 1 Processor -- start 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac4f400640 1 -- start start 2024-09-12T01:58:18.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac4f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac48104010 0x7fac4819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac4f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac481049c0 0x7fac4819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac4f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac48109140 0x7fac4819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac4f400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fac48114150 con 0x7fac481049c0 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac4f400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac48113fd0 con 0x7fac48104010 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac4f400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fac481142d0 con 0x7fac48109140 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac47e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac481049c0 0x7fac4819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac47e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac481049c0 0x7fac4819ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47382/0 (socket says 172.21.15.62:47382) 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac47e00640 1 -- 172.21.15.62:0/319777341 learned_addr learned my addr 172.21.15.62:0/319777341 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.580+0000 7fac4ca00640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac48104010 0x7fac4819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac4d400640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac48109140 0x7fac4819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac47e00640 1 -- 172.21.15.62:0/319777341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac48109140 msgr2=0x7fac4819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac47e00640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac48109140 0x7fac4819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac47e00640 1 -- 172.21.15.62:0/319777341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac48104010 msgr2=0x7fac4819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac47e00640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac48104010 0x7fac4819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac47e00640 1 -- 172.21.15.62:0/319777341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4819f5e0 con 0x7fac481049c0 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac47e00640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac481049c0 0x7fac4819ab70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fac3400e9c0 tx=0x7fac3400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac45600640 1 -- 172.21.15.62:0/319777341 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3400cde0 con 0x7fac481049c0 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac45600640 1 -- 172.21.15.62:0/319777341 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac340035f0 con 0x7fac481049c0 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac45600640 1 -- 172.21.15.62:0/319777341 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34010690 con 0x7fac481049c0 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.581+0000 7fac4f400640 1 -- 172.21.15.62:0/319777341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4819f8d0 con 0x7fac481049c0 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.582+0000 7fac4f400640 1 -- 172.21.15.62:0/319777341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac481a71b0 con 0x7fac481049c0 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.583+0000 7fac4f400640 1 -- 172.21.15.62:0/319777341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac481043f0 con 0x7fac481049c0 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.585+0000 7fac45600640 1 -- 172.21.15.62:0/319777341 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fac340037a0 con 0x7fac481049c0 2024-09-12T01:58:18.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.586+0000 7fac45600640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fac300a2c90 0x7fac300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:18.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.586+0000 7fac45600640 1 -- 172.21.15.62:0/319777341 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fac340cf730 con 0x7fac481049c0 2024-09-12T01:58:18.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.586+0000 7fac4ca00640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fac300a2c90 0x7fac300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:18.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.587+0000 7fac4ca00640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fac300a2c90 0x7fac300a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009bd0 tx=0x7fac3c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:18.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.590+0000 7fac45600640 1 -- 172.21.15.62:0/319777341 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac3409c1d0 con 0x7fac481049c0 2024-09-12T01:58:18.783 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:18 smithi062 ceph-mon[30666]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:18.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.781+0000 7fac4f400640 1 -- 172.21.15.62:0/319777341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fac4802d7c0 con 0x7fac481049c0 2024-09-12T01:58:18.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.782+0000 7fac45600640 1 -- 172.21.15.62:0/319777341 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac3409bad0 con 0x7fac481049c0 2024-09-12T01:58:18.784 INFO:teuthology.orchestra.run.smithi062.stdout:34359738460 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 -- 172.21.15.62:0/319777341 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fac300a2c90 msgr2=0x7fac300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fac300a2c90 0x7fac300a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009bd0 tx=0x7fac3c005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 -- 172.21.15.62:0/319777341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac481049c0 msgr2=0x7fac4819ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac481049c0 0x7fac4819ab70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fac3400e9c0 tx=0x7fac3400ee80 comp rx=0 tx=0).stop 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 -- 172.21.15.62:0/319777341 shutdown_connections 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fac300a2c90 0x7fac300a5150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac48109140 0x7fac4819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fac481049c0 0x7fac4819ab70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 --2- 172.21.15.62:0/319777341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac48104010 0x7fac4819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 -- 172.21.15.62:0/319777341 >> 172.21.15.62:0/319777341 conn(0x7fac480ffa50 msgr2=0x7fac48100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 -- 172.21.15.62:0/319777341 shutdown_connections 2024-09-12T01:58:18.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:18.784+0000 7fac4f400640 1 -- 172.21.15.62:0/319777341 wait complete. 2024-09-12T01:58:18.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:18 smithi107 ceph-mon[35463]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:18.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:18 smithi077 ceph-mon[35095]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:19.260 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743459 got 296352743461 for osd.10 2024-09-12T01:58:19.261 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:19.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:19 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/319777341' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:58:19.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:19 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/319777341' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:58:19.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:19 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/319777341' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:58:20.003 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149768 got 111669149771 for osd.3 2024-09-12T01:58:20.003 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:20.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.500+0000 7f17f0e00640 1 -- 172.21.15.62:0/3519103960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17ec10e420 msgr2=0x7f17ec110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.500+0000 7f17f0e00640 1 --2- 172.21.15.62:0/3519103960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17ec10e420 0x7f17ec110810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009ca0 tx=0x7f17e402a950 comp rx=0 tx=0).stop 2024-09-12T01:58:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.500+0000 7f17f0e00640 1 -- 172.21.15.62:0/3519103960 shutdown_connections 2024-09-12T01:58:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.500+0000 7f17f0e00640 1 --2- 172.21.15.62:0/3519103960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17ec10e420 0x7f17ec110810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.500+0000 7f17f0e00640 1 --2- 172.21.15.62:0/3519103960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17ec074ee0 0x7f17ec10dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.500+0000 7f17f0e00640 1 --2- 172.21.15.62:0/3519103960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec0745c0 0x7f17ec0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.500+0000 7f17f0e00640 1 -- 172.21.15.62:0/3519103960 >> 172.21.15.62:0/3519103960 conn(0x7f17ec0fd8c0 msgr2=0x7f17ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.501+0000 7f17f0e00640 1 -- 172.21.15.62:0/3519103960 shutdown_connections 2024-09-12T01:58:20.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.501+0000 7f17f0e00640 1 -- 172.21.15.62:0/3519103960 wait complete. 2024-09-12T01:58:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.502+0000 7f17f0e00640 1 Processor -- start 2024-09-12T01:58:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.502+0000 7f17f0e00640 1 -- start start 2024-09-12T01:58:20.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17f0e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17ec0745c0 0x7f17ec19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:20.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17f0e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17ec074ee0 0x7f17ec19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:20.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17f0e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec10e420 0x7f17ec19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:20.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17f0e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec114170 con 0x7f17ec0745c0 2024-09-12T01:58:20.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17f0e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec113ff0 con 0x7f17ec10e420 2024-09-12T01:58:20.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17f0e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec1142f0 con 0x7f17ec074ee0 2024-09-12T01:58:20.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17e9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17ec074ee0 0x7f17ec19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:20.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17e9400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17ec074ee0 0x7f17ec19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:54822/0 (socket says 172.21.15.62:54822) 2024-09-12T01:58:20.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17e9400640 1 -- 172.21.15.62:0/4174528462 learned_addr learned my addr 172.21.15.62:0/4174528462 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:20.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17ea800640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec10e420 0x7f17ec19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:20.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.503+0000 7f17e9e00640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17ec0745c0 0x7f17ec19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.504+0000 7f17e9400640 1 -- 172.21.15.62:0/4174528462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec10e420 msgr2=0x7f17ec19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.504+0000 7f17e9400640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec10e420 0x7f17ec19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.504+0000 7f17e9400640 1 -- 172.21.15.62:0/4174528462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17ec0745c0 msgr2=0x7f17ec19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.504+0000 7f17e9400640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17ec0745c0 0x7f17ec19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.504+0000 7f17e9400640 1 -- 172.21.15.62:0/4174528462 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec19f620 con 0x7f17ec074ee0 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.504+0000 7f17e9400640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17ec074ee0 0x7f17ec19abb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f17d800e9f0 tx=0x7f17d800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.505+0000 7f17e2a00640 1 -- 172.21.15.62:0/4174528462 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d800cd80 con 0x7f17ec074ee0 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.505+0000 7f17f0e00640 1 -- 172.21.15.62:0/4174528462 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec19f910 con 0x7f17ec074ee0 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.505+0000 7f17f0e00640 1 -- 172.21.15.62:0/4174528462 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec1a71f0 con 0x7f17ec074ee0 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.505+0000 7f17e2a00640 1 -- 172.21.15.62:0/4174528462 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17d8005500 con 0x7f17ec074ee0 2024-09-12T01:58:20.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.505+0000 7f17e2a00640 1 -- 172.21.15.62:0/4174528462 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8010690 con 0x7f17ec074ee0 2024-09-12T01:58:20.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.506+0000 7f17f0e00640 1 -- 172.21.15.62:0/4174528462 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17cc005290 con 0x7f17ec074ee0 2024-09-12T01:58:20.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.508+0000 7f17e2a00640 1 -- 172.21.15.62:0/4174528462 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f17d8044b60 con 0x7f17ec074ee0 2024-09-12T01:58:20.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.510+0000 7f17e2a00640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f17d00a2c90 0x7f17d00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:20.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.510+0000 7f17e2a00640 1 -- 172.21.15.62:0/4174528462 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f17d80cf630 con 0x7f17ec074ee0 2024-09-12T01:58:20.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.510+0000 7f17e9e00640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f17d00a2c90 0x7f17d00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:20.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.510+0000 7f17e9e00640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f17d00a2c90 0x7f17d00a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009bd0 tx=0x7f17dc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:20.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.511+0000 7f17e2a00640 1 -- 172.21.15.62:0/4174528462 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17d809c070 con 0x7f17ec074ee0 2024-09-12T01:58:20.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.704+0000 7f17f0e00640 1 -- 172.21.15.62:0/4174528462 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f17cc005850 con 0x7f17ec074ee0 2024-09-12T01:58:20.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.705+0000 7f17e2a00640 1 -- 172.21.15.62:0/4174528462 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f17d809b970 con 0x7f17ec074ee0 2024-09-12T01:58:20.705 INFO:teuthology.orchestra.run.smithi062.stdout:163208757314 2024-09-12T01:58:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.707+0000 7f17f0e00640 1 -- 172.21.15.62:0/4174528462 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f17d00a2c90 msgr2=0x7f17d00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.707+0000 7f17f0e00640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f17d00a2c90 0x7f17d00a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009bd0 tx=0x7f17dc005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.707+0000 7f17f0e00640 1 -- 172.21.15.62:0/4174528462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17ec074ee0 msgr2=0x7f17ec19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.707+0000 7f17f0e00640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17ec074ee0 0x7f17ec19abb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f17d800e9f0 tx=0x7f17d800edf0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.707+0000 7f17f0e00640 1 -- 172.21.15.62:0/4174528462 shutdown_connections 2024-09-12T01:58:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.707+0000 7f17f0e00640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f17d00a2c90 0x7f17d00a5150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.707+0000 7f17f0e00640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec10e420 0x7f17ec19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.707+0000 7f17f0e00640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17ec074ee0 0x7f17ec19abb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.707+0000 7f17f0e00640 1 --2- 172.21.15.62:0/4174528462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f17ec0745c0 0x7f17ec19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.707+0000 7f17f0e00640 1 -- 172.21.15.62:0/4174528462 >> 172.21.15.62:0/4174528462 conn(0x7f17ec0fd8c0 msgr2=0x7f17ec0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.708+0000 7f17f0e00640 1 -- 172.21.15.62:0/4174528462 shutdown_connections 2024-09-12T01:58:20.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:20.708+0000 7f17f0e00640 1 -- 172.21.15.62:0/4174528462 wait complete. 2024-09-12T01:58:20.828 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:20 smithi062 ceph-mon[30666]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:20.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:20 smithi107 ceph-mon[35463]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:20.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:20 smithi077 ceph-mon[35095]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:21.105 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738456 got 34359738460 for osd.0 2024-09-12T01:58:21.105 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:21.612 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757311 got 163208757314 for osd.5 2024-09-12T01:58:21.612 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:21.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:21 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4174528462' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:58:21.931 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364851 got 214748364853 for osd.7 2024-09-12T01:58:21.931 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:21.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:21 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4174528462' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:58:21.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:21 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4174528462' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:58:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.436+0000 7fa00e600640 1 -- 172.21.15.62:0/8571213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0081049c0 msgr2=0x7fa008108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.436+0000 7fa00e600640 1 --2- 172.21.15.62:0/8571213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0081049c0 0x7fa008108a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009900 tx=0x7f9ff402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.436+0000 7fa00e600640 1 -- 172.21.15.62:0/8571213 shutdown_connections 2024-09-12T01:58:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.436+0000 7fa00e600640 1 --2- 172.21.15.62:0/8571213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa008109140 0x7fa008110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.436+0000 7fa00e600640 1 --2- 172.21.15.62:0/8571213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0081049c0 0x7fa008108a10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.436+0000 7fa00e600640 1 --2- 172.21.15.62:0/8571213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa008104010 0x7fa0081043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.436+0000 7fa00e600640 1 -- 172.21.15.62:0/8571213 >> 172.21.15.62:0/8571213 conn(0x7fa0080ffa50 msgr2=0x7fa008101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.436+0000 7fa00e600640 1 -- 172.21.15.62:0/8571213 shutdown_connections 2024-09-12T01:58:22.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.436+0000 7fa00e600640 1 -- 172.21.15.62:0/8571213 wait complete. 2024-09-12T01:58:22.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.437+0000 7fa00e600640 1 Processor -- start 2024-09-12T01:58:22.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.438+0000 7fa00e600640 1 -- start start 2024-09-12T01:58:22.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.438+0000 7fa00e600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa008104010 0x7fa00819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.438+0000 7fa00e600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0081049c0 0x7fa00819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.438+0000 7fa00e600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa008109140 0x7fa00819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.438+0000 7fa00e600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081141b0 con 0x7fa0081049c0 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.438+0000 7fa00e600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa008114030 con 0x7fa008104010 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.438+0000 7fa00e600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa008114330 con 0x7fa008109140 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.438+0000 7fa007400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa008104010 0x7fa00819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.438+0000 7fa007400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa008104010 0x7fa00819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:60272/0 (socket says 172.21.15.62:60272) 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.438+0000 7fa007400640 1 -- 172.21.15.62:0/3016918043 learned_addr learned my addr 172.21.15.62:0/3016918043 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.439+0000 7fa007e00640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa008109140 0x7fa00819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.439+0000 7fa006a00640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0081049c0 0x7fa00819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.439+0000 7fa007400640 1 -- 172.21.15.62:0/3016918043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa008109140 msgr2=0x7fa00819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.439+0000 7fa007400640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa008109140 0x7fa00819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.439+0000 7fa007400640 1 -- 172.21.15.62:0/3016918043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0081049c0 msgr2=0x7fa00819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.439+0000 7fa007400640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0081049c0 0x7fa00819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.439+0000 7fa007400640 1 -- 172.21.15.62:0/3016918043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00819f660 con 0x7fa008104010 2024-09-12T01:58:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.439+0000 7fa007400640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa008104010 0x7fa00819a6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800d950 tx=0x7f9ff800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.439+0000 7f9fffe00640 1 -- 172.21.15.62:0/3016918043 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8017030 con 0x7fa008104010 2024-09-12T01:58:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.440+0000 7f9fffe00640 1 -- 172.21.15.62:0/3016918043 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ff8004020 con 0x7fa008104010 2024-09-12T01:58:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.440+0000 7fa00e600640 1 -- 172.21.15.62:0/3016918043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00819f950 con 0x7fa008104010 2024-09-12T01:58:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.440+0000 7f9fffe00640 1 -- 172.21.15.62:0/3016918043 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8003d60 con 0x7fa008104010 2024-09-12T01:58:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.440+0000 7fa00e600640 1 -- 172.21.15.62:0/3016918043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0081a7230 con 0x7fa008104010 2024-09-12T01:58:22.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.441+0000 7fa00e600640 1 -- 172.21.15.62:0/3016918043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0081043f0 con 0x7fa008104010 2024-09-12T01:58:22.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.443+0000 7f9fffe00640 1 -- 172.21.15.62:0/3016918043 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9ff801a070 con 0x7fa008104010 2024-09-12T01:58:22.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.444+0000 7f9fffe00640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9fec0a2c90 0x7f9fec0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:22.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.444+0000 7f9fffe00640 1 -- 172.21.15.62:0/3016918043 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f9ff80ceff0 con 0x7fa008104010 2024-09-12T01:58:22.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.444+0000 7fa006a00640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9fec0a2c90 0x7f9fec0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:22.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.445+0000 7fa006a00640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9fec0a2c90 0x7f9fec0a5150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4000c00 tx=0x7f9ff4005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:22.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.446+0000 7f9fffe00640 1 -- 172.21.15.62:0/3016918043 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ff8021070 con 0x7fa008104010 2024-09-12T01:58:22.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.637+0000 7fa00e600640 1 -- 172.21.15.62:0/3016918043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa00819ba10 con 0x7fa008104010 2024-09-12T01:58:22.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.638+0000 7f9fffe00640 1 -- 172.21.15.62:0/3016918043 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa00819ba10 con 0x7fa008104010 2024-09-12T01:58:22.639 INFO:teuthology.orchestra.run.smithi062.stdout:141733920840 2024-09-12T01:58:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 -- 172.21.15.62:0/3016918043 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9fec0a2c90 msgr2=0x7f9fec0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9fec0a2c90 0x7f9fec0a5150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4000c00 tx=0x7f9ff4005a20 comp rx=0 tx=0).stop 2024-09-12T01:58:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 -- 172.21.15.62:0/3016918043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa008104010 msgr2=0x7fa00819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa008104010 0x7fa00819a6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800d950 tx=0x7f9ff800de10 comp rx=0 tx=0).stop 2024-09-12T01:58:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 -- 172.21.15.62:0/3016918043 shutdown_connections 2024-09-12T01:58:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f9fec0a2c90 0x7f9fec0a5150 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa008109140 0x7fa00819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0081049c0 0x7fa00819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 --2- 172.21.15.62:0/3016918043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa008104010 0x7fa00819a6b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 -- 172.21.15.62:0/3016918043 >> 172.21.15.62:0/3016918043 conn(0x7fa0080ffa50 msgr2=0x7fa008100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 -- 172.21.15.62:0/3016918043 shutdown_connections 2024-09-12T01:58:22.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:22.640+0000 7fa00e600640 1 -- 172.21.15.62:0/3016918043 wait complete. 2024-09-12T01:58:22.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:22 smithi062 ceph-mon[30666]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:22.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]: dispatch 2024-09-12T01:58:22.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-12T01:58:22.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:22 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]: dispatch 2024-09-12T01:58:22.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:22 smithi107 ceph-mon[35463]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:22.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]: dispatch 2024-09-12T01:58:22.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-12T01:58:22.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:22 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]: dispatch 2024-09-12T01:58:22.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:22 smithi077 ceph-mon[35095]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:22.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]: dispatch 2024-09-12T01:58:22.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-12T01:58:22.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:22 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]: dispatch 2024-09-12T01:58:23.476 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920836 got 141733920840 for osd.4 2024-09-12T01:58:23.476 DEBUG:teuthology.parallel:result is None 2024-09-12T01:58:23.476 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:58:23.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:58:23.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]': finished 2024-09-12T01:58:23.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-12T01:58:23.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:23 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]': finished 2024-09-12T01:58:23.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:23 smithi062 ceph-mon[30666]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T01:58:23.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:23 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3016918043' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:58:23.867 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:23.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]': finished 2024-09-12T01:58:23.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-12T01:58:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:23 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]': finished 2024-09-12T01:58:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:23 smithi107 ceph-mon[35463]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T01:58:23.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:23 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3016918043' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:58:23.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]': finished 2024-09-12T01:58:23.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-12T01:58:23.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:23 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]': finished 2024-09-12T01:58:23.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:23 smithi077 ceph-mon[35095]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T01:58:23.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:23 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3016918043' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:58:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.445+0000 7f2f58a00640 1 -- 172.21.15.62:0/845370871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f54104010 msgr2=0x7f2f541043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.445+0000 7f2f58a00640 1 --2- 172.21.15.62:0/845370871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f54104010 0x7f2f541043f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009900 tx=0x7f2f4402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.445+0000 7f2f58a00640 1 -- 172.21.15.62:0/845370871 shutdown_connections 2024-09-12T01:58:24.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.445+0000 7f2f58a00640 1 --2- 172.21.15.62:0/845370871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f54109140 0x7f2f54110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.445+0000 7f2f58a00640 1 --2- 172.21.15.62:0/845370871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f541049c0 0x7f2f54108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.445+0000 7f2f58a00640 1 --2- 172.21.15.62:0/845370871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f54104010 0x7f2f541043f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.445+0000 7f2f58a00640 1 -- 172.21.15.62:0/845370871 >> 172.21.15.62:0/845370871 conn(0x7f2f540ffa50 msgr2=0x7f2f54101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.445+0000 7f2f58a00640 1 -- 172.21.15.62:0/845370871 shutdown_connections 2024-09-12T01:58:24.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.445+0000 7f2f58a00640 1 -- 172.21.15.62:0/845370871 wait complete. 2024-09-12T01:58:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.446+0000 7f2f58a00640 1 Processor -- start 2024-09-12T01:58:24.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.446+0000 7f2f58a00640 1 -- start start 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f58a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f54104010 0x7f2f5419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f58a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f541049c0 0x7f2f5419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f58a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f54109140 0x7f2f5419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f58a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2f54114140 con 0x7f2f541049c0 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f58a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f54113fc0 con 0x7f2f54104010 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f58a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2f541142c0 con 0x7f2f54109140 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f49400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f541049c0 0x7f2f5419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f51e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f54104010 0x7f2f5419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f49400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f541049c0 0x7f2f5419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54856/0 (socket says 172.21.15.62:54856) 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f49400640 1 -- 172.21.15.62:0/3865895028 learned_addr learned my addr 172.21.15.62:0/3865895028 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.447+0000 7f2f52800640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f54109140 0x7f2f5419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f49400640 1 -- 172.21.15.62:0/3865895028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f54109140 msgr2=0x7f2f5419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f49400640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f54109140 0x7f2f5419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f49400640 1 -- 172.21.15.62:0/3865895028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f54104010 msgr2=0x7f2f5419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f49400640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f54104010 0x7f2f5419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f49400640 1 -- 172.21.15.62:0/3865895028 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5419f5d0 con 0x7f2f541049c0 2024-09-12T01:58:24.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f49400640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f541049c0 0x7f2f5419ab60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00d950 tx=0x7f2f3c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f4b400640 1 -- 172.21.15.62:0/3865895028 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c017070 con 0x7f2f541049c0 2024-09-12T01:58:24.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f4b400640 1 -- 172.21.15.62:0/3865895028 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f3c009c30 con 0x7f2f541049c0 2024-09-12T01:58:24.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f58a00640 1 -- 172.21.15.62:0/3865895028 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5419f8c0 con 0x7f2f541049c0 2024-09-12T01:58:24.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f4b400640 1 -- 172.21.15.62:0/3865895028 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00f6b0 con 0x7f2f541049c0 2024-09-12T01:58:24.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.448+0000 7f2f58a00640 1 -- 172.21.15.62:0/3865895028 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f541a71a0 con 0x7f2f541049c0 2024-09-12T01:58:24.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.450+0000 7f2f58a00640 1 -- 172.21.15.62:0/3865895028 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f541043f0 con 0x7f2f541049c0 2024-09-12T01:58:24.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.452+0000 7f2f4b400640 1 -- 172.21.15.62:0/3865895028 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2f3c0109d0 con 0x7f2f541049c0 2024-09-12T01:58:24.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.453+0000 7f2f4b400640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2f380a2c90 0x7f2f380a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:24.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.453+0000 7f2f4b400640 1 -- 172.21.15.62:0/3865895028 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f2f3c0cf120 con 0x7f2f541049c0 2024-09-12T01:58:24.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.453+0000 7f2f51e00640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2f380a2c90 0x7f2f380a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:24.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.454+0000 7f2f51e00640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2f380a2c90 0x7f2f380a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009230 tx=0x7f2f440058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:24.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.458+0000 7f2f4b400640 1 -- 172.21.15.62:0/3865895028 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f3c009de0 con 0x7f2f541049c0 2024-09-12T01:58:24.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:24 smithi062 ceph-mon[30666]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T01:58:24.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:24 smithi062 ceph-mon[30666]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.639+0000 7f2f58a00640 1 -- 172.21.15.62:0/3865895028 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f54062630 con 0x7f2f380a2c90 2024-09-12T01:58:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.648+0000 7f2f4b400640 1 -- 172.21.15.62:0/3865895028 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340298 (secure 0 0 0) 0x7f2f54062630 con 0x7f2f380a2c90 2024-09-12T01:58:24.650 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:58:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 -- 172.21.15.62:0/3865895028 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2f380a2c90 msgr2=0x7f2f380a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2f380a2c90 0x7f2f380a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009230 tx=0x7f2f440058d0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 -- 172.21.15.62:0/3865895028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f541049c0 msgr2=0x7f2f5419ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f541049c0 0x7f2f5419ab60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00d950 tx=0x7f2f3c00de10 comp rx=0 tx=0).stop 2024-09-12T01:58:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 -- 172.21.15.62:0/3865895028 shutdown_connections 2024-09-12T01:58:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f2f380a2c90 0x7f2f380a5150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f54109140 0x7f2f5419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f541049c0 0x7f2f5419ab60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 --2- 172.21.15.62:0/3865895028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f54104010 0x7f2f5419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 -- 172.21.15.62:0/3865895028 >> 172.21.15.62:0/3865895028 conn(0x7f2f540ffa50 msgr2=0x7f2f54100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.652+0000 7f2f58a00640 1 -- 172.21.15.62:0/3865895028 shutdown_connections 2024-09-12T01:58:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:24.653+0000 7f2f58a00640 1 -- 172.21.15.62:0/3865895028 wait complete. 2024-09-12T01:58:24.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:24 smithi107 ceph-mon[35463]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T01:58:24.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:24 smithi107 ceph-mon[35463]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:24.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:24 smithi077 ceph-mon[35095]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T01:58:24.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:24 smithi077 ceph-mon[35095]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:25.475 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-09-12T01:58:23.563635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656531,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":267,"num_read_kb":251,"num_write":272,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371744,"kb_used_data":14160,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124570080,"statfs":{"total":1151940427776,"available":1151559761920,"internally_reserved":0,"allocated":14499840,"data_stored":8178477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002125"},"pg_stats":[{"pgid":"2.1f","version":"84'4","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956758+0000","last_change":"2024-09-12T01:56:37.753384+0000","last_active":"2024-09-12T01:57:22.956758+0000","last_peered":"2024-09-12T01:57:22.956758+0000","last_clean":"2024-09-12T01:57:22.956758+0000","last_became_active":"2024-09-12T01:56:37.751999+0000","last_became_peered":"2024-09-12T01:56:37.751999+0000","last_unstale":"2024-09-12T01:57:22.956758+0000","last_undegraded":"2024-09-12T01:57:22.956758+0000","last_fullsized":"2024-09-12T01:57:22.956758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:21.459291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482775+0000","last_change":"2024-09-12T01:57:23.481994+0000","last_active":"2024-09-12T01:57:23.482775+0000","last_peered":"2024-09-12T01:57:23.482775+0000","last_clean":"2024-09-12T01:57:23.482775+0000","last_became_active":"2024-09-12T01:57:23.481613+0000","last_became_peered":"2024-09-12T01:57:23.481613+0000","last_unstale":"2024-09-12T01:57:23.482775+0000","last_undegraded":"2024-09-12T01:57:23.482775+0000","last_fullsized":"2024-09-12T01:57:23.482775+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:30.571049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951372+0000","last_change":"2024-09-12T01:56:49.873220+0000","last_active":"2024-09-12T01:57:22.951372+0000","last_peered":"2024-09-12T01:57:22.951372+0000","last_clean":"2024-09-12T01:57:22.951372+0000","last_became_active":"2024-09-12T01:56:49.872786+0000","last_became_peered":"2024-09-12T01:56:49.872786+0000","last_unstale":"2024-09-12T01:57:22.951372+0000","last_undegraded":"2024-09-12T01:57:22.951372+0000","last_fullsized":"2024-09-12T01:57:22.951372+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:06.588088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530915+0000","last_change":"2024-09-12T01:56:38.175159+0000","last_active":"2024-09-12T01:58:22.530915+0000","last_peered":"2024-09-12T01:58:22.530915+0000","last_clean":"2024-09-12T01:58:22.530915+0000","last_became_active":"2024-09-12T01:56:38.174792+0000","last_became_peered":"2024-09-12T01:56:38.174792+0000","last_unstale":"2024-09-12T01:58:22.530915+0000","last_undegraded":"2024-09-12T01:58:22.530915+0000","last_fullsized":"2024-09-12T01:58:22.530915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.355819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949796+0000","last_change":"2024-09-12T01:56:40.816906+0000","last_active":"2024-09-12T01:57:22.949796+0000","last_peered":"2024-09-12T01:57:22.949796+0000","last_clean":"2024-09-12T01:57:22.949796+0000","last_became_active":"2024-09-12T01:56:40.816197+0000","last_became_peered":"2024-09-12T01:56:40.816197+0000","last_unstale":"2024-09-12T01:57:22.949796+0000","last_undegraded":"2024-09-12T01:57:22.949796+0000","last_fullsized":"2024-09-12T01:57:22.949796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:39.033451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946641+0000","last_change":"2024-09-12T01:56:49.875694+0000","last_active":"2024-09-12T01:57:22.946641+0000","last_peered":"2024-09-12T01:57:22.946641+0000","last_clean":"2024-09-12T01:57:22.946641+0000","last_became_active":"2024-09-12T01:56:49.875226+0000","last_became_peered":"2024-09-12T01:56:49.875226+0000","last_unstale":"2024-09-12T01:57:22.946641+0000","last_undegraded":"2024-09-12T01:57:22.946641+0000","last_fullsized":"2024-09-12T01:57:22.946641+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:54.025926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946757+0000","last_change":"2024-09-12T01:56:37.750494+0000","last_active":"2024-09-12T01:57:22.946757+0000","last_peered":"2024-09-12T01:57:22.946757+0000","last_clean":"2024-09-12T01:57:22.946757+0000","last_became_active":"2024-09-12T01:56:37.750115+0000","last_became_peered":"2024-09-12T01:56:37.750115+0000","last_unstale":"2024-09-12T01:57:22.946757+0000","last_undegraded":"2024-09-12T01:57:22.946757+0000","last_fullsized":"2024-09-12T01:57:22.946757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:25.632133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951175+0000","last_change":"2024-09-12T01:56:40.798528+0000","last_active":"2024-09-12T01:57:22.951175+0000","last_peered":"2024-09-12T01:57:22.951175+0000","last_clean":"2024-09-12T01:57:22.951175+0000","last_became_active":"2024-09-12T01:56:40.798192+0000","last_became_peered":"2024-09-12T01:56:40.798192+0000","last_unstale":"2024-09-12T01:57:22.951175+0000","last_undegraded":"2024-09-12T01:57:22.951175+0000","last_fullsized":"2024-09-12T01:57:22.951175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:43.533060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482228+0000","last_change":"2024-09-12T01:57:23.482228+0000","last_active":"2024-09-12T01:57:23.482228+0000","last_peered":"2024-09-12T01:57:23.482228+0000","last_clean":"2024-09-12T01:57:23.482228+0000","last_became_active":"2024-09-12T01:57:23.481845+0000","last_became_peered":"2024-09-12T01:57:23.481845+0000","last_unstale":"2024-09-12T01:57:23.482228+0000","last_undegraded":"2024-09-12T01:57:23.482228+0000","last_fullsized":"2024-09-12T01:57:23.482228+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:01.804914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946568+0000","last_change":"2024-09-12T01:56:37.747071+0000","last_active":"2024-09-12T01:57:22.946568+0000","last_peered":"2024-09-12T01:57:22.946568+0000","last_clean":"2024-09-12T01:57:22.946568+0000","last_became_active":"2024-09-12T01:56:37.746729+0000","last_became_peered":"2024-09-12T01:56:37.746729+0000","last_unstale":"2024-09-12T01:57:22.946568+0000","last_undegraded":"2024-09-12T01:57:22.946568+0000","last_fullsized":"2024-09-12T01:57:22.946568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:43.361782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481674+0000","last_change":"2024-09-12T01:56:40.799328+0000","last_active":"2024-09-12T01:57:23.481674+0000","last_peered":"2024-09-12T01:57:23.481674+0000","last_clean":"2024-09-12T01:57:23.481674+0000","last_became_active":"2024-09-12T01:56:40.798817+0000","last_became_peered":"2024-09-12T01:56:40.798817+0000","last_unstale":"2024-09-12T01:57:23.481674+0000","last_undegraded":"2024-09-12T01:57:23.481674+0000","last_fullsized":"2024-09-12T01:57:23.481674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:11.020387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946782+0000","last_change":"2024-09-12T01:56:49.862705+0000","last_active":"2024-09-12T01:57:22.946782+0000","last_peered":"2024-09-12T01:57:22.946782+0000","last_clean":"2024-09-12T01:57:22.946782+0000","last_became_active":"2024-09-12T01:56:49.862339+0000","last_became_peered":"2024-09-12T01:56:49.862339+0000","last_unstale":"2024-09-12T01:57:22.946782+0000","last_undegraded":"2024-09-12T01:57:22.946782+0000","last_fullsized":"2024-09-12T01:57:22.946782+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:07.418851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949948+0000","last_change":"2024-09-12T01:56:40.802464+0000","last_active":"2024-09-12T01:57:22.949948+0000","last_peered":"2024-09-12T01:57:22.949948+0000","last_clean":"2024-09-12T01:57:22.949948+0000","last_became_active":"2024-09-12T01:56:40.802058+0000","last_became_peered":"2024-09-12T01:56:40.802058+0000","last_unstale":"2024-09-12T01:57:22.949948+0000","last_undegraded":"2024-09-12T01:57:22.949948+0000","last_fullsized":"2024-09-12T01:57:22.949948+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:01.915067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.960107+0000","last_change":"2024-09-12T01:57:22.959598+0000","last_active":"2024-09-12T01:57:22.960107+0000","last_peered":"2024-09-12T01:57:22.960107+0000","last_clean":"2024-09-12T01:57:22.960107+0000","last_became_active":"2024-09-12T01:57:22.956659+0000","last_became_peered":"2024-09-12T01:57:22.956659+0000","last_unstale":"2024-09-12T01:57:22.960107+0000","last_undegraded":"2024-09-12T01:57:22.960107+0000","last_fullsized":"2024-09-12T01:57:22.960107+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.838889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947196+0000","last_change":"2024-09-12T01:56:49.881126+0000","last_active":"2024-09-12T01:57:22.947196+0000","last_peered":"2024-09-12T01:57:22.947196+0000","last_clean":"2024-09-12T01:57:22.947196+0000","last_became_active":"2024-09-12T01:56:49.880750+0000","last_became_peered":"2024-09-12T01:56:49.880750+0000","last_unstale":"2024-09-12T01:57:22.947196+0000","last_undegraded":"2024-09-12T01:57:22.947196+0000","last_fullsized":"2024-09-12T01:57:22.947196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:08.105160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530550+0000","last_change":"2024-09-12T01:56:40.807475+0000","last_active":"2024-09-12T01:58:22.530550+0000","last_peered":"2024-09-12T01:58:22.530550+0000","last_clean":"2024-09-12T01:58:22.530550+0000","last_became_active":"2024-09-12T01:56:40.806943+0000","last_became_peered":"2024-09-12T01:56:40.806943+0000","last_unstale":"2024-09-12T01:58:22.530550+0000","last_undegraded":"2024-09-12T01:58:22.530550+0000","last_fullsized":"2024-09-12T01:58:22.530550+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:28.021204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951447+0000","last_change":"2024-09-12T01:56:37.752714+0000","last_active":"2024-09-12T01:57:22.951447+0000","last_peered":"2024-09-12T01:57:22.951447+0000","last_clean":"2024-09-12T01:57:22.951447+0000","last_became_active":"2024-09-12T01:56:37.752401+0000","last_became_peered":"2024-09-12T01:56:37.752401+0000","last_unstale":"2024-09-12T01:57:22.951447+0000","last_undegraded":"2024-09-12T01:57:22.951447+0000","last_fullsized":"2024-09-12T01:57:22.951447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:06.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947240+0000","last_change":"2024-09-12T01:56:49.876369+0000","last_active":"2024-09-12T01:57:22.947240+0000","last_peered":"2024-09-12T01:57:22.947240+0000","last_clean":"2024-09-12T01:57:22.947240+0000","last_became_active":"2024-09-12T01:56:49.875573+0000","last_became_peered":"2024-09-12T01:56:49.875573+0000","last_unstale":"2024-09-12T01:57:22.947240+0000","last_undegraded":"2024-09-12T01:57:22.947240+0000","last_fullsized":"2024-09-12T01:57:22.947240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:43.942369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947776+0000","last_change":"2024-09-12T01:56:40.807316+0000","last_active":"2024-09-12T01:57:22.947776+0000","last_peered":"2024-09-12T01:57:22.947776+0000","last_clean":"2024-09-12T01:57:22.947776+0000","last_became_active":"2024-09-12T01:56:40.806978+0000","last_became_peered":"2024-09-12T01:56:40.806978+0000","last_unstale":"2024-09-12T01:57:22.947776+0000","last_undegraded":"2024-09-12T01:57:22.947776+0000","last_fullsized":"2024-09-12T01:57:22.947776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:21.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530469+0000","last_change":"2024-09-12T01:56:37.752818+0000","last_active":"2024-09-12T01:58:22.530469+0000","last_peered":"2024-09-12T01:58:22.530469+0000","last_clean":"2024-09-12T01:58:22.530469+0000","last_became_active":"2024-09-12T01:56:37.752484+0000","last_became_peered":"2024-09-12T01:56:37.752484+0000","last_unstale":"2024-09-12T01:58:22.530469+0000","last_undegraded":"2024-09-12T01:58:22.530469+0000","last_fullsized":"2024-09-12T01:58:22.530469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.916149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956416+0000","last_change":"2024-09-12T01:56:49.878089+0000","last_active":"2024-09-12T01:57:22.956416+0000","last_peered":"2024-09-12T01:57:22.956416+0000","last_clean":"2024-09-12T01:57:22.956416+0000","last_became_active":"2024-09-12T01:56:49.875070+0000","last_became_peered":"2024-09-12T01:56:49.875070+0000","last_unstale":"2024-09-12T01:57:22.956416+0000","last_undegraded":"2024-09-12T01:57:22.956416+0000","last_fullsized":"2024-09-12T01:57:22.956416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:33.106652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946096+0000","last_change":"2024-09-12T01:56:40.797909+0000","last_active":"2024-09-12T01:57:22.946096+0000","last_peered":"2024-09-12T01:57:22.946096+0000","last_clean":"2024-09-12T01:57:22.946096+0000","last_became_active":"2024-09-12T01:56:40.797534+0000","last_became_peered":"2024-09-12T01:56:40.797534+0000","last_unstale":"2024-09-12T01:57:22.946096+0000","last_undegraded":"2024-09-12T01:57:22.946096+0000","last_fullsized":"2024-09-12T01:57:22.946096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:57.262669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950706+0000","last_change":"2024-09-12T01:56:38.176597+0000","last_active":"2024-09-12T01:57:22.950706+0000","last_peered":"2024-09-12T01:57:22.950706+0000","last_clean":"2024-09-12T01:57:22.950706+0000","last_became_active":"2024-09-12T01:56:38.176225+0000","last_became_peered":"2024-09-12T01:56:38.176225+0000","last_unstale":"2024-09-12T01:57:22.950706+0000","last_undegraded":"2024-09-12T01:57:22.950706+0000","last_fullsized":"2024-09-12T01:57:22.950706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:51.401286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947316+0000","last_change":"2024-09-12T01:56:49.881191+0000","last_active":"2024-09-12T01:57:22.947316+0000","last_peered":"2024-09-12T01:57:22.947316+0000","last_clean":"2024-09-12T01:57:22.947316+0000","last_became_active":"2024-09-12T01:56:49.880737+0000","last_became_peered":"2024-09-12T01:56:49.880737+0000","last_unstale":"2024-09-12T01:57:22.947316+0000","last_undegraded":"2024-09-12T01:57:22.947316+0000","last_fullsized":"2024-09-12T01:57:22.947316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:33.842527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949625+0000","last_change":"2024-09-12T01:56:40.806688+0000","last_active":"2024-09-12T01:57:22.949625+0000","last_peered":"2024-09-12T01:57:22.949625+0000","last_clean":"2024-09-12T01:57:22.949625+0000","last_became_active":"2024-09-12T01:56:40.806221+0000","last_became_peered":"2024-09-12T01:56:40.806221+0000","last_unstale":"2024-09-12T01:57:22.949625+0000","last_undegraded":"2024-09-12T01:57:22.949625+0000","last_fullsized":"2024-09-12T01:57:22.949625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.888750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'2","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947646+0000","last_change":"2024-09-12T01:56:37.882612+0000","last_active":"2024-09-12T01:57:22.947646+0000","last_peered":"2024-09-12T01:57:22.947646+0000","last_clean":"2024-09-12T01:57:22.947646+0000","last_became_active":"2024-09-12T01:56:37.882252+0000","last_became_peered":"2024-09-12T01:56:37.882252+0000","last_unstale":"2024-09-12T01:57:22.947646+0000","last_undegraded":"2024-09-12T01:57:22.947646+0000","last_fullsized":"2024-09-12T01:57:22.947646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:09.286264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951677+0000","last_change":"2024-09-12T01:56:49.862073+0000","last_active":"2024-09-12T01:57:22.951677+0000","last_peered":"2024-09-12T01:57:22.951677+0000","last_clean":"2024-09-12T01:57:22.951677+0000","last_became_active":"2024-09-12T01:56:49.861586+0000","last_became_peered":"2024-09-12T01:56:49.861586+0000","last_unstale":"2024-09-12T01:57:22.951677+0000","last_undegraded":"2024-09-12T01:57:22.951677+0000","last_fullsized":"2024-09-12T01:57:22.951677+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:51.503334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.531036+0000","last_change":"2024-09-12T01:56:40.803456+0000","last_active":"2024-09-12T01:58:22.531036+0000","last_peered":"2024-09-12T01:58:22.531036+0000","last_clean":"2024-09-12T01:58:22.531036+0000","last_became_active":"2024-09-12T01:56:40.797474+0000","last_became_peered":"2024-09-12T01:56:40.797474+0000","last_unstale":"2024-09-12T01:58:22.531036+0000","last_undegraded":"2024-09-12T01:58:22.531036+0000","last_fullsized":"2024-09-12T01:58:22.531036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:03.965692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'9","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:39.805239+0000","last_change":"2024-09-12T01:57:22.961059+0000","last_active":"2024-09-12T01:57:39.805239+0000","last_peered":"2024-09-12T01:57:39.805239+0000","last_clean":"2024-09-12T01:57:39.805239+0000","last_became_active":"2024-09-12T01:57:22.953667+0000","last_became_peered":"2024-09-12T01:57:22.953667+0000","last_unstale":"2024-09-12T01:57:39.805239+0000","last_undegraded":"2024-09-12T01:57:39.805239+0000","last_fullsized":"2024-09-12T01:57:39.805239+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:02.040016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530040+0000","last_change":"2024-09-12T01:56:49.881209+0000","last_active":"2024-09-12T01:58:22.530040+0000","last_peered":"2024-09-12T01:58:22.530040+0000","last_clean":"2024-09-12T01:58:22.530040+0000","last_became_active":"2024-09-12T01:56:49.880787+0000","last_became_peered":"2024-09-12T01:56:49.880787+0000","last_unstale":"2024-09-12T01:58:22.530040+0000","last_undegraded":"2024-09-12T01:58:22.530040+0000","last_fullsized":"2024-09-12T01:58:22.530040+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:55.432935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956337+0000","last_change":"2024-09-12T01:56:40.799664+0000","last_active":"2024-09-12T01:57:22.956337+0000","last_peered":"2024-09-12T01:57:22.956337+0000","last_clean":"2024-09-12T01:57:22.956337+0000","last_became_active":"2024-09-12T01:56:40.799174+0000","last_became_peered":"2024-09-12T01:56:40.799174+0000","last_unstale":"2024-09-12T01:57:22.956337+0000","last_undegraded":"2024-09-12T01:57:22.956337+0000","last_fullsized":"2024-09-12T01:57:22.956337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:37.347036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946779+0000","last_change":"2024-09-12T01:56:38.177277+0000","last_active":"2024-09-12T01:57:22.946779+0000","last_peered":"2024-09-12T01:57:22.946779+0000","last_clean":"2024-09-12T01:57:22.946779+0000","last_became_active":"2024-09-12T01:56:38.176532+0000","last_became_peered":"2024-09-12T01:56:38.176532+0000","last_unstale":"2024-09-12T01:57:22.946779+0000","last_undegraded":"2024-09-12T01:57:22.946779+0000","last_fullsized":"2024-09-12T01:57:22.946779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:19.424600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948386+0000","last_change":"2024-09-12T01:56:49.863474+0000","last_active":"2024-09-12T01:57:22.948386+0000","last_peered":"2024-09-12T01:57:22.948386+0000","last_clean":"2024-09-12T01:57:22.948386+0000","last_became_active":"2024-09-12T01:56:49.863019+0000","last_became_peered":"2024-09-12T01:56:49.863019+0000","last_unstale":"2024-09-12T01:57:22.948386+0000","last_undegraded":"2024-09-12T01:57:22.948386+0000","last_fullsized":"2024-09-12T01:57:22.948386+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:48.057450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480831+0000","last_change":"2024-09-12T01:56:40.808860+0000","last_active":"2024-09-12T01:57:23.480831+0000","last_peered":"2024-09-12T01:57:23.480831+0000","last_clean":"2024-09-12T01:57:23.480831+0000","last_became_active":"2024-09-12T01:56:40.808521+0000","last_became_peered":"2024-09-12T01:56:40.808521+0000","last_unstale":"2024-09-12T01:57:23.480831+0000","last_undegraded":"2024-09-12T01:57:23.480831+0000","last_fullsized":"2024-09-12T01:57:23.480831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:11.026296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955861+0000","last_change":"2024-09-12T01:56:38.176812+0000","last_active":"2024-09-12T01:57:22.955861+0000","last_peered":"2024-09-12T01:57:22.955861+0000","last_clean":"2024-09-12T01:57:22.955861+0000","last_became_active":"2024-09-12T01:56:38.176431+0000","last_became_peered":"2024-09-12T01:56:38.176431+0000","last_unstale":"2024-09-12T01:57:22.955861+0000","last_undegraded":"2024-09-12T01:57:22.955861+0000","last_fullsized":"2024-09-12T01:57:22.955861+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:24.132211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946130+0000","last_change":"2024-09-12T01:56:49.881391+0000","last_active":"2024-09-12T01:57:22.946130+0000","last_peered":"2024-09-12T01:57:22.946130+0000","last_clean":"2024-09-12T01:57:22.946130+0000","last_became_active":"2024-09-12T01:56:49.880890+0000","last_became_peered":"2024-09-12T01:56:49.880890+0000","last_unstale":"2024-09-12T01:57:22.946130+0000","last_undegraded":"2024-09-12T01:57:22.946130+0000","last_fullsized":"2024-09-12T01:57:22.946130+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:29.633558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480762+0000","last_change":"2024-09-12T01:56:40.813468+0000","last_active":"2024-09-12T01:57:23.480762+0000","last_peered":"2024-09-12T01:57:23.480762+0000","last_clean":"2024-09-12T01:57:23.480762+0000","last_became_active":"2024-09-12T01:56:40.813121+0000","last_became_peered":"2024-09-12T01:56:40.813121+0000","last_unstale":"2024-09-12T01:57:23.480762+0000","last_undegraded":"2024-09-12T01:57:23.480762+0000","last_fullsized":"2024-09-12T01:57:23.480762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:13.633672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950033+0000","last_change":"2024-09-12T01:56:37.751076+0000","last_active":"2024-09-12T01:57:22.950033+0000","last_peered":"2024-09-12T01:57:22.950033+0000","last_clean":"2024-09-12T01:57:22.950033+0000","last_became_active":"2024-09-12T01:56:37.750730+0000","last_became_peered":"2024-09-12T01:56:37.750730+0000","last_unstale":"2024-09-12T01:57:22.950033+0000","last_undegraded":"2024-09-12T01:57:22.950033+0000","last_fullsized":"2024-09-12T01:57:22.950033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:33.791431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955008+0000","last_change":"2024-09-12T01:56:49.870381+0000","last_active":"2024-09-12T01:57:22.955008+0000","last_peered":"2024-09-12T01:57:22.955008+0000","last_clean":"2024-09-12T01:57:22.955008+0000","last_became_active":"2024-09-12T01:56:49.869787+0000","last_became_peered":"2024-09-12T01:56:49.869787+0000","last_unstale":"2024-09-12T01:57:22.955008+0000","last_undegraded":"2024-09-12T01:57:22.955008+0000","last_fullsized":"2024-09-12T01:57:22.955008+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:01.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.957415+0000","last_change":"2024-09-12T01:57:22.955352+0000","last_active":"2024-09-12T01:57:22.957415+0000","last_peered":"2024-09-12T01:57:22.957415+0000","last_clean":"2024-09-12T01:57:22.957415+0000","last_became_active":"2024-09-12T01:57:22.954949+0000","last_became_peered":"2024-09-12T01:57:22.954949+0000","last_unstale":"2024-09-12T01:57:22.957415+0000","last_undegraded":"2024-09-12T01:57:22.957415+0000","last_fullsized":"2024-09-12T01:57:22.957415+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:38.707897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954634+0000","last_change":"2024-09-12T01:56:38.174983+0000","last_active":"2024-09-12T01:57:22.954634+0000","last_peered":"2024-09-12T01:57:22.954634+0000","last_clean":"2024-09-12T01:57:22.954634+0000","last_became_active":"2024-09-12T01:56:38.174578+0000","last_became_peered":"2024-09-12T01:56:38.174578+0000","last_unstale":"2024-09-12T01:57:22.954634+0000","last_undegraded":"2024-09-12T01:57:22.954634+0000","last_fullsized":"2024-09-12T01:57:22.954634+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:44.629321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.957417+0000","last_change":"2024-09-12T01:56:49.881829+0000","last_active":"2024-09-12T01:57:22.957417+0000","last_peered":"2024-09-12T01:57:22.957417+0000","last_clean":"2024-09-12T01:57:22.957417+0000","last_became_active":"2024-09-12T01:56:49.881373+0000","last_became_peered":"2024-09-12T01:56:49.881373+0000","last_unstale":"2024-09-12T01:57:22.957417+0000","last_undegraded":"2024-09-12T01:57:22.957417+0000","last_fullsized":"2024-09-12T01:57:22.957417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:36.706558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954402+0000","last_change":"2024-09-12T01:56:40.810202+0000","last_active":"2024-09-12T01:57:22.954402+0000","last_peered":"2024-09-12T01:57:22.954402+0000","last_clean":"2024-09-12T01:57:22.954402+0000","last_became_active":"2024-09-12T01:56:40.808567+0000","last_became_peered":"2024-09-12T01:56:40.808567+0000","last_unstale":"2024-09-12T01:57:22.954402+0000","last_undegraded":"2024-09-12T01:57:22.954402+0000","last_fullsized":"2024-09-12T01:57:22.954402+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:49.157369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949569+0000","last_change":"2024-09-12T01:56:37.753459+0000","last_active":"2024-09-12T01:57:22.949569+0000","last_peered":"2024-09-12T01:57:22.949569+0000","last_clean":"2024-09-12T01:57:22.949569+0000","last_became_active":"2024-09-12T01:56:37.753129+0000","last_became_peered":"2024-09-12T01:56:37.753129+0000","last_unstale":"2024-09-12T01:57:22.949569+0000","last_undegraded":"2024-09-12T01:57:22.949569+0000","last_fullsized":"2024-09-12T01:57:22.949569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:47.841217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481822+0000","last_change":"2024-09-12T01:56:49.881600+0000","last_active":"2024-09-12T01:57:23.481822+0000","last_peered":"2024-09-12T01:57:23.481822+0000","last_clean":"2024-09-12T01:57:23.481822+0000","last_became_active":"2024-09-12T01:56:49.881116+0000","last_became_peered":"2024-09-12T01:56:49.881116+0000","last_unstale":"2024-09-12T01:57:23.481822+0000","last_undegraded":"2024-09-12T01:57:23.481822+0000","last_fullsized":"2024-09-12T01:57:23.481822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:42.515473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530335+0000","last_change":"2024-09-12T01:56:40.796878+0000","last_active":"2024-09-12T01:58:22.530335+0000","last_peered":"2024-09-12T01:58:22.530335+0000","last_clean":"2024-09-12T01:58:22.530335+0000","last_became_active":"2024-09-12T01:56:40.795031+0000","last_became_peered":"2024-09-12T01:56:40.795031+0000","last_unstale":"2024-09-12T01:58:22.530335+0000","last_undegraded":"2024-09-12T01:58:22.530335+0000","last_fullsized":"2024-09-12T01:58:22.530335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:02.497135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947593+0000","last_change":"2024-09-12T01:56:37.754379+0000","last_active":"2024-09-12T01:57:22.947593+0000","last_peered":"2024-09-12T01:57:22.947593+0000","last_clean":"2024-09-12T01:57:22.947593+0000","last_became_active":"2024-09-12T01:56:37.753986+0000","last_became_peered":"2024-09-12T01:56:37.753986+0000","last_unstale":"2024-09-12T01:57:22.947593+0000","last_undegraded":"2024-09-12T01:57:22.947593+0000","last_fullsized":"2024-09-12T01:57:22.947593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:09.877482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":361,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949811+0000","last_change":"2024-09-12T01:55:24.577685+0000","last_active":"2024-09-12T01:57:22.949811+0000","last_peered":"2024-09-12T01:57:22.949811+0000","last_clean":"2024-09-12T01:57:22.949811+0000","last_became_active":"2024-09-12T01:55:24.577248+0000","last_became_peered":"2024-09-12T01:55:24.577248+0000","last_unstale":"2024-09-12T01:57:22.949811+0000","last_undegraded":"2024-09-12T01:57:22.949811+0000","last_fullsized":"2024-09-12T01:57:22.949811+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:51:44.081524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:51:44.081524+0000","last_clean_scrub_stamp":"2024-09-12T01:51:44.081524+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:25.146507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950317+0000","last_change":"2024-09-12T01:56:49.872339+0000","last_active":"2024-09-12T01:57:22.950317+0000","last_peered":"2024-09-12T01:57:22.950317+0000","last_clean":"2024-09-12T01:57:22.950317+0000","last_became_active":"2024-09-12T01:56:49.872035+0000","last_became_peered":"2024-09-12T01:56:49.872035+0000","last_unstale":"2024-09-12T01:57:22.950317+0000","last_undegraded":"2024-09-12T01:57:22.950317+0000","last_fullsized":"2024-09-12T01:57:22.950317+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:28.512384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950428+0000","last_change":"2024-09-12T01:56:40.805832+0000","last_active":"2024-09-12T01:57:22.950428+0000","last_peered":"2024-09-12T01:57:22.950428+0000","last_clean":"2024-09-12T01:57:22.950428+0000","last_became_active":"2024-09-12T01:56:40.805407+0000","last_became_peered":"2024-09-12T01:56:40.805407+0000","last_unstale":"2024-09-12T01:57:22.950428+0000","last_undegraded":"2024-09-12T01:57:22.950428+0000","last_fullsized":"2024-09-12T01:57:22.950428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:36.699461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.958274+0000","last_change":"2024-09-12T01:57:22.958274+0000","last_active":"2024-09-12T01:57:22.958274+0000","last_peered":"2024-09-12T01:57:22.958274+0000","last_clean":"2024-09-12T01:57:22.958274+0000","last_became_active":"2024-09-12T01:57:22.957927+0000","last_became_peered":"2024-09-12T01:57:22.957927+0000","last_unstale":"2024-09-12T01:57:22.958274+0000","last_undegraded":"2024-09-12T01:57:22.958274+0000","last_fullsized":"2024-09-12T01:57:22.958274+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:58.031082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950975+0000","last_change":"2024-09-12T01:56:49.863237+0000","last_active":"2024-09-12T01:57:22.950975+0000","last_peered":"2024-09-12T01:57:22.950975+0000","last_clean":"2024-09-12T01:57:22.950975+0000","last_became_active":"2024-09-12T01:56:49.862831+0000","last_became_peered":"2024-09-12T01:56:49.862831+0000","last_unstale":"2024-09-12T01:57:22.950975+0000","last_undegraded":"2024-09-12T01:57:22.950975+0000","last_fullsized":"2024-09-12T01:57:22.950975+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:45.970500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949744+0000","last_change":"2024-09-12T01:56:40.806634+0000","last_active":"2024-09-12T01:57:22.949744+0000","last_peered":"2024-09-12T01:57:22.949744+0000","last_clean":"2024-09-12T01:57:22.949744+0000","last_became_active":"2024-09-12T01:56:40.806308+0000","last_became_peered":"2024-09-12T01:56:40.806308+0000","last_unstale":"2024-09-12T01:57:22.949744+0000","last_undegraded":"2024-09-12T01:57:22.949744+0000","last_fullsized":"2024-09-12T01:57:22.949744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:46.800939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482190+0000","last_change":"2024-09-12T01:56:37.752897+0000","last_active":"2024-09-12T01:57:23.482190+0000","last_peered":"2024-09-12T01:57:23.482190+0000","last_clean":"2024-09-12T01:57:23.482190+0000","last_became_active":"2024-09-12T01:56:37.752612+0000","last_became_peered":"2024-09-12T01:56:37.752612+0000","last_unstale":"2024-09-12T01:57:23.482190+0000","last_undegraded":"2024-09-12T01:57:23.482190+0000","last_fullsized":"2024-09-12T01:57:23.482190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:16.690620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949456+0000","last_change":"2024-09-12T01:56:49.876113+0000","last_active":"2024-09-12T01:57:22.949456+0000","last_peered":"2024-09-12T01:57:22.949456+0000","last_clean":"2024-09-12T01:57:22.949456+0000","last_became_active":"2024-09-12T01:56:49.875743+0000","last_became_peered":"2024-09-12T01:56:49.875743+0000","last_unstale":"2024-09-12T01:57:22.949456+0000","last_undegraded":"2024-09-12T01:57:22.949456+0000","last_fullsized":"2024-09-12T01:57:22.949456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:20.818024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950510+0000","last_change":"2024-09-12T01:56:40.799329+0000","last_active":"2024-09-12T01:57:22.950510+0000","last_peered":"2024-09-12T01:57:22.950510+0000","last_clean":"2024-09-12T01:57:22.950510+0000","last_became_active":"2024-09-12T01:56:40.798999+0000","last_became_peered":"2024-09-12T01:56:40.798999+0000","last_unstale":"2024-09-12T01:57:22.950510+0000","last_undegraded":"2024-09-12T01:57:22.950510+0000","last_fullsized":"2024-09-12T01:57:22.950510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:33.291045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.963796+0000","last_change":"2024-09-12T01:57:22.963796+0000","last_active":"2024-09-12T01:57:22.963796+0000","last_peered":"2024-09-12T01:57:22.963796+0000","last_clean":"2024-09-12T01:57:22.963796+0000","last_became_active":"2024-09-12T01:57:22.958887+0000","last_became_peered":"2024-09-12T01:57:22.958887+0000","last_unstale":"2024-09-12T01:57:22.963796+0000","last_undegraded":"2024-09-12T01:57:22.963796+0000","last_fullsized":"2024-09-12T01:57:22.963796+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:57.272630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480866+0000","last_change":"2024-09-12T01:56:49.864958+0000","last_active":"2024-09-12T01:57:23.480866+0000","last_peered":"2024-09-12T01:57:23.480866+0000","last_clean":"2024-09-12T01:57:23.480866+0000","last_became_active":"2024-09-12T01:56:49.864564+0000","last_became_peered":"2024-09-12T01:56:49.864564+0000","last_unstale":"2024-09-12T01:57:23.480866+0000","last_undegraded":"2024-09-12T01:57:23.480866+0000","last_fullsized":"2024-09-12T01:57:23.480866+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:20.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948473+0000","last_change":"2024-09-12T01:56:40.799887+0000","last_active":"2024-09-12T01:57:22.948473+0000","last_peered":"2024-09-12T01:57:22.948473+0000","last_clean":"2024-09-12T01:57:22.948473+0000","last_became_active":"2024-09-12T01:56:40.799561+0000","last_became_peered":"2024-09-12T01:56:40.799561+0000","last_unstale":"2024-09-12T01:57:22.948473+0000","last_undegraded":"2024-09-12T01:57:22.948473+0000","last_fullsized":"2024-09-12T01:57:22.948473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:25.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946890+0000","last_change":"2024-09-12T01:56:37.746147+0000","last_active":"2024-09-12T01:57:22.946890+0000","last_peered":"2024-09-12T01:57:22.946890+0000","last_clean":"2024-09-12T01:57:22.946890+0000","last_became_active":"2024-09-12T01:56:37.745810+0000","last_became_peered":"2024-09-12T01:56:37.745810+0000","last_unstale":"2024-09-12T01:57:22.946890+0000","last_undegraded":"2024-09-12T01:57:22.946890+0000","last_fullsized":"2024-09-12T01:57:22.946890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:09.304520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480837+0000","last_change":"2024-09-12T01:56:49.869301+0000","last_active":"2024-09-12T01:57:23.480837+0000","last_peered":"2024-09-12T01:57:23.480837+0000","last_clean":"2024-09-12T01:57:23.480837+0000","last_became_active":"2024-09-12T01:56:49.868883+0000","last_became_peered":"2024-09-12T01:56:49.868883+0000","last_unstale":"2024-09-12T01:57:23.480837+0000","last_undegraded":"2024-09-12T01:57:23.480837+0000","last_fullsized":"2024-09-12T01:57:23.480837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:11.110423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481186+0000","last_change":"2024-09-12T01:56:40.808574+0000","last_active":"2024-09-12T01:57:23.481186+0000","last_peered":"2024-09-12T01:57:23.481186+0000","last_clean":"2024-09-12T01:57:23.481186+0000","last_became_active":"2024-09-12T01:56:40.808257+0000","last_became_peered":"2024-09-12T01:56:40.808257+0000","last_unstale":"2024-09-12T01:57:23.481186+0000","last_undegraded":"2024-09-12T01:57:23.481186+0000","last_fullsized":"2024-09-12T01:57:23.481186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:58.375055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946185+0000","last_change":"2024-09-12T01:56:38.177026+0000","last_active":"2024-09-12T01:57:22.946185+0000","last_peered":"2024-09-12T01:57:22.946185+0000","last_clean":"2024-09-12T01:57:22.946185+0000","last_became_active":"2024-09-12T01:56:38.176566+0000","last_became_peered":"2024-09-12T01:56:38.176566+0000","last_unstale":"2024-09-12T01:57:22.946185+0000","last_undegraded":"2024-09-12T01:57:22.946185+0000","last_fullsized":"2024-09-12T01:57:22.946185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:53.167228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956686+0000","last_change":"2024-09-12T01:56:49.876297+0000","last_active":"2024-09-12T01:57:22.956686+0000","last_peered":"2024-09-12T01:57:22.956686+0000","last_clean":"2024-09-12T01:57:22.956686+0000","last_became_active":"2024-09-12T01:56:49.875765+0000","last_became_peered":"2024-09-12T01:56:49.875765+0000","last_unstale":"2024-09-12T01:57:22.956686+0000","last_undegraded":"2024-09-12T01:57:22.956686+0000","last_fullsized":"2024-09-12T01:57:22.956686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:55.104025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949657+0000","last_change":"2024-09-12T01:56:40.801653+0000","last_active":"2024-09-12T01:57:22.949657+0000","last_peered":"2024-09-12T01:57:22.949657+0000","last_clean":"2024-09-12T01:57:22.949657+0000","last_became_active":"2024-09-12T01:56:40.801348+0000","last_became_peered":"2024-09-12T01:56:40.801348+0000","last_unstale":"2024-09-12T01:57:22.949657+0000","last_undegraded":"2024-09-12T01:57:22.949657+0000","last_fullsized":"2024-09-12T01:57:22.949657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:59.076443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947119+0000","last_change":"2024-09-12T01:56:37.749817+0000","last_active":"2024-09-12T01:57:22.947119+0000","last_peered":"2024-09-12T01:57:22.947119+0000","last_clean":"2024-09-12T01:57:22.947119+0000","last_became_active":"2024-09-12T01:56:37.749431+0000","last_became_peered":"2024-09-12T01:56:37.749431+0000","last_unstale":"2024-09-12T01:57:22.947119+0000","last_undegraded":"2024-09-12T01:57:22.947119+0000","last_fullsized":"2024-09-12T01:57:22.947119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:13.193083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956507+0000","last_change":"2024-09-12T01:56:49.877371+0000","last_active":"2024-09-12T01:57:22.956507+0000","last_peered":"2024-09-12T01:57:22.956507+0000","last_clean":"2024-09-12T01:57:22.956507+0000","last_became_active":"2024-09-12T01:56:49.873147+0000","last_became_peered":"2024-09-12T01:56:49.873147+0000","last_unstale":"2024-09-12T01:57:22.956507+0000","last_undegraded":"2024-09-12T01:57:22.956507+0000","last_fullsized":"2024-09-12T01:57:22.956507+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:23.215058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.958641+0000","last_change":"2024-09-12T01:57:22.958641+0000","last_active":"2024-09-12T01:57:22.958641+0000","last_peered":"2024-09-12T01:57:22.958641+0000","last_clean":"2024-09-12T01:57:22.958641+0000","last_became_active":"2024-09-12T01:57:22.958274+0000","last_became_peered":"2024-09-12T01:57:22.958274+0000","last_unstale":"2024-09-12T01:57:22.958641+0000","last_undegraded":"2024-09-12T01:57:22.958641+0000","last_fullsized":"2024-09-12T01:57:22.958641+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:22.529517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481486+0000","last_change":"2024-09-12T01:56:37.751527+0000","last_active":"2024-09-12T01:57:23.481486+0000","last_peered":"2024-09-12T01:57:23.481486+0000","last_clean":"2024-09-12T01:57:23.481486+0000","last_became_active":"2024-09-12T01:56:37.751190+0000","last_became_peered":"2024-09-12T01:56:37.751190+0000","last_unstale":"2024-09-12T01:57:23.481486+0000","last_undegraded":"2024-09-12T01:57:23.481486+0000","last_fullsized":"2024-09-12T01:57:23.481486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:01.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948103+0000","last_change":"2024-09-12T01:56:49.873101+0000","last_active":"2024-09-12T01:57:22.948103+0000","last_peered":"2024-09-12T01:57:22.948103+0000","last_clean":"2024-09-12T01:57:22.948103+0000","last_became_active":"2024-09-12T01:56:49.872670+0000","last_became_peered":"2024-09-12T01:56:49.872670+0000","last_unstale":"2024-09-12T01:57:22.948103+0000","last_undegraded":"2024-09-12T01:57:22.948103+0000","last_fullsized":"2024-09-12T01:57:22.948103+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.794244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954436+0000","last_change":"2024-09-12T01:56:40.805982+0000","last_active":"2024-09-12T01:57:22.954436+0000","last_peered":"2024-09-12T01:57:22.954436+0000","last_clean":"2024-09-12T01:57:22.954436+0000","last_became_active":"2024-09-12T01:56:40.805653+0000","last_became_peered":"2024-09-12T01:56:40.805653+0000","last_unstale":"2024-09-12T01:57:22.954436+0000","last_undegraded":"2024-09-12T01:57:22.954436+0000","last_fullsized":"2024-09-12T01:57:22.954436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:37.117089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'2","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952725+0000","last_change":"2024-09-12T01:56:37.753569+0000","last_active":"2024-09-12T01:57:22.952725+0000","last_peered":"2024-09-12T01:57:22.952725+0000","last_clean":"2024-09-12T01:57:22.952725+0000","last_became_active":"2024-09-12T01:56:37.753153+0000","last_became_peered":"2024-09-12T01:56:37.753153+0000","last_unstale":"2024-09-12T01:57:22.952725+0000","last_undegraded":"2024-09-12T01:57:22.952725+0000","last_fullsized":"2024-09-12T01:57:22.952725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:33.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481671+0000","last_change":"2024-09-12T01:56:49.866532+0000","last_active":"2024-09-12T01:57:23.481671+0000","last_peered":"2024-09-12T01:57:23.481671+0000","last_clean":"2024-09-12T01:57:23.481671+0000","last_became_active":"2024-09-12T01:56:49.866114+0000","last_became_peered":"2024-09-12T01:56:49.866114+0000","last_unstale":"2024-09-12T01:57:23.481671+0000","last_undegraded":"2024-09-12T01:57:23.481671+0000","last_fullsized":"2024-09-12T01:57:23.481671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:03.241292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946624+0000","last_change":"2024-09-12T01:56:40.799319+0000","last_active":"2024-09-12T01:57:22.946624+0000","last_peered":"2024-09-12T01:57:22.946624+0000","last_clean":"2024-09-12T01:57:22.946624+0000","last_became_active":"2024-09-12T01:56:40.798949+0000","last_became_peered":"2024-09-12T01:56:40.798949+0000","last_unstale":"2024-09-12T01:57:22.946624+0000","last_undegraded":"2024-09-12T01:57:22.946624+0000","last_fullsized":"2024-09-12T01:57:22.946624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:01.254059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'33","reported_seq":196,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:58:21.057189+0000","last_change":"2024-09-12T01:56:37.750425+0000","last_active":"2024-09-12T01:58:21.057189+0000","last_peered":"2024-09-12T01:58:21.057189+0000","last_clean":"2024-09-12T01:58:21.057189+0000","last_became_active":"2024-09-12T01:56:37.749995+0000","last_became_peered":"2024-09-12T01:56:37.749995+0000","last_unstale":"2024-09-12T01:58:21.057189+0000","last_undegraded":"2024-09-12T01:58:21.057189+0000","last_fullsized":"2024-09-12T01:58:21.057189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:53.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65131,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":126,"num_write":33,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949962+0000","last_change":"2024-09-12T01:56:49.872968+0000","last_active":"2024-09-12T01:57:22.949962+0000","last_peered":"2024-09-12T01:57:22.949962+0000","last_clean":"2024-09-12T01:57:22.949962+0000","last_became_active":"2024-09-12T01:56:49.872537+0000","last_became_peered":"2024-09-12T01:56:49.872537+0000","last_unstale":"2024-09-12T01:57:22.949962+0000","last_undegraded":"2024-09-12T01:57:22.949962+0000","last_fullsized":"2024-09-12T01:57:22.949962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:05.684396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951183+0000","last_change":"2024-09-12T01:56:40.808116+0000","last_active":"2024-09-12T01:57:22.951183+0000","last_peered":"2024-09-12T01:57:22.951183+0000","last_clean":"2024-09-12T01:57:22.951183+0000","last_became_active":"2024-09-12T01:56:40.807763+0000","last_became_peered":"2024-09-12T01:56:40.807763+0000","last_unstale":"2024-09-12T01:57:22.951183+0000","last_undegraded":"2024-09-12T01:57:22.951183+0000","last_fullsized":"2024-09-12T01:57:22.951183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:24.553929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'3","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481823+0000","last_change":"2024-09-12T01:56:38.177027+0000","last_active":"2024-09-12T01:57:23.481823+0000","last_peered":"2024-09-12T01:57:23.481823+0000","last_clean":"2024-09-12T01:57:23.481823+0000","last_became_active":"2024-09-12T01:56:38.176610+0000","last_became_peered":"2024-09-12T01:56:38.176610+0000","last_unstale":"2024-09-12T01:57:23.481823+0000","last_undegraded":"2024-09-12T01:57:23.481823+0000","last_fullsized":"2024-09-12T01:57:23.481823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:18.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947469+0000","last_change":"2024-09-12T01:56:49.875835+0000","last_active":"2024-09-12T01:57:22.947469+0000","last_peered":"2024-09-12T01:57:22.947469+0000","last_clean":"2024-09-12T01:57:22.947469+0000","last_became_active":"2024-09-12T01:56:49.875310+0000","last_became_peered":"2024-09-12T01:56:49.875310+0000","last_unstale":"2024-09-12T01:57:22.947469+0000","last_undegraded":"2024-09-12T01:57:22.947469+0000","last_fullsized":"2024-09-12T01:57:22.947469+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:57.153633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482387+0000","last_change":"2024-09-12T01:57:23.482387+0000","last_active":"2024-09-12T01:57:23.482387+0000","last_peered":"2024-09-12T01:57:23.482387+0000","last_clean":"2024-09-12T01:57:23.482387+0000","last_became_active":"2024-09-12T01:57:23.481842+0000","last_became_peered":"2024-09-12T01:57:23.481842+0000","last_unstale":"2024-09-12T01:57:23.482387+0000","last_undegraded":"2024-09-12T01:57:23.482387+0000","last_fullsized":"2024-09-12T01:57:23.482387+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:40.227322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950521+0000","last_change":"2024-09-12T01:56:37.749911+0000","last_active":"2024-09-12T01:57:22.950521+0000","last_peered":"2024-09-12T01:57:22.950521+0000","last_clean":"2024-09-12T01:57:22.950521+0000","last_became_active":"2024-09-12T01:56:37.749565+0000","last_became_peered":"2024-09-12T01:56:37.749565+0000","last_unstale":"2024-09-12T01:57:22.950521+0000","last_undegraded":"2024-09-12T01:57:22.950521+0000","last_fullsized":"2024-09-12T01:57:22.950521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:33.462391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949697+0000","last_change":"2024-09-12T01:56:49.873274+0000","last_active":"2024-09-12T01:57:22.949697+0000","last_peered":"2024-09-12T01:57:22.949697+0000","last_clean":"2024-09-12T01:57:22.949697+0000","last_became_active":"2024-09-12T01:56:49.872769+0000","last_became_peered":"2024-09-12T01:56:49.872769+0000","last_unstale":"2024-09-12T01:57:22.949697+0000","last_undegraded":"2024-09-12T01:57:22.949697+0000","last_fullsized":"2024-09-12T01:57:22.949697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:04.288198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951512+0000","last_change":"2024-09-12T01:56:40.798008+0000","last_active":"2024-09-12T01:57:22.951512+0000","last_peered":"2024-09-12T01:57:22.951512+0000","last_clean":"2024-09-12T01:57:22.951512+0000","last_became_active":"2024-09-12T01:56:40.797607+0000","last_became_peered":"2024-09-12T01:56:40.797607+0000","last_unstale":"2024-09-12T01:57:22.951512+0000","last_undegraded":"2024-09-12T01:57:22.951512+0000","last_fullsized":"2024-09-12T01:57:22.951512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.738161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481088+0000","last_change":"2024-09-12T01:56:37.754607+0000","last_active":"2024-09-12T01:57:23.481088+0000","last_peered":"2024-09-12T01:57:23.481088+0000","last_clean":"2024-09-12T01:57:23.481088+0000","last_became_active":"2024-09-12T01:56:37.754311+0000","last_became_peered":"2024-09-12T01:56:37.754311+0000","last_unstale":"2024-09-12T01:57:23.481088+0000","last_undegraded":"2024-09-12T01:57:23.481088+0000","last_fullsized":"2024-09-12T01:57:23.481088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:05.597502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530144+0000","last_change":"2024-09-12T01:56:49.860561+0000","last_active":"2024-09-12T01:58:22.530144+0000","last_peered":"2024-09-12T01:58:22.530144+0000","last_clean":"2024-09-12T01:58:22.530144+0000","last_became_active":"2024-09-12T01:56:49.860149+0000","last_became_peered":"2024-09-12T01:56:49.860149+0000","last_unstale":"2024-09-12T01:58:22.530144+0000","last_undegraded":"2024-09-12T01:58:22.530144+0000","last_fullsized":"2024-09-12T01:58:22.530144+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:19.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949432+0000","last_change":"2024-09-12T01:56:49.868171+0000","last_active":"2024-09-12T01:57:22.949432+0000","last_peered":"2024-09-12T01:57:22.949432+0000","last_clean":"2024-09-12T01:57:22.949432+0000","last_became_active":"2024-09-12T01:56:49.867729+0000","last_became_peered":"2024-09-12T01:56:49.867729+0000","last_unstale":"2024-09-12T01:57:22.949432+0000","last_undegraded":"2024-09-12T01:57:22.949432+0000","last_fullsized":"2024-09-12T01:57:22.949432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:48.599568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949836+0000","last_change":"2024-09-12T01:56:40.807872+0000","last_active":"2024-09-12T01:57:22.949836+0000","last_peered":"2024-09-12T01:57:22.949836+0000","last_clean":"2024-09-12T01:57:22.949836+0000","last_became_active":"2024-09-12T01:56:40.807422+0000","last_became_peered":"2024-09-12T01:56:40.807422+0000","last_unstale":"2024-09-12T01:57:22.949836+0000","last_undegraded":"2024-09-12T01:57:22.949836+0000","last_fullsized":"2024-09-12T01:57:22.949836+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.679501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481145+0000","last_change":"2024-09-12T01:56:37.750758+0000","last_active":"2024-09-12T01:57:23.481145+0000","last_peered":"2024-09-12T01:57:23.481145+0000","last_clean":"2024-09-12T01:57:23.481145+0000","last_became_active":"2024-09-12T01:56:37.750455+0000","last_became_peered":"2024-09-12T01:56:37.750455+0000","last_unstale":"2024-09-12T01:57:23.481145+0000","last_undegraded":"2024-09-12T01:57:23.481145+0000","last_fullsized":"2024-09-12T01:57:23.481145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:44.279233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948593+0000","last_change":"2024-09-12T01:56:49.877992+0000","last_active":"2024-09-12T01:57:22.948593+0000","last_peered":"2024-09-12T01:57:22.948593+0000","last_clean":"2024-09-12T01:57:22.948593+0000","last_became_active":"2024-09-12T01:56:49.877682+0000","last_became_peered":"2024-09-12T01:56:49.877682+0000","last_unstale":"2024-09-12T01:57:22.948593+0000","last_undegraded":"2024-09-12T01:57:22.948593+0000","last_fullsized":"2024-09-12T01:57:22.948593+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:28.326232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530200+0000","last_change":"2024-09-12T01:56:40.803688+0000","last_active":"2024-09-12T01:58:22.530200+0000","last_peered":"2024-09-12T01:58:22.530200+0000","last_clean":"2024-09-12T01:58:22.530200+0000","last_became_active":"2024-09-12T01:56:40.797538+0000","last_became_peered":"2024-09-12T01:56:40.797538+0000","last_unstale":"2024-09-12T01:58:22.530200+0000","last_undegraded":"2024-09-12T01:58:22.530200+0000","last_fullsized":"2024-09-12T01:58:22.530200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:19.309770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954527+0000","last_change":"2024-09-12T01:56:37.756077+0000","last_active":"2024-09-12T01:57:22.954527+0000","last_peered":"2024-09-12T01:57:22.954527+0000","last_clean":"2024-09-12T01:57:22.954527+0000","last_became_active":"2024-09-12T01:56:37.754873+0000","last_became_peered":"2024-09-12T01:56:37.754873+0000","last_unstale":"2024-09-12T01:57:22.954527+0000","last_undegraded":"2024-09-12T01:57:22.954527+0000","last_fullsized":"2024-09-12T01:57:22.954527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:38.889020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480689+0000","last_change":"2024-09-12T01:56:37.752122+0000","last_active":"2024-09-12T01:57:23.480689+0000","last_peered":"2024-09-12T01:57:23.480689+0000","last_clean":"2024-09-12T01:57:23.480689+0000","last_became_active":"2024-09-12T01:56:37.751690+0000","last_became_peered":"2024-09-12T01:56:37.751690+0000","last_unstale":"2024-09-12T01:57:23.480689+0000","last_undegraded":"2024-09-12T01:57:23.480689+0000","last_fullsized":"2024-09-12T01:57:23.480689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:37.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481499+0000","last_change":"2024-09-12T01:56:40.800079+0000","last_active":"2024-09-12T01:57:23.481499+0000","last_peered":"2024-09-12T01:57:23.481499+0000","last_clean":"2024-09-12T01:57:23.481499+0000","last_became_active":"2024-09-12T01:56:40.799766+0000","last_became_peered":"2024-09-12T01:56:40.799766+0000","last_unstale":"2024-09-12T01:57:23.481499+0000","last_undegraded":"2024-09-12T01:57:23.481499+0000","last_fullsized":"2024-09-12T01:57:23.481499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:32.211511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951575+0000","last_change":"2024-09-12T01:56:49.875360+0000","last_active":"2024-09-12T01:57:22.951575+0000","last_peered":"2024-09-12T01:57:22.951575+0000","last_clean":"2024-09-12T01:57:22.951575+0000","last_became_active":"2024-09-12T01:56:49.874781+0000","last_became_peered":"2024-09-12T01:56:49.874781+0000","last_unstale":"2024-09-12T01:57:22.951575+0000","last_undegraded":"2024-09-12T01:57:22.951575+0000","last_fullsized":"2024-09-12T01:57:22.951575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.667086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481582+0000","last_change":"2024-09-12T01:56:37.751251+0000","last_active":"2024-09-12T01:57:23.481582+0000","last_peered":"2024-09-12T01:57:23.481582+0000","last_clean":"2024-09-12T01:57:23.481582+0000","last_became_active":"2024-09-12T01:56:37.750886+0000","last_became_peered":"2024-09-12T01:56:37.750886+0000","last_unstale":"2024-09-12T01:57:23.481582+0000","last_undegraded":"2024-09-12T01:57:23.481582+0000","last_fullsized":"2024-09-12T01:57:23.481582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.377703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946203+0000","last_change":"2024-09-12T01:56:40.800259+0000","last_active":"2024-09-12T01:57:22.946203+0000","last_peered":"2024-09-12T01:57:22.946203+0000","last_clean":"2024-09-12T01:57:22.946203+0000","last_became_active":"2024-09-12T01:56:40.799892+0000","last_became_peered":"2024-09-12T01:56:40.799892+0000","last_unstale":"2024-09-12T01:57:22.946203+0000","last_undegraded":"2024-09-12T01:57:22.946203+0000","last_fullsized":"2024-09-12T01:57:22.946203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:59.402783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952362+0000","last_change":"2024-09-12T01:56:49.864057+0000","last_active":"2024-09-12T01:57:22.952362+0000","last_peered":"2024-09-12T01:57:22.952362+0000","last_clean":"2024-09-12T01:57:22.952362+0000","last_became_active":"2024-09-12T01:56:49.863033+0000","last_became_peered":"2024-09-12T01:56:49.863033+0000","last_unstale":"2024-09-12T01:57:22.952362+0000","last_undegraded":"2024-09-12T01:57:22.952362+0000","last_fullsized":"2024-09-12T01:57:22.952362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:11.134060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947710+0000","last_change":"2024-09-12T01:56:40.800392+0000","last_active":"2024-09-12T01:57:22.947710+0000","last_peered":"2024-09-12T01:57:22.947710+0000","last_clean":"2024-09-12T01:57:22.947710+0000","last_became_active":"2024-09-12T01:56:40.800042+0000","last_became_peered":"2024-09-12T01:56:40.800042+0000","last_unstale":"2024-09-12T01:57:22.947710+0000","last_undegraded":"2024-09-12T01:57:22.947710+0000","last_fullsized":"2024-09-12T01:57:22.947710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:15.543600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951920+0000","last_change":"2024-09-12T01:56:40.806231+0000","last_active":"2024-09-12T01:57:22.951920+0000","last_peered":"2024-09-12T01:57:22.951920+0000","last_clean":"2024-09-12T01:57:22.951920+0000","last_became_active":"2024-09-12T01:56:40.805748+0000","last_became_peered":"2024-09-12T01:56:40.805748+0000","last_unstale":"2024-09-12T01:57:22.951920+0000","last_undegraded":"2024-09-12T01:57:22.951920+0000","last_fullsized":"2024-09-12T01:57:22.951920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:48.753339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951532+0000","last_change":"2024-09-12T01:56:40.809433+0000","last_active":"2024-09-12T01:57:22.951532+0000","last_peered":"2024-09-12T01:57:22.951532+0000","last_clean":"2024-09-12T01:57:22.951532+0000","last_became_active":"2024-09-12T01:56:40.809000+0000","last_became_peered":"2024-09-12T01:56:40.809000+0000","last_unstale":"2024-09-12T01:57:22.951532+0000","last_undegraded":"2024-09-12T01:57:22.951532+0000","last_fullsized":"2024-09-12T01:57:22.951532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:45.506511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949568+0000","last_change":"2024-09-12T01:56:40.811304+0000","last_active":"2024-09-12T01:57:22.949568+0000","last_peered":"2024-09-12T01:57:22.949568+0000","last_clean":"2024-09-12T01:57:22.949568+0000","last_became_active":"2024-09-12T01:56:40.810759+0000","last_became_peered":"2024-09-12T01:56:40.810759+0000","last_unstale":"2024-09-12T01:57:22.949568+0000","last_undegraded":"2024-09-12T01:57:22.949568+0000","last_fullsized":"2024-09-12T01:57:22.949568+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:45.093498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956119+0000","last_change":"2024-09-12T01:56:40.809009+0000","last_active":"2024-09-12T01:57:22.956119+0000","last_peered":"2024-09-12T01:57:22.956119+0000","last_clean":"2024-09-12T01:57:22.956119+0000","last_became_active":"2024-09-12T01:56:40.808523+0000","last_became_peered":"2024-09-12T01:56:40.808523+0000","last_unstale":"2024-09-12T01:57:22.956119+0000","last_undegraded":"2024-09-12T01:57:22.956119+0000","last_fullsized":"2024-09-12T01:57:22.956119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:02.312093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948450+0000","last_change":"2024-09-12T01:56:40.796468+0000","last_active":"2024-09-12T01:57:22.948450+0000","last_peered":"2024-09-12T01:57:22.948450+0000","last_clean":"2024-09-12T01:57:22.948450+0000","last_became_active":"2024-09-12T01:56:40.796128+0000","last_became_peered":"2024-09-12T01:56:40.796128+0000","last_unstale":"2024-09-12T01:57:22.948450+0000","last_undegraded":"2024-09-12T01:57:22.948450+0000","last_fullsized":"2024-09-12T01:57:22.948450+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:55.521802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952974+0000","last_change":"2024-09-12T01:56:40.800836+0000","last_active":"2024-09-12T01:57:22.952974+0000","last_peered":"2024-09-12T01:57:22.952974+0000","last_clean":"2024-09-12T01:57:22.952974+0000","last_became_active":"2024-09-12T01:56:40.800274+0000","last_became_peered":"2024-09-12T01:56:40.800274+0000","last_unstale":"2024-09-12T01:57:22.952974+0000","last_undegraded":"2024-09-12T01:57:22.952974+0000","last_fullsized":"2024-09-12T01:57:22.952974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:27.774825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530930+0000","last_change":"2024-09-12T01:56:40.804247+0000","last_active":"2024-09-12T01:58:22.530930+0000","last_peered":"2024-09-12T01:58:22.530930+0000","last_clean":"2024-09-12T01:58:22.530930+0000","last_became_active":"2024-09-12T01:56:40.803892+0000","last_became_peered":"2024-09-12T01:56:40.803892+0000","last_unstale":"2024-09-12T01:58:22.530930+0000","last_undegraded":"2024-09-12T01:58:22.530930+0000","last_fullsized":"2024-09-12T01:58:22.530930+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:57.537524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480965+0000","last_change":"2024-09-12T01:56:40.805206+0000","last_active":"2024-09-12T01:57:23.480965+0000","last_peered":"2024-09-12T01:57:23.480965+0000","last_clean":"2024-09-12T01:57:23.480965+0000","last_became_active":"2024-09-12T01:56:40.804710+0000","last_became_peered":"2024-09-12T01:56:40.804710+0000","last_unstale":"2024-09-12T01:57:23.480965+0000","last_undegraded":"2024-09-12T01:57:23.480965+0000","last_fullsized":"2024-09-12T01:57:23.480965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530313+0000","last_change":"2024-09-12T01:56:40.795793+0000","last_active":"2024-09-12T01:58:22.530313+0000","last_peered":"2024-09-12T01:58:22.530313+0000","last_clean":"2024-09-12T01:58:22.530313+0000","last_became_active":"2024-09-12T01:56:40.795389+0000","last_became_peered":"2024-09-12T01:56:40.795389+0000","last_unstale":"2024-09-12T01:58:22.530313+0000","last_undegraded":"2024-09-12T01:58:22.530313+0000","last_fullsized":"2024-09-12T01:58:22.530313+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:16.413066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951131+0000","last_change":"2024-09-12T01:56:40.800624+0000","last_active":"2024-09-12T01:57:22.951131+0000","last_peered":"2024-09-12T01:57:22.951131+0000","last_clean":"2024-09-12T01:57:22.951131+0000","last_became_active":"2024-09-12T01:56:40.800203+0000","last_became_peered":"2024-09-12T01:56:40.800203+0000","last_unstale":"2024-09-12T01:57:22.951131+0000","last_undegraded":"2024-09-12T01:57:22.951131+0000","last_fullsized":"2024-09-12T01:57:22.951131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:01.688455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955164+0000","last_change":"2024-09-12T01:56:40.814818+0000","last_active":"2024-09-12T01:57:22.955164+0000","last_peered":"2024-09-12T01:57:22.955164+0000","last_clean":"2024-09-12T01:57:22.955164+0000","last_became_active":"2024-09-12T01:56:40.813521+0000","last_became_peered":"2024-09-12T01:56:40.813521+0000","last_unstale":"2024-09-12T01:57:22.955164+0000","last_undegraded":"2024-09-12T01:57:22.955164+0000","last_fullsized":"2024-09-12T01:57:22.955164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.393165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948221+0000","last_change":"2024-09-12T01:56:40.808186+0000","last_active":"2024-09-12T01:57:22.948221+0000","last_peered":"2024-09-12T01:57:22.948221+0000","last_clean":"2024-09-12T01:57:22.948221+0000","last_became_active":"2024-09-12T01:56:40.807817+0000","last_became_peered":"2024-09-12T01:56:40.807817+0000","last_unstale":"2024-09-12T01:57:22.948221+0000","last_undegraded":"2024-09-12T01:57:22.948221+0000","last_fullsized":"2024-09-12T01:57:22.948221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:21.055662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.952548+0000","last_change":"2024-09-12T01:56:40.805693+0000","last_active":"2024-09-12T01:57:22.952548+0000","last_peered":"2024-09-12T01:57:22.952548+0000","last_clean":"2024-09-12T01:57:22.952548+0000","last_became_active":"2024-09-12T01:56:40.805327+0000","last_became_peered":"2024-09-12T01:56:40.805327+0000","last_unstale":"2024-09-12T01:57:22.952548+0000","last_undegraded":"2024-09-12T01:57:22.952548+0000","last_fullsized":"2024-09-12T01:57:22.952548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:40.313504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.956039+0000","last_change":"2024-09-12T01:56:40.802263+0000","last_active":"2024-09-12T01:57:22.956039+0000","last_peered":"2024-09-12T01:57:22.956039+0000","last_clean":"2024-09-12T01:57:22.956039+0000","last_became_active":"2024-09-12T01:56:40.801009+0000","last_became_peered":"2024-09-12T01:56:40.801009+0000","last_unstale":"2024-09-12T01:57:22.956039+0000","last_undegraded":"2024-09-12T01:57:22.956039+0000","last_fullsized":"2024-09-12T01:57:22.956039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:03.283370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948958+0000","last_change":"2024-09-12T01:56:40.817597+0000","last_active":"2024-09-12T01:57:22.948958+0000","last_peered":"2024-09-12T01:57:22.948958+0000","last_clean":"2024-09-12T01:57:22.948958+0000","last_became_active":"2024-09-12T01:56:40.817314+0000","last_became_peered":"2024-09-12T01:56:40.817314+0000","last_unstale":"2024-09-12T01:57:22.948958+0000","last_undegraded":"2024-09-12T01:57:22.948958+0000","last_fullsized":"2024-09-12T01:57:22.948958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:33.421685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950442+0000","last_change":"2024-09-12T01:56:40.803580+0000","last_active":"2024-09-12T01:57:22.950442+0000","last_peered":"2024-09-12T01:57:22.950442+0000","last_clean":"2024-09-12T01:57:22.950442+0000","last_became_active":"2024-09-12T01:56:40.803251+0000","last_became_peered":"2024-09-12T01:56:40.803251+0000","last_unstale":"2024-09-12T01:57:22.950442+0000","last_undegraded":"2024-09-12T01:57:22.950442+0000","last_fullsized":"2024-09-12T01:57:22.950442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:48.813142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954092+0000","last_change":"2024-09-12T01:57:22.954092+0000","last_active":"2024-09-12T01:57:22.954092+0000","last_peered":"2024-09-12T01:57:22.954092+0000","last_clean":"2024-09-12T01:57:22.954092+0000","last_became_active":"2024-09-12T01:57:22.953702+0000","last_became_peered":"2024-09-12T01:57:22.953702+0000","last_unstale":"2024-09-12T01:57:22.954092+0000","last_undegraded":"2024-09-12T01:57:22.954092+0000","last_fullsized":"2024-09-12T01:57:22.954092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:21.939930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949090+0000","last_change":"2024-09-12T01:56:40.805635+0000","last_active":"2024-09-12T01:57:22.949090+0000","last_peered":"2024-09-12T01:57:22.949090+0000","last_clean":"2024-09-12T01:57:22.949090+0000","last_became_active":"2024-09-12T01:56:40.805272+0000","last_became_peered":"2024-09-12T01:56:40.805272+0000","last_unstale":"2024-09-12T01:57:22.949090+0000","last_undegraded":"2024-09-12T01:57:22.949090+0000","last_fullsized":"2024-09-12T01:57:22.949090+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:38.069722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.955059+0000","last_change":"2024-09-12T01:56:40.804448+0000","last_active":"2024-09-12T01:57:22.955059+0000","last_peered":"2024-09-12T01:57:22.955059+0000","last_clean":"2024-09-12T01:57:22.955059+0000","last_became_active":"2024-09-12T01:56:40.804087+0000","last_became_peered":"2024-09-12T01:56:40.804087+0000","last_unstale":"2024-09-12T01:57:22.955059+0000","last_undegraded":"2024-09-12T01:57:22.955059+0000","last_fullsized":"2024-09-12T01:57:22.955059+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:21.840684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947614+0000","last_change":"2024-09-12T01:56:40.805791+0000","last_active":"2024-09-12T01:57:22.947614+0000","last_peered":"2024-09-12T01:57:22.947614+0000","last_clean":"2024-09-12T01:57:22.947614+0000","last_became_active":"2024-09-12T01:56:40.805240+0000","last_became_peered":"2024-09-12T01:56:40.805240+0000","last_unstale":"2024-09-12T01:57:22.947614+0000","last_undegraded":"2024-09-12T01:57:22.947614+0000","last_fullsized":"2024-09-12T01:57:22.947614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:14.060341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950705+0000","last_change":"2024-09-12T01:56:40.803546+0000","last_active":"2024-09-12T01:57:22.950705+0000","last_peered":"2024-09-12T01:57:22.950705+0000","last_clean":"2024-09-12T01:57:22.950705+0000","last_became_active":"2024-09-12T01:56:40.803235+0000","last_became_peered":"2024-09-12T01:56:40.803235+0000","last_unstale":"2024-09-12T01:57:22.950705+0000","last_undegraded":"2024-09-12T01:57:22.950705+0000","last_fullsized":"2024-09-12T01:57:22.950705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:15.758641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481136+0000","last_change":"2024-09-12T01:56:40.806725+0000","last_active":"2024-09-12T01:57:23.481136+0000","last_peered":"2024-09-12T01:57:23.481136+0000","last_clean":"2024-09-12T01:57:23.481136+0000","last_became_active":"2024-09-12T01:56:40.806378+0000","last_became_peered":"2024-09-12T01:56:40.806378+0000","last_unstale":"2024-09-12T01:57:23.481136+0000","last_undegraded":"2024-09-12T01:57:23.481136+0000","last_fullsized":"2024-09-12T01:57:23.481136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:09.124282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951505+0000","last_change":"2024-09-12T01:56:40.794601+0000","last_active":"2024-09-12T01:57:22.951505+0000","last_peered":"2024-09-12T01:57:22.951505+0000","last_clean":"2024-09-12T01:57:22.951505+0000","last_became_active":"2024-09-12T01:56:40.794281+0000","last_became_peered":"2024-09-12T01:56:40.794281+0000","last_unstale":"2024-09-12T01:57:22.951505+0000","last_undegraded":"2024-09-12T01:57:22.951505+0000","last_fullsized":"2024-09-12T01:57:22.951505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.408464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530160+0000","last_change":"2024-09-12T01:56:40.806003+0000","last_active":"2024-09-12T01:58:22.530160+0000","last_peered":"2024-09-12T01:58:22.530160+0000","last_clean":"2024-09-12T01:58:22.530160+0000","last_became_active":"2024-09-12T01:56:40.805689+0000","last_became_peered":"2024-09-12T01:56:40.805689+0000","last_unstale":"2024-09-12T01:58:22.530160+0000","last_undegraded":"2024-09-12T01:58:22.530160+0000","last_fullsized":"2024-09-12T01:58:22.530160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:47.498654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950087+0000","last_change":"2024-09-12T01:56:40.800840+0000","last_active":"2024-09-12T01:57:22.950087+0000","last_peered":"2024-09-12T01:57:22.950087+0000","last_clean":"2024-09-12T01:57:22.950087+0000","last_became_active":"2024-09-12T01:56:40.800479+0000","last_became_peered":"2024-09-12T01:56:40.800479+0000","last_unstale":"2024-09-12T01:57:22.950087+0000","last_undegraded":"2024-09-12T01:57:22.950087+0000","last_fullsized":"2024-09-12T01:57:22.950087+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:11.789524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480654+0000","last_change":"2024-09-12T01:56:40.799488+0000","last_active":"2024-09-12T01:57:23.480654+0000","last_peered":"2024-09-12T01:57:23.480654+0000","last_clean":"2024-09-12T01:57:23.480654+0000","last_became_active":"2024-09-12T01:56:40.799131+0000","last_became_peered":"2024-09-12T01:56:40.799131+0000","last_unstale":"2024-09-12T01:57:23.480654+0000","last_undegraded":"2024-09-12T01:57:23.480654+0000","last_fullsized":"2024-09-12T01:57:23.480654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:37.722651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946176+0000","last_change":"2024-09-12T01:56:40.809821+0000","last_active":"2024-09-12T01:57:22.946176+0000","last_peered":"2024-09-12T01:57:22.946176+0000","last_clean":"2024-09-12T01:57:22.946176+0000","last_became_active":"2024-09-12T01:56:40.809500+0000","last_became_peered":"2024-09-12T01:56:40.809500+0000","last_unstale":"2024-09-12T01:57:22.946176+0000","last_undegraded":"2024-09-12T01:57:22.946176+0000","last_fullsized":"2024-09-12T01:57:22.946176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:23.271230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947610+0000","last_change":"2024-09-12T01:56:40.805722+0000","last_active":"2024-09-12T01:57:22.947610+0000","last_peered":"2024-09-12T01:57:22.947610+0000","last_clean":"2024-09-12T01:57:22.947610+0000","last_became_active":"2024-09-12T01:56:40.805406+0000","last_became_peered":"2024-09-12T01:56:40.805406+0000","last_unstale":"2024-09-12T01:57:22.947610+0000","last_undegraded":"2024-09-12T01:57:22.947610+0000","last_fullsized":"2024-09-12T01:57:22.947610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:14.214021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951499+0000","last_change":"2024-09-12T01:56:40.807957+0000","last_active":"2024-09-12T01:57:22.951499+0000","last_peered":"2024-09-12T01:57:22.951499+0000","last_clean":"2024-09-12T01:57:22.951499+0000","last_became_active":"2024-09-12T01:56:40.807635+0000","last_became_peered":"2024-09-12T01:56:40.807635+0000","last_unstale":"2024-09-12T01:57:22.951499+0000","last_undegraded":"2024-09-12T01:57:22.951499+0000","last_fullsized":"2024-09-12T01:57:22.951499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:05.378671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949492+0000","last_change":"2024-09-12T01:56:40.813995+0000","last_active":"2024-09-12T01:57:22.949492+0000","last_peered":"2024-09-12T01:57:22.949492+0000","last_clean":"2024-09-12T01:57:22.949492+0000","last_became_active":"2024-09-12T01:56:40.806665+0000","last_became_peered":"2024-09-12T01:56:40.806665+0000","last_unstale":"2024-09-12T01:57:22.949492+0000","last_undegraded":"2024-09-12T01:57:22.949492+0000","last_fullsized":"2024-09-12T01:57:22.949492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:01.652850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948866+0000","last_change":"2024-09-12T01:56:40.817591+0000","last_active":"2024-09-12T01:57:22.948866+0000","last_peered":"2024-09-12T01:57:22.948866+0000","last_clean":"2024-09-12T01:57:22.948866+0000","last_became_active":"2024-09-12T01:56:40.817281+0000","last_became_peered":"2024-09-12T01:56:40.817281+0000","last_unstale":"2024-09-12T01:57:22.948866+0000","last_undegraded":"2024-09-12T01:57:22.948866+0000","last_fullsized":"2024-09-12T01:57:22.948866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:51.933536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65929,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":131,"num_read_kb":132,"num_write":89,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":197787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":518042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743463,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32856,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712296,"statfs":{"total":95995035648,"available":95961391104,"internally_reserved":0,"allocated":1712128,"data_stored":1169639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906988,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":522720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":518646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364855,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36944,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708208,"statfs":{"total":95995035648,"available":95957204992,"internally_reserved":0,"allocated":1638400,"data_stored":1113088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528381,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1032192,"data_stored":513946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32788,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712364,"statfs":{"total":95995035648,"available":95961460736,"internally_reserved":0,"allocated":1642496,"data_stored":1108592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":518064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149773,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1056768,"data_stored":523516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":579111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":579077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1036288,"data_stored":514036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":65165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:25.481 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:58:25.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:25 smithi062 ceph-mon[30666]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:58:25.897 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:25.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:25 smithi107 ceph-mon[35463]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:58:25.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:25 smithi077 ceph-mon[35095]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:58:26.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.461+0000 7f30eb800640 1 -- 172.21.15.62:0/2032653198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e4103ff0 msgr2=0x7f30e41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.461+0000 7f30eb800640 1 --2- 172.21.15.62:0/2032653198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e4103ff0 0x7f30e41043d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009900 tx=0x7f30d802a410 comp rx=0 tx=0).stop 2024-09-12T01:58:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.461+0000 7f30eb800640 1 -- 172.21.15.62:0/2032653198 shutdown_connections 2024-09-12T01:58:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.461+0000 7f30eb800640 1 --2- 172.21.15.62:0/2032653198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30e4109120 0x7f30e4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.461+0000 7f30eb800640 1 --2- 172.21.15.62:0/2032653198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30e41049a0 0x7f30e41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.461+0000 7f30eb800640 1 --2- 172.21.15.62:0/2032653198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e4103ff0 0x7f30e41043d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.461+0000 7f30eb800640 1 -- 172.21.15.62:0/2032653198 >> 172.21.15.62:0/2032653198 conn(0x7f30e40ffa90 msgr2=0x7f30e4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.461+0000 7f30eb800640 1 -- 172.21.15.62:0/2032653198 shutdown_connections 2024-09-12T01:58:26.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.461+0000 7f30eb800640 1 -- 172.21.15.62:0/2032653198 wait complete. 2024-09-12T01:58:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.462+0000 7f30eb800640 1 Processor -- start 2024-09-12T01:58:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.462+0000 7f30eb800640 1 -- start start 2024-09-12T01:58:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.462+0000 7f30eb800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30e4103ff0 0x7f30e419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.462+0000 7f30eb800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e41049a0 0x7f30e419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.462+0000 7f30eb800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30e4109120 0x7f30e419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.462+0000 7f30eb800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f30e4114150 con 0x7f30e41049a0 2024-09-12T01:58:26.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.462+0000 7f30eb800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f30e4113fd0 con 0x7f30e4103ff0 2024-09-12T01:58:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.462+0000 7f30eb800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f30e41142d0 con 0x7f30e4109120 2024-09-12T01:58:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.463+0000 7f30e3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e41049a0 0x7f30e419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.463+0000 7f30e8e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30e4103ff0 0x7f30e419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.463+0000 7f30e8e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30e4103ff0 0x7f30e419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:60318/0 (socket says 172.21.15.62:60318) 2024-09-12T01:58:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.463+0000 7f30e8e00640 1 -- 172.21.15.62:0/2735671099 learned_addr learned my addr 172.21.15.62:0/2735671099 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.463+0000 7f30e9800640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30e4109120 0x7f30e419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.463+0000 7f30e8e00640 1 -- 172.21.15.62:0/2735671099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30e4109120 msgr2=0x7f30e419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.463+0000 7f30e8e00640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30e4109120 0x7f30e419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.463+0000 7f30e8e00640 1 -- 172.21.15.62:0/2735671099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e41049a0 msgr2=0x7f30e419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.463+0000 7f30e8e00640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e41049a0 0x7f30e419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.463+0000 7f30e8e00640 1 -- 172.21.15.62:0/2735671099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e419f5a0 con 0x7f30e4103ff0 2024-09-12T01:58:26.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.464+0000 7f30e8e00640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30e4103ff0 0x7f30e419a5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f30d8006010 tx=0x7f30d8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.464+0000 7f30e1600640 1 -- 172.21.15.62:0/2735671099 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d803f030 con 0x7f30e4103ff0 2024-09-12T01:58:26.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.464+0000 7f30eb800640 1 -- 172.21.15.62:0/2735671099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e419f830 con 0x7f30e4103ff0 2024-09-12T01:58:26.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.464+0000 7f30e1600640 1 -- 172.21.15.62:0/2735671099 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30d8004440 con 0x7f30e4103ff0 2024-09-12T01:58:26.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.464+0000 7f30e1600640 1 -- 172.21.15.62:0/2735671099 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8035070 con 0x7f30e4103ff0 2024-09-12T01:58:26.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.464+0000 7f30eb800640 1 -- 172.21.15.62:0/2735671099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e41a7170 con 0x7f30e4103ff0 2024-09-12T01:58:26.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.465+0000 7f30eb800640 1 -- 172.21.15.62:0/2735671099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e41043d0 con 0x7f30e4103ff0 2024-09-12T01:58:26.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.467+0000 7f30e1600640 1 -- 172.21.15.62:0/2735671099 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f30d8042030 con 0x7f30e4103ff0 2024-09-12T01:58:26.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.469+0000 7f30e1600640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30cc0a2c90 0x7f30cc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:26.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.469+0000 7f30e1600640 1 -- 172.21.15.62:0/2735671099 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f30d80efbd0 con 0x7f30e4103ff0 2024-09-12T01:58:26.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.469+0000 7f30e3e00640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30cc0a2c90 0x7f30cc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:26.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.470+0000 7f30e3e00640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30cc0a2c90 0x7f30cc0a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f30e40ffeb0 tx=0x7f30d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:26.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.471+0000 7f30e1600640 1 -- 172.21.15.62:0/2735671099 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30d80bc030 con 0x7f30e4103ff0 2024-09-12T01:58:26.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.654+0000 7f30eb800640 1 -- 172.21.15.62:0/2735671099 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30e4062630 con 0x7f30cc0a2c90 2024-09-12T01:58:26.655 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:26 smithi062 ceph-mon[30666]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-12T01:58:26.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.662+0000 7f30e1600640 1 -- 172.21.15.62:0/2735671099 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340299 (secure 0 0 0) 0x7f30e4062630 con 0x7f30cc0a2c90 2024-09-12T01:58:26.667 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:26.669 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:58:26.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 -- 172.21.15.62:0/2735671099 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30cc0a2c90 msgr2=0x7f30cc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30cc0a2c90 0x7f30cc0a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f30e40ffeb0 tx=0x7f30d0005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:26.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 -- 172.21.15.62:0/2735671099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30e4103ff0 msgr2=0x7f30e419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:26.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30e4103ff0 0x7f30e419a5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f30d8006010 tx=0x7f30d8004040 comp rx=0 tx=0).stop 2024-09-12T01:58:26.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 -- 172.21.15.62:0/2735671099 shutdown_connections 2024-09-12T01:58:26.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f30cc0a2c90 0x7f30cc0a5150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30e4109120 0x7f30e419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30e41049a0 0x7f30e419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 --2- 172.21.15.62:0/2735671099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30e4103ff0 0x7f30e419a5f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:26.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 -- 172.21.15.62:0/2735671099 >> 172.21.15.62:0/2735671099 conn(0x7f30e40ffa90 msgr2=0x7f30e4100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:26.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 -- 172.21.15.62:0/2735671099 shutdown_connections 2024-09-12T01:58:26.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:26.668+0000 7f30eb800640 1 -- 172.21.15.62:0/2735671099 wait complete. 2024-09-12T01:58:26.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:26 smithi107 ceph-mon[35463]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-12T01:58:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:26 smithi077 ceph-mon[35095]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-12T01:58:27.410 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-09-12T01:58:25.563965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656531,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":267,"num_read_kb":251,"num_write":272,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371932,"kb_used_data":14320,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124569892,"statfs":{"total":1151940427776,"available":1151559569408,"internally_reserved":0,"allocated":14663680,"data_stored":8272885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001860"},"pg_stats":[{"pgid":"2.1f","version":"84'4","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.534932+0000","last_change":"2024-09-12T01:56:37.753384+0000","last_active":"2024-09-12T01:58:23.534932+0000","last_peered":"2024-09-12T01:58:23.534932+0000","last_clean":"2024-09-12T01:58:23.534932+0000","last_became_active":"2024-09-12T01:56:37.751999+0000","last_became_peered":"2024-09-12T01:56:37.751999+0000","last_unstale":"2024-09-12T01:58:23.534932+0000","last_undegraded":"2024-09-12T01:58:23.534932+0000","last_fullsized":"2024-09-12T01:58:23.534932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:21.459291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.534069+0000","last_change":"2024-09-12T01:57:23.481994+0000","last_active":"2024-09-12T01:58:23.534069+0000","last_peered":"2024-09-12T01:58:23.534069+0000","last_clean":"2024-09-12T01:58:23.534069+0000","last_became_active":"2024-09-12T01:57:23.481613+0000","last_became_peered":"2024-09-12T01:57:23.481613+0000","last_unstale":"2024-09-12T01:58:23.534069+0000","last_undegraded":"2024-09-12T01:58:23.534069+0000","last_fullsized":"2024-09-12T01:58:23.534069+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:30.571049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.535203+0000","last_change":"2024-09-12T01:56:49.873220+0000","last_active":"2024-09-12T01:58:23.535203+0000","last_peered":"2024-09-12T01:58:23.535203+0000","last_clean":"2024-09-12T01:58:23.535203+0000","last_became_active":"2024-09-12T01:56:49.872786+0000","last_became_peered":"2024-09-12T01:56:49.872786+0000","last_unstale":"2024-09-12T01:58:23.535203+0000","last_undegraded":"2024-09-12T01:58:23.535203+0000","last_fullsized":"2024-09-12T01:58:23.535203+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:06.588088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530915+0000","last_change":"2024-09-12T01:56:38.175159+0000","last_active":"2024-09-12T01:58:22.530915+0000","last_peered":"2024-09-12T01:58:22.530915+0000","last_clean":"2024-09-12T01:58:22.530915+0000","last_became_active":"2024-09-12T01:56:38.174792+0000","last_became_peered":"2024-09-12T01:56:38.174792+0000","last_unstale":"2024-09-12T01:58:22.530915+0000","last_undegraded":"2024-09-12T01:58:22.530915+0000","last_fullsized":"2024-09-12T01:58:22.530915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:27.355819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949796+0000","last_change":"2024-09-12T01:56:40.816906+0000","last_active":"2024-09-12T01:57:22.949796+0000","last_peered":"2024-09-12T01:57:22.949796+0000","last_clean":"2024-09-12T01:57:22.949796+0000","last_became_active":"2024-09-12T01:56:40.816197+0000","last_became_peered":"2024-09-12T01:56:40.816197+0000","last_unstale":"2024-09-12T01:57:22.949796+0000","last_undegraded":"2024-09-12T01:57:22.949796+0000","last_fullsized":"2024-09-12T01:57:22.949796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:39.033451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.531991+0000","last_change":"2024-09-12T01:56:49.875694+0000","last_active":"2024-09-12T01:58:23.531991+0000","last_peered":"2024-09-12T01:58:23.531991+0000","last_clean":"2024-09-12T01:58:23.531991+0000","last_became_active":"2024-09-12T01:56:49.875226+0000","last_became_peered":"2024-09-12T01:56:49.875226+0000","last_unstale":"2024-09-12T01:58:23.531991+0000","last_undegraded":"2024-09-12T01:58:23.531991+0000","last_fullsized":"2024-09-12T01:58:23.531991+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:54.025926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946757+0000","last_change":"2024-09-12T01:56:37.750494+0000","last_active":"2024-09-12T01:57:22.946757+0000","last_peered":"2024-09-12T01:57:22.946757+0000","last_clean":"2024-09-12T01:57:22.946757+0000","last_became_active":"2024-09-12T01:56:37.750115+0000","last_became_peered":"2024-09-12T01:56:37.750115+0000","last_unstale":"2024-09-12T01:57:22.946757+0000","last_undegraded":"2024-09-12T01:57:22.946757+0000","last_fullsized":"2024-09-12T01:57:22.946757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:25.632133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951175+0000","last_change":"2024-09-12T01:56:40.798528+0000","last_active":"2024-09-12T01:57:22.951175+0000","last_peered":"2024-09-12T01:57:22.951175+0000","last_clean":"2024-09-12T01:57:22.951175+0000","last_became_active":"2024-09-12T01:56:40.798192+0000","last_became_peered":"2024-09-12T01:56:40.798192+0000","last_unstale":"2024-09-12T01:57:22.951175+0000","last_undegraded":"2024-09-12T01:57:22.951175+0000","last_fullsized":"2024-09-12T01:57:22.951175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:43.533060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.532239+0000","last_change":"2024-09-12T01:57:23.482228+0000","last_active":"2024-09-12T01:58:23.532239+0000","last_peered":"2024-09-12T01:58:23.532239+0000","last_clean":"2024-09-12T01:58:23.532239+0000","last_became_active":"2024-09-12T01:57:23.481845+0000","last_became_peered":"2024-09-12T01:57:23.481845+0000","last_unstale":"2024-09-12T01:58:23.532239+0000","last_undegraded":"2024-09-12T01:58:23.532239+0000","last_fullsized":"2024-09-12T01:58:23.532239+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:01.804914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946568+0000","last_change":"2024-09-12T01:56:37.747071+0000","last_active":"2024-09-12T01:57:22.946568+0000","last_peered":"2024-09-12T01:57:22.946568+0000","last_clean":"2024-09-12T01:57:22.946568+0000","last_became_active":"2024-09-12T01:56:37.746729+0000","last_became_peered":"2024-09-12T01:56:37.746729+0000","last_unstale":"2024-09-12T01:57:22.946568+0000","last_undegraded":"2024-09-12T01:57:22.946568+0000","last_fullsized":"2024-09-12T01:57:22.946568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:43.361782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812644+0000","last_change":"2024-09-12T01:56:40.799328+0000","last_active":"2024-09-12T01:58:23.812644+0000","last_peered":"2024-09-12T01:58:23.812644+0000","last_clean":"2024-09-12T01:58:23.812644+0000","last_became_active":"2024-09-12T01:56:40.798817+0000","last_became_peered":"2024-09-12T01:56:40.798817+0000","last_unstale":"2024-09-12T01:58:23.812644+0000","last_undegraded":"2024-09-12T01:58:23.812644+0000","last_fullsized":"2024-09-12T01:58:23.812644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:11.020387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.532153+0000","last_change":"2024-09-12T01:56:49.862705+0000","last_active":"2024-09-12T01:58:23.532153+0000","last_peered":"2024-09-12T01:58:23.532153+0000","last_clean":"2024-09-12T01:58:23.532153+0000","last_became_active":"2024-09-12T01:56:49.862339+0000","last_became_peered":"2024-09-12T01:56:49.862339+0000","last_unstale":"2024-09-12T01:58:23.532153+0000","last_undegraded":"2024-09-12T01:58:23.532153+0000","last_fullsized":"2024-09-12T01:58:23.532153+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:07.418851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.813183+0000","last_change":"2024-09-12T01:56:40.802464+0000","last_active":"2024-09-12T01:58:23.813183+0000","last_peered":"2024-09-12T01:58:23.813183+0000","last_clean":"2024-09-12T01:58:23.813183+0000","last_became_active":"2024-09-12T01:56:40.802058+0000","last_became_peered":"2024-09-12T01:56:40.802058+0000","last_unstale":"2024-09-12T01:58:23.813183+0000","last_undegraded":"2024-09-12T01:58:23.813183+0000","last_fullsized":"2024-09-12T01:58:23.813183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:01.915067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.960107+0000","last_change":"2024-09-12T01:57:22.959598+0000","last_active":"2024-09-12T01:57:22.960107+0000","last_peered":"2024-09-12T01:57:22.960107+0000","last_clean":"2024-09-12T01:57:22.960107+0000","last_became_active":"2024-09-12T01:57:22.956659+0000","last_became_peered":"2024-09-12T01:57:22.956659+0000","last_unstale":"2024-09-12T01:57:22.960107+0000","last_undegraded":"2024-09-12T01:57:22.960107+0000","last_fullsized":"2024-09-12T01:57:22.960107+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.838889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.532294+0000","last_change":"2024-09-12T01:56:49.881126+0000","last_active":"2024-09-12T01:58:23.532294+0000","last_peered":"2024-09-12T01:58:23.532294+0000","last_clean":"2024-09-12T01:58:23.532294+0000","last_became_active":"2024-09-12T01:56:49.880750+0000","last_became_peered":"2024-09-12T01:56:49.880750+0000","last_unstale":"2024-09-12T01:58:23.532294+0000","last_undegraded":"2024-09-12T01:58:23.532294+0000","last_fullsized":"2024-09-12T01:58:23.532294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:08.105160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530550+0000","last_change":"2024-09-12T01:56:40.807475+0000","last_active":"2024-09-12T01:58:22.530550+0000","last_peered":"2024-09-12T01:58:22.530550+0000","last_clean":"2024-09-12T01:58:22.530550+0000","last_became_active":"2024-09-12T01:56:40.806943+0000","last_became_peered":"2024-09-12T01:56:40.806943+0000","last_unstale":"2024-09-12T01:58:22.530550+0000","last_undegraded":"2024-09-12T01:58:22.530550+0000","last_fullsized":"2024-09-12T01:58:22.530550+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:28.021204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.535715+0000","last_change":"2024-09-12T01:56:37.752714+0000","last_active":"2024-09-12T01:58:23.535715+0000","last_peered":"2024-09-12T01:58:23.535715+0000","last_clean":"2024-09-12T01:58:23.535715+0000","last_became_active":"2024-09-12T01:56:37.752401+0000","last_became_peered":"2024-09-12T01:56:37.752401+0000","last_unstale":"2024-09-12T01:58:23.535715+0000","last_undegraded":"2024-09-12T01:58:23.535715+0000","last_fullsized":"2024-09-12T01:58:23.535715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:06.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.532218+0000","last_change":"2024-09-12T01:56:49.876369+0000","last_active":"2024-09-12T01:58:23.532218+0000","last_peered":"2024-09-12T01:58:23.532218+0000","last_clean":"2024-09-12T01:58:23.532218+0000","last_became_active":"2024-09-12T01:56:49.875573+0000","last_became_peered":"2024-09-12T01:56:49.875573+0000","last_unstale":"2024-09-12T01:58:23.532218+0000","last_undegraded":"2024-09-12T01:58:23.532218+0000","last_fullsized":"2024-09-12T01:58:23.532218+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:43.942369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947776+0000","last_change":"2024-09-12T01:56:40.807316+0000","last_active":"2024-09-12T01:57:22.947776+0000","last_peered":"2024-09-12T01:57:22.947776+0000","last_clean":"2024-09-12T01:57:22.947776+0000","last_became_active":"2024-09-12T01:56:40.806978+0000","last_became_peered":"2024-09-12T01:56:40.806978+0000","last_unstale":"2024-09-12T01:57:22.947776+0000","last_undegraded":"2024-09-12T01:57:22.947776+0000","last_fullsized":"2024-09-12T01:57:22.947776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:21.311099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530469+0000","last_change":"2024-09-12T01:56:37.752818+0000","last_active":"2024-09-12T01:58:22.530469+0000","last_peered":"2024-09-12T01:58:22.530469+0000","last_clean":"2024-09-12T01:58:22.530469+0000","last_became_active":"2024-09-12T01:56:37.752484+0000","last_became_peered":"2024-09-12T01:56:37.752484+0000","last_unstale":"2024-09-12T01:58:22.530469+0000","last_undegraded":"2024-09-12T01:58:22.530469+0000","last_fullsized":"2024-09-12T01:58:22.530469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.916149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.767452+0000","last_change":"2024-09-12T01:58:23.767452+0000","last_active":"2024-09-12T01:58:23.767452+0000","last_peered":"2024-09-12T01:58:23.767452+0000","last_clean":"2024-09-12T01:58:23.767452+0000","last_became_active":"2024-09-12T01:58:23.767021+0000","last_became_peered":"2024-09-12T01:58:23.767021+0000","last_unstale":"2024-09-12T01:58:23.767452+0000","last_undegraded":"2024-09-12T01:58:23.767452+0000","last_fullsized":"2024-09-12T01:58:23.767452+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:03.065667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,8],"acting":[9,3,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946096+0000","last_change":"2024-09-12T01:56:40.797909+0000","last_active":"2024-09-12T01:57:22.946096+0000","last_peered":"2024-09-12T01:57:22.946096+0000","last_clean":"2024-09-12T01:57:22.946096+0000","last_became_active":"2024-09-12T01:56:40.797534+0000","last_became_peered":"2024-09-12T01:56:40.797534+0000","last_unstale":"2024-09-12T01:57:22.946096+0000","last_undegraded":"2024-09-12T01:57:22.946096+0000","last_fullsized":"2024-09-12T01:57:22.946096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:57.262669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950706+0000","last_change":"2024-09-12T01:56:38.176597+0000","last_active":"2024-09-12T01:57:22.950706+0000","last_peered":"2024-09-12T01:57:22.950706+0000","last_clean":"2024-09-12T01:57:22.950706+0000","last_became_active":"2024-09-12T01:56:38.176225+0000","last_became_peered":"2024-09-12T01:56:38.176225+0000","last_unstale":"2024-09-12T01:57:22.950706+0000","last_undegraded":"2024-09-12T01:57:22.950706+0000","last_fullsized":"2024-09-12T01:57:22.950706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:51.401286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.532599+0000","last_change":"2024-09-12T01:56:49.881191+0000","last_active":"2024-09-12T01:58:23.532599+0000","last_peered":"2024-09-12T01:58:23.532599+0000","last_clean":"2024-09-12T01:58:23.532599+0000","last_became_active":"2024-09-12T01:56:49.880737+0000","last_became_peered":"2024-09-12T01:56:49.880737+0000","last_unstale":"2024-09-12T01:58:23.532599+0000","last_undegraded":"2024-09-12T01:58:23.532599+0000","last_fullsized":"2024-09-12T01:58:23.532599+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:33.842527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949625+0000","last_change":"2024-09-12T01:56:40.806688+0000","last_active":"2024-09-12T01:57:22.949625+0000","last_peered":"2024-09-12T01:57:22.949625+0000","last_clean":"2024-09-12T01:57:22.949625+0000","last_became_active":"2024-09-12T01:56:40.806221+0000","last_became_peered":"2024-09-12T01:56:40.806221+0000","last_unstale":"2024-09-12T01:57:22.949625+0000","last_undegraded":"2024-09-12T01:57:22.949625+0000","last_fullsized":"2024-09-12T01:57:22.949625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.888750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'2","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.532728+0000","last_change":"2024-09-12T01:56:37.882612+0000","last_active":"2024-09-12T01:58:23.532728+0000","last_peered":"2024-09-12T01:58:23.532728+0000","last_clean":"2024-09-12T01:58:23.532728+0000","last_became_active":"2024-09-12T01:56:37.882252+0000","last_became_peered":"2024-09-12T01:56:37.882252+0000","last_unstale":"2024-09-12T01:58:23.532728+0000","last_undegraded":"2024-09-12T01:58:23.532728+0000","last_fullsized":"2024-09-12T01:58:23.532728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:09.286264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.535794+0000","last_change":"2024-09-12T01:56:49.862073+0000","last_active":"2024-09-12T01:58:23.535794+0000","last_peered":"2024-09-12T01:58:23.535794+0000","last_clean":"2024-09-12T01:58:23.535794+0000","last_became_active":"2024-09-12T01:56:49.861586+0000","last_became_peered":"2024-09-12T01:56:49.861586+0000","last_unstale":"2024-09-12T01:58:23.535794+0000","last_undegraded":"2024-09-12T01:58:23.535794+0000","last_fullsized":"2024-09-12T01:58:23.535794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:51.503334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.531036+0000","last_change":"2024-09-12T01:56:40.803456+0000","last_active":"2024-09-12T01:58:22.531036+0000","last_peered":"2024-09-12T01:58:22.531036+0000","last_clean":"2024-09-12T01:58:22.531036+0000","last_became_active":"2024-09-12T01:56:40.797474+0000","last_became_peered":"2024-09-12T01:56:40.797474+0000","last_unstale":"2024-09-12T01:58:22.531036+0000","last_undegraded":"2024-09-12T01:58:22.531036+0000","last_fullsized":"2024-09-12T01:58:22.531036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:03.965692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'9","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.534545+0000","last_change":"2024-09-12T01:57:22.961059+0000","last_active":"2024-09-12T01:58:23.534545+0000","last_peered":"2024-09-12T01:58:23.534545+0000","last_clean":"2024-09-12T01:58:23.534545+0000","last_became_active":"2024-09-12T01:57:22.953667+0000","last_became_peered":"2024-09-12T01:57:22.953667+0000","last_unstale":"2024-09-12T01:58:23.534545+0000","last_undegraded":"2024-09-12T01:58:23.534545+0000","last_fullsized":"2024-09-12T01:58:23.534545+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:02.040016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530040+0000","last_change":"2024-09-12T01:56:49.881209+0000","last_active":"2024-09-12T01:58:22.530040+0000","last_peered":"2024-09-12T01:58:22.530040+0000","last_clean":"2024-09-12T01:58:22.530040+0000","last_became_active":"2024-09-12T01:56:49.880787+0000","last_became_peered":"2024-09-12T01:56:49.880787+0000","last_unstale":"2024-09-12T01:58:22.530040+0000","last_undegraded":"2024-09-12T01:58:22.530040+0000","last_fullsized":"2024-09-12T01:58:22.530040+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:55.432935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662587+0000","last_change":"2024-09-12T01:56:40.799664+0000","last_active":"2024-09-12T01:58:23.662587+0000","last_peered":"2024-09-12T01:58:23.662587+0000","last_clean":"2024-09-12T01:58:23.662587+0000","last_became_active":"2024-09-12T01:56:40.799174+0000","last_became_peered":"2024-09-12T01:56:40.799174+0000","last_unstale":"2024-09-12T01:58:23.662587+0000","last_undegraded":"2024-09-12T01:58:23.662587+0000","last_fullsized":"2024-09-12T01:58:23.662587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:37.347036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946779+0000","last_change":"2024-09-12T01:56:38.177277+0000","last_active":"2024-09-12T01:57:22.946779+0000","last_peered":"2024-09-12T01:57:22.946779+0000","last_clean":"2024-09-12T01:57:22.946779+0000","last_became_active":"2024-09-12T01:56:38.176532+0000","last_became_peered":"2024-09-12T01:56:38.176532+0000","last_unstale":"2024-09-12T01:57:22.946779+0000","last_undegraded":"2024-09-12T01:57:22.946779+0000","last_fullsized":"2024-09-12T01:57:22.946779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:19.424600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948386+0000","last_change":"2024-09-12T01:56:49.863474+0000","last_active":"2024-09-12T01:57:22.948386+0000","last_peered":"2024-09-12T01:57:22.948386+0000","last_clean":"2024-09-12T01:57:22.948386+0000","last_became_active":"2024-09-12T01:56:49.863019+0000","last_became_peered":"2024-09-12T01:56:49.863019+0000","last_unstale":"2024-09-12T01:57:22.948386+0000","last_undegraded":"2024-09-12T01:57:22.948386+0000","last_fullsized":"2024-09-12T01:57:22.948386+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:48.057450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480831+0000","last_change":"2024-09-12T01:56:40.808860+0000","last_active":"2024-09-12T01:57:23.480831+0000","last_peered":"2024-09-12T01:57:23.480831+0000","last_clean":"2024-09-12T01:57:23.480831+0000","last_became_active":"2024-09-12T01:56:40.808521+0000","last_became_peered":"2024-09-12T01:56:40.808521+0000","last_unstale":"2024-09-12T01:57:23.480831+0000","last_undegraded":"2024-09-12T01:57:23.480831+0000","last_fullsized":"2024-09-12T01:57:23.480831+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:11.026296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.534724+0000","last_change":"2024-09-12T01:56:38.176812+0000","last_active":"2024-09-12T01:58:23.534724+0000","last_peered":"2024-09-12T01:58:23.534724+0000","last_clean":"2024-09-12T01:58:23.534724+0000","last_became_active":"2024-09-12T01:56:38.176431+0000","last_became_peered":"2024-09-12T01:56:38.176431+0000","last_unstale":"2024-09-12T01:58:23.534724+0000","last_undegraded":"2024-09-12T01:58:23.534724+0000","last_fullsized":"2024-09-12T01:58:23.534724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:24.132211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946130+0000","last_change":"2024-09-12T01:56:49.881391+0000","last_active":"2024-09-12T01:57:22.946130+0000","last_peered":"2024-09-12T01:57:22.946130+0000","last_clean":"2024-09-12T01:57:22.946130+0000","last_became_active":"2024-09-12T01:56:49.880890+0000","last_became_peered":"2024-09-12T01:56:49.880890+0000","last_unstale":"2024-09-12T01:57:22.946130+0000","last_undegraded":"2024-09-12T01:57:22.946130+0000","last_fullsized":"2024-09-12T01:57:22.946130+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:29.633558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480762+0000","last_change":"2024-09-12T01:56:40.813468+0000","last_active":"2024-09-12T01:57:23.480762+0000","last_peered":"2024-09-12T01:57:23.480762+0000","last_clean":"2024-09-12T01:57:23.480762+0000","last_became_active":"2024-09-12T01:56:40.813121+0000","last_became_peered":"2024-09-12T01:56:40.813121+0000","last_unstale":"2024-09-12T01:57:23.480762+0000","last_undegraded":"2024-09-12T01:57:23.480762+0000","last_fullsized":"2024-09-12T01:57:23.480762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:13.633672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.813089+0000","last_change":"2024-09-12T01:56:37.751076+0000","last_active":"2024-09-12T01:58:23.813089+0000","last_peered":"2024-09-12T01:58:23.813089+0000","last_clean":"2024-09-12T01:58:23.813089+0000","last_became_active":"2024-09-12T01:56:37.750730+0000","last_became_peered":"2024-09-12T01:56:37.750730+0000","last_unstale":"2024-09-12T01:58:23.813089+0000","last_undegraded":"2024-09-12T01:58:23.813089+0000","last_fullsized":"2024-09-12T01:58:23.813089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:33.791431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662419+0000","last_change":"2024-09-12T01:56:49.870381+0000","last_active":"2024-09-12T01:58:23.662419+0000","last_peered":"2024-09-12T01:58:23.662419+0000","last_clean":"2024-09-12T01:58:23.662419+0000","last_became_active":"2024-09-12T01:56:49.869787+0000","last_became_peered":"2024-09-12T01:56:49.869787+0000","last_unstale":"2024-09-12T01:58:23.662419+0000","last_undegraded":"2024-09-12T01:58:23.662419+0000","last_fullsized":"2024-09-12T01:58:23.662419+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:01.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.533142+0000","last_change":"2024-09-12T01:57:22.955352+0000","last_active":"2024-09-12T01:58:23.533142+0000","last_peered":"2024-09-12T01:58:23.533142+0000","last_clean":"2024-09-12T01:58:23.533142+0000","last_became_active":"2024-09-12T01:57:22.954949+0000","last_became_peered":"2024-09-12T01:57:22.954949+0000","last_unstale":"2024-09-12T01:58:23.533142+0000","last_undegraded":"2024-09-12T01:58:23.533142+0000","last_fullsized":"2024-09-12T01:58:23.533142+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:38.707897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662150+0000","last_change":"2024-09-12T01:56:38.174983+0000","last_active":"2024-09-12T01:58:23.662150+0000","last_peered":"2024-09-12T01:58:23.662150+0000","last_clean":"2024-09-12T01:58:23.662150+0000","last_became_active":"2024-09-12T01:56:38.174578+0000","last_became_peered":"2024-09-12T01:56:38.174578+0000","last_unstale":"2024-09-12T01:58:23.662150+0000","last_undegraded":"2024-09-12T01:58:23.662150+0000","last_fullsized":"2024-09-12T01:58:23.662150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:44.629321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662429+0000","last_change":"2024-09-12T01:56:49.881829+0000","last_active":"2024-09-12T01:58:23.662429+0000","last_peered":"2024-09-12T01:58:23.662429+0000","last_clean":"2024-09-12T01:58:23.662429+0000","last_became_active":"2024-09-12T01:56:49.881373+0000","last_became_peered":"2024-09-12T01:56:49.881373+0000","last_unstale":"2024-09-12T01:58:23.662429+0000","last_undegraded":"2024-09-12T01:58:23.662429+0000","last_fullsized":"2024-09-12T01:58:23.662429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:36.706558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662008+0000","last_change":"2024-09-12T01:56:40.810202+0000","last_active":"2024-09-12T01:58:23.662008+0000","last_peered":"2024-09-12T01:58:23.662008+0000","last_clean":"2024-09-12T01:58:23.662008+0000","last_became_active":"2024-09-12T01:56:40.808567+0000","last_became_peered":"2024-09-12T01:56:40.808567+0000","last_unstale":"2024-09-12T01:58:23.662008+0000","last_undegraded":"2024-09-12T01:58:23.662008+0000","last_fullsized":"2024-09-12T01:58:23.662008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:49.157369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.813703+0000","last_change":"2024-09-12T01:56:37.753459+0000","last_active":"2024-09-12T01:58:23.813703+0000","last_peered":"2024-09-12T01:58:23.813703+0000","last_clean":"2024-09-12T01:58:23.813703+0000","last_became_active":"2024-09-12T01:56:37.753129+0000","last_became_peered":"2024-09-12T01:56:37.753129+0000","last_unstale":"2024-09-12T01:58:23.813703+0000","last_undegraded":"2024-09-12T01:58:23.813703+0000","last_fullsized":"2024-09-12T01:58:23.813703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:47.841217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812574+0000","last_change":"2024-09-12T01:56:49.881600+0000","last_active":"2024-09-12T01:58:23.812574+0000","last_peered":"2024-09-12T01:58:23.812574+0000","last_clean":"2024-09-12T01:58:23.812574+0000","last_became_active":"2024-09-12T01:56:49.881116+0000","last_became_peered":"2024-09-12T01:56:49.881116+0000","last_unstale":"2024-09-12T01:58:23.812574+0000","last_undegraded":"2024-09-12T01:58:23.812574+0000","last_fullsized":"2024-09-12T01:58:23.812574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:42.515473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530335+0000","last_change":"2024-09-12T01:56:40.796878+0000","last_active":"2024-09-12T01:58:22.530335+0000","last_peered":"2024-09-12T01:58:22.530335+0000","last_clean":"2024-09-12T01:58:22.530335+0000","last_became_active":"2024-09-12T01:56:40.795031+0000","last_became_peered":"2024-09-12T01:56:40.795031+0000","last_unstale":"2024-09-12T01:58:22.530335+0000","last_undegraded":"2024-09-12T01:58:22.530335+0000","last_fullsized":"2024-09-12T01:58:22.530335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:02.497135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.532951+0000","last_change":"2024-09-12T01:56:37.754379+0000","last_active":"2024-09-12T01:58:23.532951+0000","last_peered":"2024-09-12T01:58:23.532951+0000","last_clean":"2024-09-12T01:58:23.532951+0000","last_became_active":"2024-09-12T01:56:37.753986+0000","last_became_peered":"2024-09-12T01:56:37.753986+0000","last_unstale":"2024-09-12T01:58:23.532951+0000","last_undegraded":"2024-09-12T01:58:23.532951+0000","last_fullsized":"2024-09-12T01:58:23.532951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:09.877482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":364,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.814104+0000","last_change":"2024-09-12T01:55:24.577685+0000","last_active":"2024-09-12T01:58:23.814104+0000","last_peered":"2024-09-12T01:58:23.814104+0000","last_clean":"2024-09-12T01:58:23.814104+0000","last_became_active":"2024-09-12T01:55:24.577248+0000","last_became_peered":"2024-09-12T01:55:24.577248+0000","last_unstale":"2024-09-12T01:58:23.814104+0000","last_undegraded":"2024-09-12T01:58:23.814104+0000","last_fullsized":"2024-09-12T01:58:23.814104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:51:44.081524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:51:44.081524+0000","last_clean_scrub_stamp":"2024-09-12T01:51:44.081524+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:25.146507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.813445+0000","last_change":"2024-09-12T01:56:49.872339+0000","last_active":"2024-09-12T01:58:23.813445+0000","last_peered":"2024-09-12T01:58:23.813445+0000","last_clean":"2024-09-12T01:58:23.813445+0000","last_became_active":"2024-09-12T01:56:49.872035+0000","last_became_peered":"2024-09-12T01:56:49.872035+0000","last_unstale":"2024-09-12T01:58:23.813445+0000","last_undegraded":"2024-09-12T01:58:23.813445+0000","last_fullsized":"2024-09-12T01:58:23.813445+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:28.512384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.813856+0000","last_change":"2024-09-12T01:56:40.805832+0000","last_active":"2024-09-12T01:58:23.813856+0000","last_peered":"2024-09-12T01:58:23.813856+0000","last_clean":"2024-09-12T01:58:23.813856+0000","last_became_active":"2024-09-12T01:56:40.805407+0000","last_became_peered":"2024-09-12T01:56:40.805407+0000","last_unstale":"2024-09-12T01:58:23.813856+0000","last_undegraded":"2024-09-12T01:58:23.813856+0000","last_fullsized":"2024-09-12T01:58:23.813856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:36.699461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.958274+0000","last_change":"2024-09-12T01:57:22.958274+0000","last_active":"2024-09-12T01:57:22.958274+0000","last_peered":"2024-09-12T01:57:22.958274+0000","last_clean":"2024-09-12T01:57:22.958274+0000","last_became_active":"2024-09-12T01:57:22.957927+0000","last_became_peered":"2024-09-12T01:57:22.957927+0000","last_unstale":"2024-09-12T01:57:22.958274+0000","last_undegraded":"2024-09-12T01:57:22.958274+0000","last_fullsized":"2024-09-12T01:57:22.958274+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:58.031082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950975+0000","last_change":"2024-09-12T01:56:49.863237+0000","last_active":"2024-09-12T01:57:22.950975+0000","last_peered":"2024-09-12T01:57:22.950975+0000","last_clean":"2024-09-12T01:57:22.950975+0000","last_became_active":"2024-09-12T01:56:49.862831+0000","last_became_peered":"2024-09-12T01:56:49.862831+0000","last_unstale":"2024-09-12T01:57:22.950975+0000","last_undegraded":"2024-09-12T01:57:22.950975+0000","last_fullsized":"2024-09-12T01:57:22.950975+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:45.970500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.813339+0000","last_change":"2024-09-12T01:56:40.806634+0000","last_active":"2024-09-12T01:58:23.813339+0000","last_peered":"2024-09-12T01:58:23.813339+0000","last_clean":"2024-09-12T01:58:23.813339+0000","last_became_active":"2024-09-12T01:56:40.806308+0000","last_became_peered":"2024-09-12T01:56:40.806308+0000","last_unstale":"2024-09-12T01:58:23.813339+0000","last_undegraded":"2024-09-12T01:58:23.813339+0000","last_fullsized":"2024-09-12T01:58:23.813339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:46.800939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812830+0000","last_change":"2024-09-12T01:56:37.752897+0000","last_active":"2024-09-12T01:58:23.812830+0000","last_peered":"2024-09-12T01:58:23.812830+0000","last_clean":"2024-09-12T01:58:23.812830+0000","last_became_active":"2024-09-12T01:56:37.752612+0000","last_became_peered":"2024-09-12T01:56:37.752612+0000","last_unstale":"2024-09-12T01:58:23.812830+0000","last_undegraded":"2024-09-12T01:58:23.812830+0000","last_fullsized":"2024-09-12T01:58:23.812830+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:16.690620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949456+0000","last_change":"2024-09-12T01:56:49.876113+0000","last_active":"2024-09-12T01:57:22.949456+0000","last_peered":"2024-09-12T01:57:22.949456+0000","last_clean":"2024-09-12T01:57:22.949456+0000","last_became_active":"2024-09-12T01:56:49.875743+0000","last_became_peered":"2024-09-12T01:56:49.875743+0000","last_unstale":"2024-09-12T01:57:22.949456+0000","last_undegraded":"2024-09-12T01:57:22.949456+0000","last_fullsized":"2024-09-12T01:57:22.949456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:20.818024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.813745+0000","last_change":"2024-09-12T01:56:40.799329+0000","last_active":"2024-09-12T01:58:23.813745+0000","last_peered":"2024-09-12T01:58:23.813745+0000","last_clean":"2024-09-12T01:58:23.813745+0000","last_became_active":"2024-09-12T01:56:40.798999+0000","last_became_peered":"2024-09-12T01:56:40.798999+0000","last_unstale":"2024-09-12T01:58:23.813745+0000","last_undegraded":"2024-09-12T01:58:23.813745+0000","last_fullsized":"2024-09-12T01:58:23.813745+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:33.291045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662789+0000","last_change":"2024-09-12T01:57:22.963796+0000","last_active":"2024-09-12T01:58:23.662789+0000","last_peered":"2024-09-12T01:58:23.662789+0000","last_clean":"2024-09-12T01:58:23.662789+0000","last_became_active":"2024-09-12T01:57:22.958887+0000","last_became_peered":"2024-09-12T01:57:22.958887+0000","last_unstale":"2024-09-12T01:58:23.662789+0000","last_undegraded":"2024-09-12T01:58:23.662789+0000","last_fullsized":"2024-09-12T01:58:23.662789+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:57.272630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.811826+0000","last_change":"2024-09-12T01:56:49.864958+0000","last_active":"2024-09-12T01:58:23.811826+0000","last_peered":"2024-09-12T01:58:23.811826+0000","last_clean":"2024-09-12T01:58:23.811826+0000","last_became_active":"2024-09-12T01:56:49.864564+0000","last_became_peered":"2024-09-12T01:56:49.864564+0000","last_unstale":"2024-09-12T01:58:23.811826+0000","last_undegraded":"2024-09-12T01:58:23.811826+0000","last_fullsized":"2024-09-12T01:58:23.811826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:20.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948473+0000","last_change":"2024-09-12T01:56:40.799887+0000","last_active":"2024-09-12T01:57:22.948473+0000","last_peered":"2024-09-12T01:57:22.948473+0000","last_clean":"2024-09-12T01:57:22.948473+0000","last_became_active":"2024-09-12T01:56:40.799561+0000","last_became_peered":"2024-09-12T01:56:40.799561+0000","last_unstale":"2024-09-12T01:57:22.948473+0000","last_undegraded":"2024-09-12T01:57:22.948473+0000","last_fullsized":"2024-09-12T01:57:22.948473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:25.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946890+0000","last_change":"2024-09-12T01:56:37.746147+0000","last_active":"2024-09-12T01:57:22.946890+0000","last_peered":"2024-09-12T01:57:22.946890+0000","last_clean":"2024-09-12T01:57:22.946890+0000","last_became_active":"2024-09-12T01:56:37.745810+0000","last_became_peered":"2024-09-12T01:56:37.745810+0000","last_unstale":"2024-09-12T01:57:22.946890+0000","last_undegraded":"2024-09-12T01:57:22.946890+0000","last_fullsized":"2024-09-12T01:57:22.946890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:09.304520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.811816+0000","last_change":"2024-09-12T01:56:49.869301+0000","last_active":"2024-09-12T01:58:23.811816+0000","last_peered":"2024-09-12T01:58:23.811816+0000","last_clean":"2024-09-12T01:58:23.811816+0000","last_became_active":"2024-09-12T01:56:49.868883+0000","last_became_peered":"2024-09-12T01:56:49.868883+0000","last_unstale":"2024-09-12T01:58:23.811816+0000","last_undegraded":"2024-09-12T01:58:23.811816+0000","last_fullsized":"2024-09-12T01:58:23.811816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:11.110423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.811991+0000","last_change":"2024-09-12T01:56:40.808574+0000","last_active":"2024-09-12T01:58:23.811991+0000","last_peered":"2024-09-12T01:58:23.811991+0000","last_clean":"2024-09-12T01:58:23.811991+0000","last_became_active":"2024-09-12T01:56:40.808257+0000","last_became_peered":"2024-09-12T01:56:40.808257+0000","last_unstale":"2024-09-12T01:58:23.811991+0000","last_undegraded":"2024-09-12T01:58:23.811991+0000","last_fullsized":"2024-09-12T01:58:23.811991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:58.375055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946185+0000","last_change":"2024-09-12T01:56:38.177026+0000","last_active":"2024-09-12T01:57:22.946185+0000","last_peered":"2024-09-12T01:57:22.946185+0000","last_clean":"2024-09-12T01:57:22.946185+0000","last_became_active":"2024-09-12T01:56:38.176566+0000","last_became_peered":"2024-09-12T01:56:38.176566+0000","last_unstale":"2024-09-12T01:57:22.946185+0000","last_undegraded":"2024-09-12T01:57:22.946185+0000","last_fullsized":"2024-09-12T01:57:22.946185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:53.167228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662755+0000","last_change":"2024-09-12T01:56:49.876297+0000","last_active":"2024-09-12T01:58:23.662755+0000","last_peered":"2024-09-12T01:58:23.662755+0000","last_clean":"2024-09-12T01:58:23.662755+0000","last_became_active":"2024-09-12T01:56:49.875765+0000","last_became_peered":"2024-09-12T01:56:49.875765+0000","last_unstale":"2024-09-12T01:58:23.662755+0000","last_undegraded":"2024-09-12T01:58:23.662755+0000","last_fullsized":"2024-09-12T01:58:23.662755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:55.104025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.813511+0000","last_change":"2024-09-12T01:56:40.801653+0000","last_active":"2024-09-12T01:58:23.813511+0000","last_peered":"2024-09-12T01:58:23.813511+0000","last_clean":"2024-09-12T01:58:23.813511+0000","last_became_active":"2024-09-12T01:56:40.801348+0000","last_became_peered":"2024-09-12T01:56:40.801348+0000","last_unstale":"2024-09-12T01:58:23.813511+0000","last_undegraded":"2024-09-12T01:58:23.813511+0000","last_fullsized":"2024-09-12T01:58:23.813511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:59.076443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.532272+0000","last_change":"2024-09-12T01:56:37.749817+0000","last_active":"2024-09-12T01:58:23.532272+0000","last_peered":"2024-09-12T01:58:23.532272+0000","last_clean":"2024-09-12T01:58:23.532272+0000","last_became_active":"2024-09-12T01:56:37.749431+0000","last_became_peered":"2024-09-12T01:56:37.749431+0000","last_unstale":"2024-09-12T01:58:23.532272+0000","last_undegraded":"2024-09-12T01:58:23.532272+0000","last_fullsized":"2024-09-12T01:58:23.532272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:13.193083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.534802+0000","last_change":"2024-09-12T01:56:49.877371+0000","last_active":"2024-09-12T01:58:23.534802+0000","last_peered":"2024-09-12T01:58:23.534802+0000","last_clean":"2024-09-12T01:58:23.534802+0000","last_became_active":"2024-09-12T01:56:49.873147+0000","last_became_peered":"2024-09-12T01:56:49.873147+0000","last_unstale":"2024-09-12T01:58:23.534802+0000","last_undegraded":"2024-09-12T01:58:23.534802+0000","last_fullsized":"2024-09-12T01:58:23.534802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:23.215058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812902+0000","last_change":"2024-09-12T01:57:22.958641+0000","last_active":"2024-09-12T01:58:23.812902+0000","last_peered":"2024-09-12T01:58:23.812902+0000","last_clean":"2024-09-12T01:58:23.812902+0000","last_became_active":"2024-09-12T01:57:22.958274+0000","last_became_peered":"2024-09-12T01:57:22.958274+0000","last_unstale":"2024-09-12T01:58:23.812902+0000","last_undegraded":"2024-09-12T01:58:23.812902+0000","last_fullsized":"2024-09-12T01:58:23.812902+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:22.529517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812437+0000","last_change":"2024-09-12T01:56:37.751527+0000","last_active":"2024-09-12T01:58:23.812437+0000","last_peered":"2024-09-12T01:58:23.812437+0000","last_clean":"2024-09-12T01:58:23.812437+0000","last_became_active":"2024-09-12T01:56:37.751190+0000","last_became_peered":"2024-09-12T01:56:37.751190+0000","last_unstale":"2024-09-12T01:58:23.812437+0000","last_undegraded":"2024-09-12T01:58:23.812437+0000","last_fullsized":"2024-09-12T01:58:23.812437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:01.917812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948103+0000","last_change":"2024-09-12T01:56:49.873101+0000","last_active":"2024-09-12T01:57:22.948103+0000","last_peered":"2024-09-12T01:57:22.948103+0000","last_clean":"2024-09-12T01:57:22.948103+0000","last_became_active":"2024-09-12T01:56:49.872670+0000","last_became_peered":"2024-09-12T01:56:49.872670+0000","last_unstale":"2024-09-12T01:57:22.948103+0000","last_undegraded":"2024-09-12T01:57:22.948103+0000","last_fullsized":"2024-09-12T01:57:22.948103+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.794244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662339+0000","last_change":"2024-09-12T01:56:40.805982+0000","last_active":"2024-09-12T01:58:23.662339+0000","last_peered":"2024-09-12T01:58:23.662339+0000","last_clean":"2024-09-12T01:58:23.662339+0000","last_became_active":"2024-09-12T01:56:40.805653+0000","last_became_peered":"2024-09-12T01:56:40.805653+0000","last_unstale":"2024-09-12T01:58:23.662339+0000","last_undegraded":"2024-09-12T01:58:23.662339+0000","last_fullsized":"2024-09-12T01:58:23.662339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:37.117089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'2","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.535777+0000","last_change":"2024-09-12T01:56:37.753569+0000","last_active":"2024-09-12T01:58:23.535777+0000","last_peered":"2024-09-12T01:58:23.535777+0000","last_clean":"2024-09-12T01:58:23.535777+0000","last_became_active":"2024-09-12T01:56:37.753153+0000","last_became_peered":"2024-09-12T01:56:37.753153+0000","last_unstale":"2024-09-12T01:58:23.535777+0000","last_undegraded":"2024-09-12T01:58:23.535777+0000","last_fullsized":"2024-09-12T01:58:23.535777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:33.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812482+0000","last_change":"2024-09-12T01:56:49.866532+0000","last_active":"2024-09-12T01:58:23.812482+0000","last_peered":"2024-09-12T01:58:23.812482+0000","last_clean":"2024-09-12T01:58:23.812482+0000","last_became_active":"2024-09-12T01:56:49.866114+0000","last_became_peered":"2024-09-12T01:56:49.866114+0000","last_unstale":"2024-09-12T01:58:23.812482+0000","last_undegraded":"2024-09-12T01:58:23.812482+0000","last_fullsized":"2024-09-12T01:58:23.812482+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:03.241292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946624+0000","last_change":"2024-09-12T01:56:40.799319+0000","last_active":"2024-09-12T01:57:22.946624+0000","last_peered":"2024-09-12T01:57:22.946624+0000","last_clean":"2024-09-12T01:57:22.946624+0000","last_became_active":"2024-09-12T01:56:40.798949+0000","last_became_peered":"2024-09-12T01:56:40.798949+0000","last_unstale":"2024-09-12T01:57:22.946624+0000","last_undegraded":"2024-09-12T01:57:22.946624+0000","last_fullsized":"2024-09-12T01:57:22.946624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:01.254059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'33","reported_seq":196,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:58:21.057189+0000","last_change":"2024-09-12T01:56:37.750425+0000","last_active":"2024-09-12T01:58:21.057189+0000","last_peered":"2024-09-12T01:58:21.057189+0000","last_clean":"2024-09-12T01:58:21.057189+0000","last_became_active":"2024-09-12T01:56:37.749995+0000","last_became_peered":"2024-09-12T01:56:37.749995+0000","last_unstale":"2024-09-12T01:58:21.057189+0000","last_undegraded":"2024-09-12T01:58:21.057189+0000","last_fullsized":"2024-09-12T01:58:21.057189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:53.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65131,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":126,"num_write":33,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.533734+0000","last_change":"2024-09-12T01:56:49.872968+0000","last_active":"2024-09-12T01:58:23.533734+0000","last_peered":"2024-09-12T01:58:23.533734+0000","last_clean":"2024-09-12T01:58:23.533734+0000","last_became_active":"2024-09-12T01:56:49.872537+0000","last_became_peered":"2024-09-12T01:56:49.872537+0000","last_unstale":"2024-09-12T01:58:23.533734+0000","last_undegraded":"2024-09-12T01:58:23.533734+0000","last_fullsized":"2024-09-12T01:58:23.533734+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:05.684396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951183+0000","last_change":"2024-09-12T01:56:40.808116+0000","last_active":"2024-09-12T01:57:22.951183+0000","last_peered":"2024-09-12T01:57:22.951183+0000","last_clean":"2024-09-12T01:57:22.951183+0000","last_became_active":"2024-09-12T01:56:40.807763+0000","last_became_peered":"2024-09-12T01:56:40.807763+0000","last_unstale":"2024-09-12T01:57:22.951183+0000","last_undegraded":"2024-09-12T01:57:22.951183+0000","last_fullsized":"2024-09-12T01:57:22.951183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:24.553929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'3","reported_seq":44,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812748+0000","last_change":"2024-09-12T01:56:38.177027+0000","last_active":"2024-09-12T01:58:23.812748+0000","last_peered":"2024-09-12T01:58:23.812748+0000","last_clean":"2024-09-12T01:58:23.812748+0000","last_became_active":"2024-09-12T01:56:38.176610+0000","last_became_peered":"2024-09-12T01:56:38.176610+0000","last_unstale":"2024-09-12T01:58:23.812748+0000","last_undegraded":"2024-09-12T01:58:23.812748+0000","last_fullsized":"2024-09-12T01:58:23.812748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:18.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.814362+0000","last_change":"2024-09-12T01:58:23.814362+0000","last_active":"2024-09-12T01:58:23.814362+0000","last_peered":"2024-09-12T01:58:23.814362+0000","last_clean":"2024-09-12T01:58:23.814362+0000","last_became_active":"2024-09-12T01:58:23.813892+0000","last_became_peered":"2024-09-12T01:58:23.813892+0000","last_unstale":"2024-09-12T01:58:23.814362+0000","last_undegraded":"2024-09-12T01:58:23.814362+0000","last_fullsized":"2024-09-12T01:58:23.814362+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:22.564093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.482387+0000","last_change":"2024-09-12T01:57:23.482387+0000","last_active":"2024-09-12T01:57:23.482387+0000","last_peered":"2024-09-12T01:57:23.482387+0000","last_clean":"2024-09-12T01:57:23.482387+0000","last_became_active":"2024-09-12T01:57:23.481842+0000","last_became_peered":"2024-09-12T01:57:23.481842+0000","last_unstale":"2024-09-12T01:57:23.482387+0000","last_undegraded":"2024-09-12T01:57:23.482387+0000","last_fullsized":"2024-09-12T01:57:23.482387+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:40.227322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.813653+0000","last_change":"2024-09-12T01:56:37.749911+0000","last_active":"2024-09-12T01:58:23.813653+0000","last_peered":"2024-09-12T01:58:23.813653+0000","last_clean":"2024-09-12T01:58:23.813653+0000","last_became_active":"2024-09-12T01:56:37.749565+0000","last_became_peered":"2024-09-12T01:56:37.749565+0000","last_unstale":"2024-09-12T01:58:23.813653+0000","last_undegraded":"2024-09-12T01:58:23.813653+0000","last_fullsized":"2024-09-12T01:58:23.813653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:33.462391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.533163+0000","last_change":"2024-09-12T01:56:49.873274+0000","last_active":"2024-09-12T01:58:23.533163+0000","last_peered":"2024-09-12T01:58:23.533163+0000","last_clean":"2024-09-12T01:58:23.533163+0000","last_became_active":"2024-09-12T01:56:49.872769+0000","last_became_peered":"2024-09-12T01:56:49.872769+0000","last_unstale":"2024-09-12T01:58:23.533163+0000","last_undegraded":"2024-09-12T01:58:23.533163+0000","last_fullsized":"2024-09-12T01:58:23.533163+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:04.288198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951512+0000","last_change":"2024-09-12T01:56:40.798008+0000","last_active":"2024-09-12T01:57:22.951512+0000","last_peered":"2024-09-12T01:57:22.951512+0000","last_clean":"2024-09-12T01:57:22.951512+0000","last_became_active":"2024-09-12T01:56:40.797607+0000","last_became_peered":"2024-09-12T01:56:40.797607+0000","last_unstale":"2024-09-12T01:57:22.951512+0000","last_undegraded":"2024-09-12T01:57:22.951512+0000","last_fullsized":"2024-09-12T01:57:22.951512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.738161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481088+0000","last_change":"2024-09-12T01:56:37.754607+0000","last_active":"2024-09-12T01:57:23.481088+0000","last_peered":"2024-09-12T01:57:23.481088+0000","last_clean":"2024-09-12T01:57:23.481088+0000","last_became_active":"2024-09-12T01:56:37.754311+0000","last_became_peered":"2024-09-12T01:56:37.754311+0000","last_unstale":"2024-09-12T01:57:23.481088+0000","last_undegraded":"2024-09-12T01:57:23.481088+0000","last_fullsized":"2024-09-12T01:57:23.481088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:05.597502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530144+0000","last_change":"2024-09-12T01:56:49.860561+0000","last_active":"2024-09-12T01:58:22.530144+0000","last_peered":"2024-09-12T01:58:22.530144+0000","last_clean":"2024-09-12T01:58:22.530144+0000","last_became_active":"2024-09-12T01:56:49.860149+0000","last_became_peered":"2024-09-12T01:56:49.860149+0000","last_unstale":"2024-09-12T01:58:22.530144+0000","last_undegraded":"2024-09-12T01:58:22.530144+0000","last_fullsized":"2024-09-12T01:58:22.530144+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:19.590143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949432+0000","last_change":"2024-09-12T01:56:49.868171+0000","last_active":"2024-09-12T01:57:22.949432+0000","last_peered":"2024-09-12T01:57:22.949432+0000","last_clean":"2024-09-12T01:57:22.949432+0000","last_became_active":"2024-09-12T01:56:49.867729+0000","last_became_peered":"2024-09-12T01:56:49.867729+0000","last_unstale":"2024-09-12T01:57:22.949432+0000","last_undegraded":"2024-09-12T01:57:22.949432+0000","last_fullsized":"2024-09-12T01:57:22.949432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:48.599568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.533789+0000","last_change":"2024-09-12T01:56:40.807872+0000","last_active":"2024-09-12T01:58:23.533789+0000","last_peered":"2024-09-12T01:58:23.533789+0000","last_clean":"2024-09-12T01:58:23.533789+0000","last_became_active":"2024-09-12T01:56:40.807422+0000","last_became_peered":"2024-09-12T01:56:40.807422+0000","last_unstale":"2024-09-12T01:58:23.533789+0000","last_undegraded":"2024-09-12T01:58:23.533789+0000","last_fullsized":"2024-09-12T01:58:23.533789+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.679501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812164+0000","last_change":"2024-09-12T01:56:37.750758+0000","last_active":"2024-09-12T01:58:23.812164+0000","last_peered":"2024-09-12T01:58:23.812164+0000","last_clean":"2024-09-12T01:58:23.812164+0000","last_became_active":"2024-09-12T01:56:37.750455+0000","last_became_peered":"2024-09-12T01:56:37.750455+0000","last_unstale":"2024-09-12T01:58:23.812164+0000","last_undegraded":"2024-09-12T01:58:23.812164+0000","last_fullsized":"2024-09-12T01:58:23.812164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:44.279233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948593+0000","last_change":"2024-09-12T01:56:49.877992+0000","last_active":"2024-09-12T01:57:22.948593+0000","last_peered":"2024-09-12T01:57:22.948593+0000","last_clean":"2024-09-12T01:57:22.948593+0000","last_became_active":"2024-09-12T01:56:49.877682+0000","last_became_peered":"2024-09-12T01:56:49.877682+0000","last_unstale":"2024-09-12T01:57:22.948593+0000","last_undegraded":"2024-09-12T01:57:22.948593+0000","last_fullsized":"2024-09-12T01:57:22.948593+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:28.326232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530200+0000","last_change":"2024-09-12T01:56:40.803688+0000","last_active":"2024-09-12T01:58:22.530200+0000","last_peered":"2024-09-12T01:58:22.530200+0000","last_clean":"2024-09-12T01:58:22.530200+0000","last_became_active":"2024-09-12T01:56:40.797538+0000","last_became_peered":"2024-09-12T01:56:40.797538+0000","last_unstale":"2024-09-12T01:58:22.530200+0000","last_undegraded":"2024-09-12T01:58:22.530200+0000","last_fullsized":"2024-09-12T01:58:22.530200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:19.309770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662020+0000","last_change":"2024-09-12T01:56:37.756077+0000","last_active":"2024-09-12T01:58:23.662020+0000","last_peered":"2024-09-12T01:58:23.662020+0000","last_clean":"2024-09-12T01:58:23.662020+0000","last_became_active":"2024-09-12T01:56:37.754873+0000","last_became_peered":"2024-09-12T01:56:37.754873+0000","last_unstale":"2024-09-12T01:58:23.662020+0000","last_undegraded":"2024-09-12T01:58:23.662020+0000","last_fullsized":"2024-09-12T01:58:23.662020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:38.889020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480689+0000","last_change":"2024-09-12T01:56:37.752122+0000","last_active":"2024-09-12T01:57:23.480689+0000","last_peered":"2024-09-12T01:57:23.480689+0000","last_clean":"2024-09-12T01:57:23.480689+0000","last_became_active":"2024-09-12T01:56:37.751690+0000","last_became_peered":"2024-09-12T01:56:37.751690+0000","last_unstale":"2024-09-12T01:57:23.480689+0000","last_undegraded":"2024-09-12T01:57:23.480689+0000","last_fullsized":"2024-09-12T01:57:23.480689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:37.768660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812304+0000","last_change":"2024-09-12T01:56:40.800079+0000","last_active":"2024-09-12T01:58:23.812304+0000","last_peered":"2024-09-12T01:58:23.812304+0000","last_clean":"2024-09-12T01:58:23.812304+0000","last_became_active":"2024-09-12T01:56:40.799766+0000","last_became_peered":"2024-09-12T01:56:40.799766+0000","last_unstale":"2024-09-12T01:58:23.812304+0000","last_undegraded":"2024-09-12T01:58:23.812304+0000","last_fullsized":"2024-09-12T01:58:23.812304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:32.211511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.814632+0000","last_change":"2024-09-12T01:58:23.814632+0000","last_active":"2024-09-12T01:58:23.814632+0000","last_peered":"2024-09-12T01:58:23.814632+0000","last_clean":"2024-09-12T01:58:23.814632+0000","last_became_active":"2024-09-12T01:58:23.814122+0000","last_became_peered":"2024-09-12T01:58:23.814122+0000","last_unstale":"2024-09-12T01:58:23.814632+0000","last_undegraded":"2024-09-12T01:58:23.814632+0000","last_fullsized":"2024-09-12T01:58:23.814632+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:20.515911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,10,5],"acting":[2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'1","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812397+0000","last_change":"2024-09-12T01:56:37.751251+0000","last_active":"2024-09-12T01:58:23.812397+0000","last_peered":"2024-09-12T01:58:23.812397+0000","last_clean":"2024-09-12T01:58:23.812397+0000","last_became_active":"2024-09-12T01:56:37.750886+0000","last_became_peered":"2024-09-12T01:56:37.750886+0000","last_unstale":"2024-09-12T01:58:23.812397+0000","last_undegraded":"2024-09-12T01:58:23.812397+0000","last_fullsized":"2024-09-12T01:58:23.812397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:36.734798+0000","last_clean_scrub_stamp":"2024-09-12T01:56:36.734798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.377703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946203+0000","last_change":"2024-09-12T01:56:40.800259+0000","last_active":"2024-09-12T01:57:22.946203+0000","last_peered":"2024-09-12T01:57:22.946203+0000","last_clean":"2024-09-12T01:57:22.946203+0000","last_became_active":"2024-09-12T01:56:40.799892+0000","last_became_peered":"2024-09-12T01:56:40.799892+0000","last_unstale":"2024-09-12T01:57:22.946203+0000","last_undegraded":"2024-09-12T01:57:22.946203+0000","last_fullsized":"2024-09-12T01:57:22.946203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:59.402783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.535661+0000","last_change":"2024-09-12T01:56:49.864057+0000","last_active":"2024-09-12T01:58:23.535661+0000","last_peered":"2024-09-12T01:58:23.535661+0000","last_clean":"2024-09-12T01:58:23.535661+0000","last_became_active":"2024-09-12T01:56:49.863033+0000","last_became_peered":"2024-09-12T01:56:49.863033+0000","last_unstale":"2024-09-12T01:58:23.535661+0000","last_undegraded":"2024-09-12T01:58:23.535661+0000","last_fullsized":"2024-09-12T01:58:23.535661+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:48.828897+0000","last_clean_scrub_stamp":"2024-09-12T01:56:48.828897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:11.134060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.947710+0000","last_change":"2024-09-12T01:56:40.800392+0000","last_active":"2024-09-12T01:57:22.947710+0000","last_peered":"2024-09-12T01:57:22.947710+0000","last_clean":"2024-09-12T01:57:22.947710+0000","last_became_active":"2024-09-12T01:56:40.800042+0000","last_became_peered":"2024-09-12T01:56:40.800042+0000","last_unstale":"2024-09-12T01:57:22.947710+0000","last_undegraded":"2024-09-12T01:57:22.947710+0000","last_fullsized":"2024-09-12T01:57:22.947710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:15.543600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.536001+0000","last_change":"2024-09-12T01:56:40.806231+0000","last_active":"2024-09-12T01:58:23.536001+0000","last_peered":"2024-09-12T01:58:23.536001+0000","last_clean":"2024-09-12T01:58:23.536001+0000","last_became_active":"2024-09-12T01:56:40.805748+0000","last_became_peered":"2024-09-12T01:56:40.805748+0000","last_unstale":"2024-09-12T01:58:23.536001+0000","last_undegraded":"2024-09-12T01:58:23.536001+0000","last_fullsized":"2024-09-12T01:58:23.536001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:48.753339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.535569+0000","last_change":"2024-09-12T01:56:40.809433+0000","last_active":"2024-09-12T01:58:23.535569+0000","last_peered":"2024-09-12T01:58:23.535569+0000","last_clean":"2024-09-12T01:58:23.535569+0000","last_became_active":"2024-09-12T01:56:40.809000+0000","last_became_peered":"2024-09-12T01:56:40.809000+0000","last_unstale":"2024-09-12T01:58:23.535569+0000","last_undegraded":"2024-09-12T01:58:23.535569+0000","last_fullsized":"2024-09-12T01:58:23.535569+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:45.506511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949568+0000","last_change":"2024-09-12T01:56:40.811304+0000","last_active":"2024-09-12T01:57:22.949568+0000","last_peered":"2024-09-12T01:57:22.949568+0000","last_clean":"2024-09-12T01:57:22.949568+0000","last_became_active":"2024-09-12T01:56:40.810759+0000","last_became_peered":"2024-09-12T01:56:40.810759+0000","last_unstale":"2024-09-12T01:57:22.949568+0000","last_undegraded":"2024-09-12T01:57:22.949568+0000","last_fullsized":"2024-09-12T01:57:22.949568+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:45.093498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662596+0000","last_change":"2024-09-12T01:56:40.809009+0000","last_active":"2024-09-12T01:58:23.662596+0000","last_peered":"2024-09-12T01:58:23.662596+0000","last_clean":"2024-09-12T01:58:23.662596+0000","last_became_active":"2024-09-12T01:56:40.808523+0000","last_became_peered":"2024-09-12T01:56:40.808523+0000","last_unstale":"2024-09-12T01:58:23.662596+0000","last_undegraded":"2024-09-12T01:58:23.662596+0000","last_fullsized":"2024-09-12T01:58:23.662596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:02.312093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948450+0000","last_change":"2024-09-12T01:56:40.796468+0000","last_active":"2024-09-12T01:57:22.948450+0000","last_peered":"2024-09-12T01:57:22.948450+0000","last_clean":"2024-09-12T01:57:22.948450+0000","last_became_active":"2024-09-12T01:56:40.796128+0000","last_became_peered":"2024-09-12T01:56:40.796128+0000","last_unstale":"2024-09-12T01:57:22.948450+0000","last_undegraded":"2024-09-12T01:57:22.948450+0000","last_fullsized":"2024-09-12T01:57:22.948450+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:55.521802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.535841+0000","last_change":"2024-09-12T01:56:40.800836+0000","last_active":"2024-09-12T01:58:23.535841+0000","last_peered":"2024-09-12T01:58:23.535841+0000","last_clean":"2024-09-12T01:58:23.535841+0000","last_became_active":"2024-09-12T01:56:40.800274+0000","last_became_peered":"2024-09-12T01:56:40.800274+0000","last_unstale":"2024-09-12T01:58:23.535841+0000","last_undegraded":"2024-09-12T01:58:23.535841+0000","last_fullsized":"2024-09-12T01:58:23.535841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:27.774825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530930+0000","last_change":"2024-09-12T01:56:40.804247+0000","last_active":"2024-09-12T01:58:22.530930+0000","last_peered":"2024-09-12T01:58:22.530930+0000","last_clean":"2024-09-12T01:58:22.530930+0000","last_became_active":"2024-09-12T01:56:40.803892+0000","last_became_peered":"2024-09-12T01:56:40.803892+0000","last_unstale":"2024-09-12T01:58:22.530930+0000","last_undegraded":"2024-09-12T01:58:22.530930+0000","last_fullsized":"2024-09-12T01:58:22.530930+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:57.537524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.811998+0000","last_change":"2024-09-12T01:56:40.805206+0000","last_active":"2024-09-12T01:58:23.811998+0000","last_peered":"2024-09-12T01:58:23.811998+0000","last_clean":"2024-09-12T01:58:23.811998+0000","last_became_active":"2024-09-12T01:56:40.804710+0000","last_became_peered":"2024-09-12T01:56:40.804710+0000","last_unstale":"2024-09-12T01:58:23.811998+0000","last_undegraded":"2024-09-12T01:58:23.811998+0000","last_fullsized":"2024-09-12T01:58:23.811998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530313+0000","last_change":"2024-09-12T01:56:40.795793+0000","last_active":"2024-09-12T01:58:22.530313+0000","last_peered":"2024-09-12T01:58:22.530313+0000","last_clean":"2024-09-12T01:58:22.530313+0000","last_became_active":"2024-09-12T01:56:40.795389+0000","last_became_peered":"2024-09-12T01:56:40.795389+0000","last_unstale":"2024-09-12T01:58:22.530313+0000","last_undegraded":"2024-09-12T01:58:22.530313+0000","last_fullsized":"2024-09-12T01:58:22.530313+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:16.413066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951131+0000","last_change":"2024-09-12T01:56:40.800624+0000","last_active":"2024-09-12T01:57:22.951131+0000","last_peered":"2024-09-12T01:57:22.951131+0000","last_clean":"2024-09-12T01:57:22.951131+0000","last_became_active":"2024-09-12T01:56:40.800203+0000","last_became_peered":"2024-09-12T01:56:40.800203+0000","last_unstale":"2024-09-12T01:57:22.951131+0000","last_undegraded":"2024-09-12T01:57:22.951131+0000","last_fullsized":"2024-09-12T01:57:22.951131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:01.688455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662511+0000","last_change":"2024-09-12T01:56:40.814818+0000","last_active":"2024-09-12T01:58:23.662511+0000","last_peered":"2024-09-12T01:58:23.662511+0000","last_clean":"2024-09-12T01:58:23.662511+0000","last_became_active":"2024-09-12T01:56:40.813521+0000","last_became_peered":"2024-09-12T01:56:40.813521+0000","last_unstale":"2024-09-12T01:58:23.662511+0000","last_undegraded":"2024-09-12T01:58:23.662511+0000","last_fullsized":"2024-09-12T01:58:23.662511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:43.393165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948221+0000","last_change":"2024-09-12T01:56:40.808186+0000","last_active":"2024-09-12T01:57:22.948221+0000","last_peered":"2024-09-12T01:57:22.948221+0000","last_clean":"2024-09-12T01:57:22.948221+0000","last_became_active":"2024-09-12T01:56:40.807817+0000","last_became_peered":"2024-09-12T01:56:40.807817+0000","last_unstale":"2024-09-12T01:57:22.948221+0000","last_undegraded":"2024-09-12T01:57:22.948221+0000","last_fullsized":"2024-09-12T01:57:22.948221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:21.055662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.535788+0000","last_change":"2024-09-12T01:56:40.805693+0000","last_active":"2024-09-12T01:58:23.535788+0000","last_peered":"2024-09-12T01:58:23.535788+0000","last_clean":"2024-09-12T01:58:23.535788+0000","last_became_active":"2024-09-12T01:56:40.805327+0000","last_became_peered":"2024-09-12T01:56:40.805327+0000","last_unstale":"2024-09-12T01:58:23.535788+0000","last_undegraded":"2024-09-12T01:58:23.535788+0000","last_fullsized":"2024-09-12T01:58:23.535788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:40.313504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.534441+0000","last_change":"2024-09-12T01:56:40.802263+0000","last_active":"2024-09-12T01:58:23.534441+0000","last_peered":"2024-09-12T01:58:23.534441+0000","last_clean":"2024-09-12T01:58:23.534441+0000","last_became_active":"2024-09-12T01:56:40.801009+0000","last_became_peered":"2024-09-12T01:56:40.801009+0000","last_unstale":"2024-09-12T01:58:23.534441+0000","last_undegraded":"2024-09-12T01:58:23.534441+0000","last_fullsized":"2024-09-12T01:58:23.534441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:03.283370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948958+0000","last_change":"2024-09-12T01:56:40.817597+0000","last_active":"2024-09-12T01:57:22.948958+0000","last_peered":"2024-09-12T01:57:22.948958+0000","last_clean":"2024-09-12T01:57:22.948958+0000","last_became_active":"2024-09-12T01:56:40.817314+0000","last_became_peered":"2024-09-12T01:56:40.817314+0000","last_unstale":"2024-09-12T01:57:22.948958+0000","last_undegraded":"2024-09-12T01:57:22.948958+0000","last_fullsized":"2024-09-12T01:57:22.948958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:33.421685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.950442+0000","last_change":"2024-09-12T01:56:40.803580+0000","last_active":"2024-09-12T01:57:22.950442+0000","last_peered":"2024-09-12T01:57:22.950442+0000","last_clean":"2024-09-12T01:57:22.950442+0000","last_became_active":"2024-09-12T01:56:40.803251+0000","last_became_peered":"2024-09-12T01:56:40.803251+0000","last_unstale":"2024-09-12T01:57:22.950442+0000","last_undegraded":"2024-09-12T01:57:22.950442+0000","last_fullsized":"2024-09-12T01:57:22.950442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:48.813142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.954092+0000","last_change":"2024-09-12T01:57:22.954092+0000","last_active":"2024-09-12T01:57:22.954092+0000","last_peered":"2024-09-12T01:57:22.954092+0000","last_clean":"2024-09-12T01:57:22.954092+0000","last_became_active":"2024-09-12T01:57:22.953702+0000","last_became_peered":"2024-09-12T01:57:22.953702+0000","last_unstale":"2024-09-12T01:57:22.954092+0000","last_undegraded":"2024-09-12T01:57:22.954092+0000","last_fullsized":"2024-09-12T01:57:22.954092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:21.939930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949090+0000","last_change":"2024-09-12T01:56:40.805635+0000","last_active":"2024-09-12T01:57:22.949090+0000","last_peered":"2024-09-12T01:57:22.949090+0000","last_clean":"2024-09-12T01:57:22.949090+0000","last_became_active":"2024-09-12T01:56:40.805272+0000","last_became_peered":"2024-09-12T01:56:40.805272+0000","last_unstale":"2024-09-12T01:57:22.949090+0000","last_undegraded":"2024-09-12T01:57:22.949090+0000","last_fullsized":"2024-09-12T01:57:22.949090+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:38.069722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.662404+0000","last_change":"2024-09-12T01:56:40.804448+0000","last_active":"2024-09-12T01:58:23.662404+0000","last_peered":"2024-09-12T01:58:23.662404+0000","last_clean":"2024-09-12T01:58:23.662404+0000","last_became_active":"2024-09-12T01:56:40.804087+0000","last_became_peered":"2024-09-12T01:56:40.804087+0000","last_unstale":"2024-09-12T01:58:23.662404+0000","last_undegraded":"2024-09-12T01:58:23.662404+0000","last_fullsized":"2024-09-12T01:58:23.662404+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:21.840684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.532514+0000","last_change":"2024-09-12T01:56:40.805791+0000","last_active":"2024-09-12T01:58:23.532514+0000","last_peered":"2024-09-12T01:58:23.532514+0000","last_clean":"2024-09-12T01:58:23.532514+0000","last_became_active":"2024-09-12T01:56:40.805240+0000","last_became_peered":"2024-09-12T01:56:40.805240+0000","last_unstale":"2024-09-12T01:58:23.532514+0000","last_undegraded":"2024-09-12T01:58:23.532514+0000","last_fullsized":"2024-09-12T01:58:23.532514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:14.060341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.813653+0000","last_change":"2024-09-12T01:56:40.803546+0000","last_active":"2024-09-12T01:58:23.813653+0000","last_peered":"2024-09-12T01:58:23.813653+0000","last_clean":"2024-09-12T01:58:23.813653+0000","last_became_active":"2024-09-12T01:56:40.803235+0000","last_became_peered":"2024-09-12T01:56:40.803235+0000","last_unstale":"2024-09-12T01:58:23.813653+0000","last_undegraded":"2024-09-12T01:58:23.813653+0000","last_fullsized":"2024-09-12T01:58:23.813653+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:15.758641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.481136+0000","last_change":"2024-09-12T01:56:40.806725+0000","last_active":"2024-09-12T01:57:23.481136+0000","last_peered":"2024-09-12T01:57:23.481136+0000","last_clean":"2024-09-12T01:57:23.481136+0000","last_became_active":"2024-09-12T01:56:40.806378+0000","last_became_peered":"2024-09-12T01:56:40.806378+0000","last_unstale":"2024-09-12T01:57:23.481136+0000","last_undegraded":"2024-09-12T01:57:23.481136+0000","last_fullsized":"2024-09-12T01:57:23.481136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:09.124282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951505+0000","last_change":"2024-09-12T01:56:40.794601+0000","last_active":"2024-09-12T01:57:22.951505+0000","last_peered":"2024-09-12T01:57:22.951505+0000","last_clean":"2024-09-12T01:57:22.951505+0000","last_became_active":"2024-09-12T01:56:40.794281+0000","last_became_peered":"2024-09-12T01:56:40.794281+0000","last_unstale":"2024-09-12T01:57:22.951505+0000","last_undegraded":"2024-09-12T01:57:22.951505+0000","last_fullsized":"2024-09-12T01:57:22.951505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.408464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T01:58:22.530160+0000","last_change":"2024-09-12T01:56:40.806003+0000","last_active":"2024-09-12T01:58:22.530160+0000","last_peered":"2024-09-12T01:58:22.530160+0000","last_clean":"2024-09-12T01:58:22.530160+0000","last_became_active":"2024-09-12T01:56:40.805689+0000","last_became_peered":"2024-09-12T01:56:40.805689+0000","last_unstale":"2024-09-12T01:58:22.530160+0000","last_undegraded":"2024-09-12T01:58:22.530160+0000","last_fullsized":"2024-09-12T01:58:22.530160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:47.498654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.812528+0000","last_change":"2024-09-12T01:56:40.800840+0000","last_active":"2024-09-12T01:58:23.812528+0000","last_peered":"2024-09-12T01:58:23.812528+0000","last_clean":"2024-09-12T01:58:23.812528+0000","last_became_active":"2024-09-12T01:56:40.800479+0000","last_became_peered":"2024-09-12T01:56:40.800479+0000","last_unstale":"2024-09-12T01:58:23.812528+0000","last_undegraded":"2024-09-12T01:58:23.812528+0000","last_fullsized":"2024-09-12T01:58:23.812528+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:11.789524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:23.480654+0000","last_change":"2024-09-12T01:56:40.799488+0000","last_active":"2024-09-12T01:57:23.480654+0000","last_peered":"2024-09-12T01:57:23.480654+0000","last_clean":"2024-09-12T01:57:23.480654+0000","last_became_active":"2024-09-12T01:56:40.799131+0000","last_became_peered":"2024-09-12T01:56:40.799131+0000","last_unstale":"2024-09-12T01:57:23.480654+0000","last_undegraded":"2024-09-12T01:57:23.480654+0000","last_fullsized":"2024-09-12T01:57:23.480654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:37.722651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.946176+0000","last_change":"2024-09-12T01:56:40.809821+0000","last_active":"2024-09-12T01:57:22.946176+0000","last_peered":"2024-09-12T01:57:22.946176+0000","last_clean":"2024-09-12T01:57:22.946176+0000","last_became_active":"2024-09-12T01:56:40.809500+0000","last_became_peered":"2024-09-12T01:56:40.809500+0000","last_unstale":"2024-09-12T01:57:22.946176+0000","last_undegraded":"2024-09-12T01:57:22.946176+0000","last_fullsized":"2024-09-12T01:57:22.946176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:23.271230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T01:58:23.532441+0000","last_change":"2024-09-12T01:56:40.805722+0000","last_active":"2024-09-12T01:58:23.532441+0000","last_peered":"2024-09-12T01:58:23.532441+0000","last_clean":"2024-09-12T01:58:23.532441+0000","last_became_active":"2024-09-12T01:56:40.805406+0000","last_became_peered":"2024-09-12T01:56:40.805406+0000","last_unstale":"2024-09-12T01:58:23.532441+0000","last_undegraded":"2024-09-12T01:58:23.532441+0000","last_fullsized":"2024-09-12T01:58:23.532441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:14.214021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.951499+0000","last_change":"2024-09-12T01:56:40.807957+0000","last_active":"2024-09-12T01:57:22.951499+0000","last_peered":"2024-09-12T01:57:22.951499+0000","last_clean":"2024-09-12T01:57:22.951499+0000","last_became_active":"2024-09-12T01:56:40.807635+0000","last_became_peered":"2024-09-12T01:56:40.807635+0000","last_unstale":"2024-09-12T01:57:22.951499+0000","last_undegraded":"2024-09-12T01:57:22.951499+0000","last_fullsized":"2024-09-12T01:57:22.951499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:05.378671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.949492+0000","last_change":"2024-09-12T01:56:40.813995+0000","last_active":"2024-09-12T01:57:22.949492+0000","last_peered":"2024-09-12T01:57:22.949492+0000","last_clean":"2024-09-12T01:57:22.949492+0000","last_became_active":"2024-09-12T01:56:40.806665+0000","last_became_peered":"2024-09-12T01:56:40.806665+0000","last_unstale":"2024-09-12T01:57:22.949492+0000","last_undegraded":"2024-09-12T01:57:22.949492+0000","last_fullsized":"2024-09-12T01:57:22.949492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:01.652850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:57:22.948866+0000","last_change":"2024-09-12T01:56:40.817591+0000","last_active":"2024-09-12T01:57:22.948866+0000","last_peered":"2024-09-12T01:57:22.948866+0000","last_clean":"2024-09-12T01:57:22.948866+0000","last_became_active":"2024-09-12T01:56:40.817281+0000","last_became_peered":"2024-09-12T01:56:40.817281+0000","last_unstale":"2024-09-12T01:57:22.948866+0000","last_undegraded":"2024-09-12T01:57:22.948866+0000","last_fullsized":"2024-09-12T01:57:22.948866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:56:39.763988+0000","last_clean_scrub_stamp":"2024-09-12T01:56:39.763988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:51.933536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65929,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":131,"num_read_kb":132,"num_write":89,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":197787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":518042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743463,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32856,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712296,"statfs":{"total":95995035648,"available":95961391104,"internally_reserved":0,"allocated":1712128,"data_stored":1169639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906989,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1077248,"data_stored":541589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":518646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364856,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36980,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708172,"statfs":{"total":95995035648,"available":95957168128,"internally_reserved":0,"allocated":1671168,"data_stored":1131957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528382,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1048576,"data_stored":523412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32824,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712328,"statfs":{"total":95995035648,"available":95961423872,"internally_reserved":0,"allocated":1675264,"data_stored":1127461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":536933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149773,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1056768,"data_stored":523516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1126400,"data_stored":588577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":579077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1036288,"data_stored":514036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":65165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:58:27.416 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:58:27.416 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T01:58:27.416 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T01:58:27.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T01:58:27.797 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:27.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:27 smithi062 ceph-mon[30666]: from='client.24923 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:58:27.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:27 smithi107 ceph-mon[35463]: from='client.24923 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:58:27.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:27 smithi077 ceph-mon[35095]: from='client.24923 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.318+0000 7ff8b1400640 1 -- 172.21.15.62:0/2244410697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8ac077040 msgr2=0x7ff8ac112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.318+0000 7ff8b1400640 1 --2- 172.21.15.62:0/2244410697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8ac077040 0x7ff8ac112510 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff898009900 tx=0x7ff89802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.318+0000 7ff8b1400640 1 -- 172.21.15.62:0/2244410697 shutdown_connections 2024-09-12T01:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.318+0000 7ff8b1400640 1 --2- 172.21.15.62:0/2244410697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8ac112a50 0x7ff8ac114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.318+0000 7ff8b1400640 1 --2- 172.21.15.62:0/2244410697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8ac077040 0x7ff8ac112510 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.318+0000 7ff8b1400640 1 --2- 172.21.15.62:0/2244410697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8ac076720 0x7ff8ac076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.318+0000 7ff8b1400640 1 -- 172.21.15.62:0/2244410697 >> 172.21.15.62:0/2244410697 conn(0x7ff8ac0ffa50 msgr2=0x7ff8ac101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.318+0000 7ff8b1400640 1 -- 172.21.15.62:0/2244410697 shutdown_connections 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.318+0000 7ff8b1400640 1 -- 172.21.15.62:0/2244410697 wait complete. 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.319+0000 7ff8b1400640 1 Processor -- start 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.319+0000 7ff8b1400640 1 -- start start 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8b1400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8ac076720 0x7ff8ac1a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8b1400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8ac077040 0x7ff8ac1a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8b1400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8ac112a50 0x7ff8ac19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8b1400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac1185c0 con 0x7ff8ac076720 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8b1400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac118440 con 0x7ff8ac077040 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8b1400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac118740 con 0x7ff8ac112a50 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8aa800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8ac076720 0x7ff8ac1a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8aa800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8ac076720 0x7ff8ac1a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54894/0 (socket says 172.21.15.62:54894) 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8aa800640 1 -- 172.21.15.62:0/667936493 learned_addr learned my addr 172.21.15.62:0/667936493 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8ab200640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8ac112a50 0x7ff8ac19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.320+0000 7ff8a9e00640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8ac077040 0x7ff8ac1a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8aa800640 1 -- 172.21.15.62:0/667936493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8ac112a50 msgr2=0x7ff8ac19e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8aa800640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8ac112a50 0x7ff8ac19e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8aa800640 1 -- 172.21.15.62:0/667936493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8ac077040 msgr2=0x7ff8ac1a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8aa800640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8ac077040 0x7ff8ac1a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8aa800640 1 -- 172.21.15.62:0/667936493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ac19f020 con 0x7ff8ac076720 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8ab200640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8ac112a50 0x7ff8ac19e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8aa800640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8ac076720 0x7ff8ac1a4730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00e9f0 tx=0x7ff89c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8a3400640 1 -- 172.21.15.62:0/667936493 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00cd80 con 0x7ff8ac076720 2024-09-12T01:58:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8a3400640 1 -- 172.21.15.62:0/667936493 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff89c010910 con 0x7ff8ac076720 2024-09-12T01:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8b1400640 1 -- 172.21.15.62:0/667936493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ac19f310 con 0x7ff8ac076720 2024-09-12T01:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8a3400640 1 -- 172.21.15.62:0/667936493 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c018990 con 0x7ff8ac076720 2024-09-12T01:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.321+0000 7ff8b1400640 1 -- 172.21.15.62:0/667936493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8ac1ab600 con 0x7ff8ac076720 2024-09-12T01:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.322+0000 7ff8b1400640 1 -- 172.21.15.62:0/667936493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8ac076b00 con 0x7ff8ac076720 2024-09-12T01:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.324+0000 7ff8a3400640 1 -- 172.21.15.62:0/667936493 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff89c010ac0 con 0x7ff8ac076720 2024-09-12T01:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.325+0000 7ff8a3400640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff8900a2c10 0x7ff8900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.326+0000 7ff8a3400640 1 -- 172.21.15.62:0/667936493 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7ff89c0cfa50 con 0x7ff8ac076720 2024-09-12T01:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.326+0000 7ff8a9e00640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff8900a2c10 0x7ff8900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.327+0000 7ff8a9e00640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff8900a2c10 0x7ff8900a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac1a00e0 tx=0x7ff898005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:28.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.330+0000 7ff8a3400640 1 -- 172.21.15.62:0/667936493 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff89c09c440 con 0x7ff8ac076720 2024-09-12T01:58:28.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.552+0000 7ff8b1400640 1 -- 172.21.15.62:0/667936493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8ac1ab830 con 0x7ff8ac076720 2024-09-12T01:58:28.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.552+0000 7ff8a3400640 1 -- 172.21.15.62:0/667936493 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff89c09bd40 con 0x7ff8ac076720 2024-09-12T01:58:28.553 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:28.553 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T01:58:28.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 -- 172.21.15.62:0/667936493 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff8900a2c10 msgr2=0x7ff8900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff8900a2c10 0x7ff8900a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac1a00e0 tx=0x7ff898005a20 comp rx=0 tx=0).stop 2024-09-12T01:58:28.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 -- 172.21.15.62:0/667936493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8ac076720 msgr2=0x7ff8ac1a4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:28.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8ac076720 0x7ff8ac1a4730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00e9f0 tx=0x7ff89c00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 -- 172.21.15.62:0/667936493 shutdown_connections 2024-09-12T01:58:28.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7ff8900a2c10 0x7ff8900a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff8ac112a50 0x7ff8ac19e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8ac077040 0x7ff8ac1a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 --2- 172.21.15.62:0/667936493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8ac076720 0x7ff8ac1a4730 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:28.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 -- 172.21.15.62:0/667936493 >> 172.21.15.62:0/667936493 conn(0x7ff8ac0ffa50 msgr2=0x7ff8ac101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:28.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 -- 172.21.15.62:0/667936493 shutdown_connections 2024-09-12T01:58:28.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:28.555+0000 7ff8b1400640 1 -- 172.21.15.62:0/667936493 wait complete. 2024-09-12T01:58:28.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:28 smithi062 ceph-mon[30666]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:28.956 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:28 smithi107 ceph-mon[35463]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:28.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:28 smithi077 ceph-mon[35095]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:29.441 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T01:58:29.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:58:29.822 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:29.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:29 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/667936493' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:58:29.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:29 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/667936493' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:58:29.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:29 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/667936493' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:58:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.355+0000 7fa60e000640 1 -- 172.21.15.62:0/1127037863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa608103ff0 msgr2=0x7fa6081043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.355+0000 7fa60e000640 1 --2- 172.21.15.62:0/1127037863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa608103ff0 0x7fa6081043d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009900 tx=0x7fa5f802a410 comp rx=0 tx=0).stop 2024-09-12T01:58:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.355+0000 7fa60e000640 1 -- 172.21.15.62:0/1127037863 shutdown_connections 2024-09-12T01:58:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.355+0000 7fa60e000640 1 --2- 172.21.15.62:0/1127037863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa608109120 0x7fa608110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.355+0000 7fa60e000640 1 --2- 172.21.15.62:0/1127037863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6081049a0 0x7fa6081089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.355+0000 7fa60e000640 1 --2- 172.21.15.62:0/1127037863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa608103ff0 0x7fa6081043d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.355+0000 7fa60e000640 1 -- 172.21.15.62:0/1127037863 >> 172.21.15.62:0/1127037863 conn(0x7fa6080ffa90 msgr2=0x7fa608101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.355+0000 7fa60e000640 1 -- 172.21.15.62:0/1127037863 shutdown_connections 2024-09-12T01:58:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.355+0000 7fa60e000640 1 -- 172.21.15.62:0/1127037863 wait complete. 2024-09-12T01:58:30.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.356+0000 7fa60e000640 1 Processor -- start 2024-09-12T01:58:30.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.356+0000 7fa60e000640 1 -- start start 2024-09-12T01:58:30.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa60e000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608103ff0 0x7fa60819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa60e000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6081049a0 0x7fa60819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa60e000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa608109120 0x7fa60819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa60e000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa608114150 con 0x7fa6081049a0 2024-09-12T01:58:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa60e000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa608113fd0 con 0x7fa608103ff0 2024-09-12T01:58:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa60e000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa6081142d0 con 0x7fa608109120 2024-09-12T01:58:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa5fea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6081049a0 0x7fa60819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa5fea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6081049a0 0x7fa60819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54906/0 (socket says 172.21.15.62:54906) 2024-09-12T01:58:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa5fea00640 1 -- 172.21.15.62:0/42181320 learned_addr learned my addr 172.21.15.62:0/42181320 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa607e00640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa608109120 0x7fa60819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.357+0000 7fa607400640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608103ff0 0x7fa60819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa5fea00640 1 -- 172.21.15.62:0/42181320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa608109120 msgr2=0x7fa60819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa5fea00640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa608109120 0x7fa60819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa5fea00640 1 -- 172.21.15.62:0/42181320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608103ff0 msgr2=0x7fa60819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa5fea00640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608103ff0 0x7fa60819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa5fea00640 1 -- 172.21.15.62:0/42181320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60819f5a0 con 0x7fa6081049a0 2024-09-12T01:58:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa5fea00640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6081049a0 0x7fa60819ab30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000d950 tx=0x7fa5f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa604c00640 1 -- 172.21.15.62:0/42181320 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0017070 con 0x7fa6081049a0 2024-09-12T01:58:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa604c00640 1 -- 172.21.15.62:0/42181320 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5f0009c30 con 0x7fa6081049a0 2024-09-12T01:58:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa60e000640 1 -- 172.21.15.62:0/42181320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60819f890 con 0x7fa6081049a0 2024-09-12T01:58:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa604c00640 1 -- 172.21.15.62:0/42181320 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000f6b0 con 0x7fa6081049a0 2024-09-12T01:58:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.358+0000 7fa60e000640 1 -- 172.21.15.62:0/42181320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6081a7170 con 0x7fa6081049a0 2024-09-12T01:58:30.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.360+0000 7fa60e000640 1 -- 172.21.15.62:0/42181320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6081043d0 con 0x7fa6081049a0 2024-09-12T01:58:30.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.362+0000 7fa604c00640 1 -- 172.21.15.62:0/42181320 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa5f00109d0 con 0x7fa6081049a0 2024-09-12T01:58:30.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.363+0000 7fa604c00640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa5ec0a2c10 0x7fa5ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:30.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.364+0000 7fa604c00640 1 -- 172.21.15.62:0/42181320 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fa5f00cea50 con 0x7fa6081049a0 2024-09-12T01:58:30.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.364+0000 7fa607400640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa5ec0a2c10 0x7fa5ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:30.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.364+0000 7fa607400640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa5ec0a2c10 0x7fa5ec0a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009230 tx=0x7fa5f80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:30.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.368+0000 7fa604c00640 1 -- 172.21.15.62:0/42181320 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5f0009de0 con 0x7fa6081049a0 2024-09-12T01:58:30.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.594+0000 7fa60e000640 1 -- 172.21.15.62:0/42181320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa60802d7c0 con 0x7fa6081049a0 2024-09-12T01:58:30.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.594+0000 7fa604c00640 1 -- 172.21.15.62:0/42181320 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11851 (secure 0 0 0) 0x7fa5f009ae50 con 0x7fa6081049a0 2024-09-12T01:58:30.595 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:30.595 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"btime":"2024-09-12T01:57:25:959947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:56:41.854823+0000","modified":"2024-09-12T01:57:25.905993+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24529":{"gid":24529,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24530]},"id":1}]} 2024-09-12T01:58:30.596 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2024-09-12T01:58:30.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 -- 172.21.15.62:0/42181320 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa5ec0a2c10 msgr2=0x7fa5ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa5ec0a2c10 0x7fa5ec0a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009230 tx=0x7fa5f80058d0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 -- 172.21.15.62:0/42181320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6081049a0 msgr2=0x7fa60819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6081049a0 0x7fa60819ab30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000d950 tx=0x7fa5f000de10 comp rx=0 tx=0).stop 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 -- 172.21.15.62:0/42181320 shutdown_connections 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa5ec0a2c10 0x7fa5ec0a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa608109120 0x7fa60819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6081049a0 0x7fa60819ab30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 --2- 172.21.15.62:0/42181320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa608103ff0 0x7fa60819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 -- 172.21.15.62:0/42181320 >> 172.21.15.62:0/42181320 conn(0x7fa6080ffa90 msgr2=0x7fa608100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 -- 172.21.15.62:0/42181320 shutdown_connections 2024-09-12T01:58:30.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:30.597+0000 7fa60e000640 1 -- 172.21.15.62:0/42181320 wait complete. 2024-09-12T01:58:30.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:30 smithi062 ceph-mon[30666]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:30.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:30 smithi107 ceph-mon[35463]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:30.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:30 smithi077 ceph-mon[35095]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:31.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:58:31.802 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:31.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:31 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/42181320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:31.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:31 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/42181320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:31.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:31 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/42181320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:32.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.336+0000 7fc081800640 1 -- 172.21.15.62:0/3134411227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc07c106f10 msgr2=0x7fc07c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.336+0000 7fc081800640 1 --2- 172.21.15.62:0/3134411227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc07c106f10 0x7fc07c10ea90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc074009ca0 tx=0x7fc07402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.336+0000 7fc081800640 1 -- 172.21.15.62:0/3134411227 shutdown_connections 2024-09-12T01:58:32.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.336+0000 7fc081800640 1 --2- 172.21.15.62:0/3134411227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc07c106f10 0x7fc07c10ea90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.336+0000 7fc081800640 1 --2- 172.21.15.62:0/3134411227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c102790 0x7fc07c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.336+0000 7fc081800640 1 --2- 172.21.15.62:0/3134411227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc07c101de0 0x7fc07c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.336+0000 7fc081800640 1 -- 172.21.15.62:0/3134411227 >> 172.21.15.62:0/3134411227 conn(0x7fc07c0fd8c0 msgr2=0x7fc07c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:32.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.336+0000 7fc081800640 1 -- 172.21.15.62:0/3134411227 shutdown_connections 2024-09-12T01:58:32.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.336+0000 7fc081800640 1 -- 172.21.15.62:0/3134411227 wait complete. 2024-09-12T01:58:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.337+0000 7fc081800640 1 Processor -- start 2024-09-12T01:58:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.337+0000 7fc081800640 1 -- start start 2024-09-12T01:58:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc081800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc07c101de0 0x7fc07c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc081800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc07c102790 0x7fc07c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc081800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c106f10 0x7fc07c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc081800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c111fc0 con 0x7fc07c101de0 2024-09-12T01:58:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc081800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c111e40 con 0x7fc07c106f10 2024-09-12T01:58:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc081800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c112140 con 0x7fc07c102790 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc07aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc07c101de0 0x7fc07c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc07aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc07c101de0 0x7fc07c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46566/0 (socket says 172.21.15.62:46566) 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc07aa00640 1 -- 172.21.15.62:0/4250684633 learned_addr learned my addr 172.21.15.62:0/4250684633 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc073e00640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc07c102790 0x7fc07c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc07b400640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c106f10 0x7fc07c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc07aa00640 1 -- 172.21.15.62:0/4250684633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc07c102790 msgr2=0x7fc07c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.338+0000 7fc07aa00640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc07c102790 0x7fc07c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc07aa00640 1 -- 172.21.15.62:0/4250684633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c106f10 msgr2=0x7fc07c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc07aa00640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c106f10 0x7fc07c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc07aa00640 1 -- 172.21.15.62:0/4250684633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07c19f5f0 con 0x7fc07c101de0 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc07b400640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c106f10 0x7fc07c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:32.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc073e00640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc07c102790 0x7fc07c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc07aa00640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc07c101de0 0x7fc07c19a640 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00e9f0 tx=0x7fc06c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc073400640 1 -- 172.21.15.62:0/4250684633 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00cd80 con 0x7fc07c101de0 2024-09-12T01:58:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc073400640 1 -- 172.21.15.62:0/4250684633 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc06c005500 con 0x7fc07c101de0 2024-09-12T01:58:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc081800640 1 -- 172.21.15.62:0/4250684633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07c19f8e0 con 0x7fc07c101de0 2024-09-12T01:58:32.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc073400640 1 -- 172.21.15.62:0/4250684633 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c010690 con 0x7fc07c101de0 2024-09-12T01:58:32.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.339+0000 7fc081800640 1 -- 172.21.15.62:0/4250684633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07c1a71c0 con 0x7fc07c101de0 2024-09-12T01:58:32.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.340+0000 7fc081800640 1 -- 172.21.15.62:0/4250684633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc07c1021c0 con 0x7fc07c101de0 2024-09-12T01:58:32.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.342+0000 7fc073400640 1 -- 172.21.15.62:0/4250684633 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc06c0046c0 con 0x7fc07c101de0 2024-09-12T01:58:32.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.343+0000 7fc073400640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0600a2c90 0x7fc0600a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:32.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.344+0000 7fc073400640 1 -- 172.21.15.62:0/4250684633 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fc06c0cfa10 con 0x7fc07c101de0 2024-09-12T01:58:32.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.344+0000 7fc073e00640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0600a2c90 0x7fc0600a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:32.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.344+0000 7fc073e00640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0600a2c90 0x7fc0600a5150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc07c076480 tx=0x7fc064005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.348+0000 7fc073400640 1 -- 172.21.15.62:0/4250684633 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc06c09c400 con 0x7fc07c101de0 2024-09-12T01:58:32.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.568+0000 7fc081800640 1 -- 172.21.15.62:0/4250684633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc07c19b9a0 con 0x7fc07c101de0 2024-09-12T01:58:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.569+0000 7fc073400640 1 -- 172.21.15.62:0/4250684633 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11851 (secure 0 0 0) 0x7fc06c09bd00 con 0x7fc07c101de0 2024-09-12T01:58:32.570 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:32.570 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"btime":"2024-09-12T01:57:25:959947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:56:41.854823+0000","modified":"2024-09-12T01:57:25.905993+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24529":{"gid":24529,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24530]},"id":1}]} 2024-09-12T01:58:32.570 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2024-09-12T01:58:32.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.571+0000 7fc081800640 1 -- 172.21.15.62:0/4250684633 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0600a2c90 msgr2=0x7fc0600a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.571+0000 7fc081800640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0600a2c90 0x7fc0600a5150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc07c076480 tx=0x7fc064005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:32.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.571+0000 7fc081800640 1 -- 172.21.15.62:0/4250684633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc07c101de0 msgr2=0x7fc07c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:32.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.571+0000 7fc081800640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc07c101de0 0x7fc07c19a640 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00e9f0 tx=0x7fc06c00edf0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.572+0000 7fc081800640 1 -- 172.21.15.62:0/4250684633 shutdown_connections 2024-09-12T01:58:32.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.572+0000 7fc081800640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc0600a2c90 0x7fc0600a5150 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.572+0000 7fc081800640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c106f10 0x7fc07c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.572+0000 7fc081800640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc07c102790 0x7fc07c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.572+0000 7fc081800640 1 --2- 172.21.15.62:0/4250684633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc07c101de0 0x7fc07c19a640 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:32.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.572+0000 7fc081800640 1 -- 172.21.15.62:0/4250684633 >> 172.21.15.62:0/4250684633 conn(0x7fc07c0fd8c0 msgr2=0x7fc07c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:32.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.572+0000 7fc081800640 1 -- 172.21.15.62:0/4250684633 shutdown_connections 2024-09-12T01:58:32.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:32.572+0000 7fc081800640 1 -- 172.21.15.62:0/4250684633 wait complete. 2024-09-12T01:58:32.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:32 smithi062 ceph-mon[30666]: pgmap v359: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 566 B/s rd, 1 op/s 2024-09-12T01:58:32.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:32 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4250684633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:32.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:32 smithi107 ceph-mon[35463]: pgmap v359: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 566 B/s rd, 1 op/s 2024-09-12T01:58:32.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:32 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4250684633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:32.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:32 smithi077 ceph-mon[35095]: pgmap v359: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 566 B/s rd, 1 op/s 2024-09-12T01:58:32.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:32 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4250684633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:33.428 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:58:33.806 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:34.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.353+0000 7f7dce000640 1 -- 172.21.15.62:0/1194635812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dc8101df0 msgr2=0x7f7dc81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.353+0000 7f7dce000640 1 --2- 172.21.15.62:0/1194635812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dc8101df0 0x7f7dc81021d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009900 tx=0x7f7db802a410 comp rx=0 tx=0).stop 2024-09-12T01:58:34.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.354+0000 7f7dce000640 1 -- 172.21.15.62:0/1194635812 shutdown_connections 2024-09-12T01:58:34.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.354+0000 7f7dce000640 1 --2- 172.21.15.62:0/1194635812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8106f20 0x7f7dc810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.354+0000 7f7dce000640 1 --2- 172.21.15.62:0/1194635812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dc81027a0 0x7f7dc81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.354+0000 7f7dce000640 1 --2- 172.21.15.62:0/1194635812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dc8101df0 0x7f7dc81021d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.354+0000 7f7dce000640 1 -- 172.21.15.62:0/1194635812 >> 172.21.15.62:0/1194635812 conn(0x7f7dc80fd8b0 msgr2=0x7f7dc80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.354+0000 7f7dce000640 1 -- 172.21.15.62:0/1194635812 shutdown_connections 2024-09-12T01:58:34.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.354+0000 7f7dce000640 1 -- 172.21.15.62:0/1194635812 wait complete. 2024-09-12T01:58:34.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dce000640 1 Processor -- start 2024-09-12T01:58:34.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dce000640 1 -- start start 2024-09-12T01:58:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dce000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dc8101df0 0x7f7dc819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dce000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc81027a0 0x7f7dc819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dce000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dc8106f20 0x7f7dc819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dce000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8111f80 con 0x7f7dc8106f20 2024-09-12T01:58:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dce000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8111e00 con 0x7f7dc81027a0 2024-09-12T01:58:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dce000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8112100 con 0x7f7dc8101df0 2024-09-12T01:58:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dc7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dc8101df0 0x7f7dc819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dc7400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dc8101df0 0x7f7dc819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:50292/0 (socket says 172.21.15.62:50292) 2024-09-12T01:58:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dc7400640 1 -- 172.21.15.62:0/2262396860 learned_addr learned my addr 172.21.15.62:0/2262396860 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:34.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.355+0000 7f7dc7e00640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dc8106f20 0x7f7dc819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.356+0000 7f7dbfe00640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc81027a0 0x7f7dc819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.356+0000 7f7dc7400640 1 -- 172.21.15.62:0/2262396860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc81027a0 msgr2=0x7f7dc819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.356+0000 7f7dc7400640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc81027a0 0x7f7dc819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.356+0000 7f7dc7400640 1 -- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dc8106f20 msgr2=0x7f7dc819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.356+0000 7f7dc7400640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dc8106f20 0x7f7dc819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.356+0000 7f7dc7400640 1 -- 172.21.15.62:0/2262396860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc819f5c0 con 0x7f7dc8101df0 2024-09-12T01:58:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.356+0000 7f7dc7e00640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dc8106f20 0x7f7dc819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.356+0000 7f7dc7400640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dc8101df0 0x7f7dc819a610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7db8006010 tx=0x7f7db8004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.357+0000 7f7dc4c00640 1 -- 172.21.15.62:0/2262396860 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db803f030 con 0x7f7dc8101df0 2024-09-12T01:58:34.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.357+0000 7f7dc4c00640 1 -- 172.21.15.62:0/2262396860 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7db8004440 con 0x7f7dc8101df0 2024-09-12T01:58:34.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.357+0000 7f7dc4c00640 1 -- 172.21.15.62:0/2262396860 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db8035070 con 0x7f7dc8101df0 2024-09-12T01:58:34.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.357+0000 7f7dce000640 1 -- 172.21.15.62:0/2262396860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc819f850 con 0x7f7dc8101df0 2024-09-12T01:58:34.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.357+0000 7f7dce000640 1 -- 172.21.15.62:0/2262396860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc819fce0 con 0x7f7dc8101df0 2024-09-12T01:58:34.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.358+0000 7f7dce000640 1 -- 172.21.15.62:0/2262396860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc81021d0 con 0x7f7dc8101df0 2024-09-12T01:58:34.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.360+0000 7f7dc4c00640 1 -- 172.21.15.62:0/2262396860 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7db8042030 con 0x7f7dc8101df0 2024-09-12T01:58:34.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.361+0000 7f7dc4c00640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7dac0a2c90 0x7f7dac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.362+0000 7f7dc4c00640 1 -- 172.21.15.62:0/2262396860 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f7db80efae0 con 0x7f7dc8101df0 2024-09-12T01:58:34.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.362+0000 7f7dbfe00640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7dac0a2c90 0x7f7dac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.362+0000 7f7dbfe00640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7dac0a2c90 0x7f7dac0a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7dc810eef0 tx=0x7f7db0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.364+0000 7f7dc4c00640 1 -- 172.21.15.62:0/2262396860 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7db80bbf40 con 0x7f7dc8101df0 2024-09-12T01:58:34.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.553+0000 7f7dce000640 1 -- 172.21.15.62:0/2262396860 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dc81a7310 con 0x7f7dc8101df0 2024-09-12T01:58:34.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.555+0000 7f7dc4c00640 1 -- 172.21.15.62:0/2262396860 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24864 (secure 0 0 0) 0x7f7db80c0240 con 0x7f7dc8101df0 2024-09-12T01:58:34.556 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:34.557 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":94,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:58:23.527829+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:58:34.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.557+0000 7f7dce000640 1 -- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7dac0a2c90 msgr2=0x7f7dac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.557+0000 7f7dce000640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7dac0a2c90 0x7f7dac0a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7dc810eef0 tx=0x7f7db0005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:34.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.557+0000 7f7dce000640 1 -- 172.21.15.62:0/2262396860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dc8101df0 msgr2=0x7f7dc819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.557+0000 7f7dce000640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dc8101df0 0x7f7dc819a610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7db8006010 tx=0x7f7db8004040 comp rx=0 tx=0).stop 2024-09-12T01:58:34.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.557+0000 7f7dce000640 1 -- 172.21.15.62:0/2262396860 shutdown_connections 2024-09-12T01:58:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.557+0000 7f7dce000640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f7dac0a2c90 0x7f7dac0a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.557+0000 7f7dce000640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7dc8106f20 0x7f7dc819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.557+0000 7f7dce000640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc81027a0 0x7f7dc819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.557+0000 7f7dce000640 1 --2- 172.21.15.62:0/2262396860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7dc8101df0 0x7f7dc819a610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.557+0000 7f7dce000640 1 -- 172.21.15.62:0/2262396860 >> 172.21.15.62:0/2262396860 conn(0x7f7dc80fd8b0 msgr2=0x7f7dc80ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.558+0000 7f7dce000640 1 -- 172.21.15.62:0/2262396860 shutdown_connections 2024-09-12T01:58:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:34.558+0000 7f7dce000640 1 -- 172.21.15.62:0/2262396860 wait complete. 2024-09-12T01:58:34.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:34 smithi062 ceph-mon[30666]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1020 B/s rd, 1 op/s 2024-09-12T01:58:34.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:34 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2262396860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:58:34.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:34 smithi107 ceph-mon[35463]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1020 B/s rd, 1 op/s 2024-09-12T01:58:34.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:34 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2262396860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:58:34.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:34 smithi077 ceph-mon[35095]: pgmap v360: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1020 B/s rd, 1 op/s 2024-09-12T01:58:34.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:34 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2262396860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:58:35.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:58:35.727 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.299+0000 7f80a1e00640 1 -- 172.21.15.62:0/4098735517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f809c077040 msgr2=0x7f809c112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.299+0000 7f80a1e00640 1 --2- 172.21.15.62:0/4098735517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f809c077040 0x7f809c112330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8088009900 tx=0x7f808802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.299+0000 7f80a1e00640 1 -- 172.21.15.62:0/4098735517 shutdown_connections 2024-09-12T01:58:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.299+0000 7f80a1e00640 1 --2- 172.21.15.62:0/4098735517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f809c112870 0x7f809c114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.299+0000 7f80a1e00640 1 --2- 172.21.15.62:0/4098735517 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f809c077040 0x7f809c112330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.299+0000 7f80a1e00640 1 --2- 172.21.15.62:0/4098735517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809c076720 0x7f809c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.299+0000 7f80a1e00640 1 -- 172.21.15.62:0/4098735517 >> 172.21.15.62:0/4098735517 conn(0x7f809c0ff8d0 msgr2=0x7f809c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.299+0000 7f80a1e00640 1 -- 172.21.15.62:0/4098735517 shutdown_connections 2024-09-12T01:58:36.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.299+0000 7f80a1e00640 1 -- 172.21.15.62:0/4098735517 wait complete. 2024-09-12T01:58:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.300+0000 7f80a1e00640 1 Processor -- start 2024-09-12T01:58:36.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.300+0000 7f80a1e00640 1 -- start start 2024-09-12T01:58:36.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f80a1e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809c076720 0x7f809c1a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:36.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f80a1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f809c077040 0x7f809c1a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:36.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f80a1e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f809c112870 0x7f809c19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:36.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f80a1e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f809c118430 con 0x7f809c077040 2024-09-12T01:58:36.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f80a1e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1182b0 con 0x7f809c076720 2024-09-12T01:58:36.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f80a1e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1185b0 con 0x7f809c112870 2024-09-12T01:58:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f80a0a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809c076720 0x7f809c1a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f809be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f809c077040 0x7f809c1a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f80a0a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809c076720 0x7f809c1a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:52842/0 (socket says 172.21.15.62:52842) 2024-09-12T01:58:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f80a0a00640 1 -- 172.21.15.62:0/3760143702 learned_addr learned my addr 172.21.15.62:0/3760143702 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.301+0000 7f80a1400640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f809c112870 0x7f809c19e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.302+0000 7f80a0a00640 1 -- 172.21.15.62:0/3760143702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f809c112870 msgr2=0x7f809c19e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.302+0000 7f80a0a00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f809c112870 0x7f809c19e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.302+0000 7f80a0a00640 1 -- 172.21.15.62:0/3760143702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f809c077040 msgr2=0x7f809c1a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.302+0000 7f80a0a00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f809c077040 0x7f809c1a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.302+0000 7f80a0a00640 1 -- 172.21.15.62:0/3760143702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c19ef90 con 0x7f809c076720 2024-09-12T01:58:36.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.302+0000 7f80a0a00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809c076720 0x7f809c1a4650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f809000d950 tx=0x7f809000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:36.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.302+0000 7f8099600640 1 -- 172.21.15.62:0/3760143702 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090017030 con 0x7f809c076720 2024-09-12T01:58:36.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.302+0000 7f80a1e00640 1 -- 172.21.15.62:0/3760143702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c19f280 con 0x7f809c076720 2024-09-12T01:58:36.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.302+0000 7f8099600640 1 -- 172.21.15.62:0/3760143702 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8090004020 con 0x7f809c076720 2024-09-12T01:58:36.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.302+0000 7f8099600640 1 -- 172.21.15.62:0/3760143702 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80900047a0 con 0x7f809c076720 2024-09-12T01:58:36.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.303+0000 7f80a1e00640 1 -- 172.21.15.62:0/3760143702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c1ab5d0 con 0x7f809c076720 2024-09-12T01:58:36.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.304+0000 7f80a1e00640 1 -- 172.21.15.62:0/3760143702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809c077e60 con 0x7f809c076720 2024-09-12T01:58:36.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.305+0000 7f8099600640 1 -- 172.21.15.62:0/3760143702 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f80900041d0 con 0x7f809c076720 2024-09-12T01:58:36.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.307+0000 7f8099600640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f80840a2c90 0x7f80840a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:36.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.307+0000 7f8099600640 1 -- 172.21.15.62:0/3760143702 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f80900cf110 con 0x7f809c076720 2024-09-12T01:58:36.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.307+0000 7f809be00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f80840a2c90 0x7f80840a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:36.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.308+0000 7f809be00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f80840a2c90 0x7f80840a5150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8088000c00 tx=0x7f8088005b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:36.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.309+0000 7f8099600640 1 -- 172.21.15.62:0/3760143702 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f809009bb80 con 0x7f809c076720 2024-09-12T01:58:36.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.532+0000 7f80a1e00640 1 -- 172.21.15.62:0/3760143702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f809c1ab7a0 con 0x7f809c076720 2024-09-12T01:58:36.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.533+0000 7f8099600640 1 -- 172.21.15.62:0/3760143702 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11851 (secure 0 0 0) 0x7f809009b480 con 0x7f809c076720 2024-09-12T01:58:36.533 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:36.534 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"btime":"2024-09-12T01:57:25:959947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:56:41.854823+0000","modified":"2024-09-12T01:57:25.905993+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24529":{"gid":24529,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24530]},"id":1}]} 2024-09-12T01:58:36.534 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2024-09-12T01:58:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 -- 172.21.15.62:0/3760143702 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f80840a2c90 msgr2=0x7f80840a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f80840a2c90 0x7f80840a5150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8088000c00 tx=0x7f8088005b50 comp rx=0 tx=0).stop 2024-09-12T01:58:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 -- 172.21.15.62:0/3760143702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809c076720 msgr2=0x7f809c1a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809c076720 0x7f809c1a4650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f809000d950 tx=0x7f809000de10 comp rx=0 tx=0).stop 2024-09-12T01:58:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 -- 172.21.15.62:0/3760143702 shutdown_connections 2024-09-12T01:58:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f80840a2c90 0x7f80840a5150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f809c112870 0x7f809c19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f809c077040 0x7f809c1a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 --2- 172.21.15.62:0/3760143702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809c076720 0x7f809c1a4650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:36.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 -- 172.21.15.62:0/3760143702 >> 172.21.15.62:0/3760143702 conn(0x7f809c0ff8d0 msgr2=0x7f809c101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:36.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.535+0000 7f80a1e00640 1 -- 172.21.15.62:0/3760143702 shutdown_connections 2024-09-12T01:58:36.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:36.536+0000 7f80a1e00640 1 -- 172.21.15.62:0/3760143702 wait complete. 2024-09-12T01:58:36.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:36 smithi062 ceph-mon[30666]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:36.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:36 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3760143702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:36.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:36 smithi107 ceph-mon[35463]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:36.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:36 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3760143702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:36.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:36 smithi077 ceph-mon[35095]: pgmap v361: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:36.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:36 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3760143702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:37.235 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:56:41.854823+0000', 'modified': '2024-09-12T01:57:25.905993+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24530}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24529': {'gid': 24529, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6839/4011311424', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 4011311424}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 4011311424}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24530': {'gid': 24530, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.77:6839/1365701824', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6838', 'nonce': 1365701824}, {'type': 'v1', 'addr': '172.21.15.77:6839', 'nonce': 1365701824}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24530, 'qdb_cluster': [24530]} 2024-09-12T01:58:37.236 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:58:37.236 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:58:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.149+0000 7fa292c00640 1 -- 172.21.15.62:0/1671491711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28c108f60 msgr2=0x7fa28c110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.149+0000 7fa292c00640 1 --2- 172.21.15.62:0/1671491711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28c108f60 0x7fa28c110ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa284009ca0 tx=0x7fa28402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.149+0000 7fa292c00640 1 -- 172.21.15.62:0/1671491711 shutdown_connections 2024-09-12T01:58:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.149+0000 7fa292c00640 1 --2- 172.21.15.62:0/1671491711 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28c108f60 0x7fa28c110ae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.149+0000 7fa292c00640 1 --2- 172.21.15.62:0/1671491711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28c1047e0 0x7fa28c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.149+0000 7fa292c00640 1 --2- 172.21.15.62:0/1671491711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa28c103e30 0x7fa28c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.149+0000 7fa292c00640 1 -- 172.21.15.62:0/1671491711 >> 172.21.15.62:0/1671491711 conn(0x7fa28c0ff8d0 msgr2=0x7fa28c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.149+0000 7fa292c00640 1 -- 172.21.15.62:0/1671491711 shutdown_connections 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.149+0000 7fa292c00640 1 -- 172.21.15.62:0/1671491711 wait complete. 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.150+0000 7fa292c00640 1 Processor -- start 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.150+0000 7fa292c00640 1 -- start start 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.150+0000 7fa292c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28c103e30 0x7fa28c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.150+0000 7fa292c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28c1047e0 0x7fa28c19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.150+0000 7fa292c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa28c108f60 0x7fa28c19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.150+0000 7fa292c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c114010 con 0x7fa28c103e30 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.150+0000 7fa292c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c113e90 con 0x7fa28c1047e0 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.150+0000 7fa292c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c114190 con 0x7fa28c108f60 2024-09-12T01:58:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa290e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28c1047e0 0x7fa28c19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa291800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28c103e30 0x7fa28c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa292200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa28c108f60 0x7fa28c19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa291800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28c103e30 0x7fa28c19a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46616/0 (socket says 172.21.15.62:46616) 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa291800640 1 -- 172.21.15.62:0/2701551306 learned_addr learned my addr 172.21.15.62:0/2701551306 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa291800640 1 -- 172.21.15.62:0/2701551306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa28c108f60 msgr2=0x7fa28c19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa291800640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa28c108f60 0x7fa28c19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa291800640 1 -- 172.21.15.62:0/2701551306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28c1047e0 msgr2=0x7fa28c19a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa291800640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28c1047e0 0x7fa28c19a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa291800640 1 -- 172.21.15.62:0/2701551306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c19f3c0 con 0x7fa28c103e30 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.151+0000 7fa291800640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28c103e30 0x7fa28c19a410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa28000d950 tx=0x7fa28000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.152+0000 7fa28a000640 1 -- 172.21.15.62:0/2701551306 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa280017030 con 0x7fa28c103e30 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.152+0000 7fa28a000640 1 -- 172.21.15.62:0/2701551306 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa280004020 con 0x7fa28c103e30 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.152+0000 7fa28a000640 1 -- 172.21.15.62:0/2701551306 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2800047a0 con 0x7fa28c103e30 2024-09-12T01:58:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.152+0000 7fa292c00640 1 -- 172.21.15.62:0/2701551306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28c19f6b0 con 0x7fa28c103e30 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.152+0000 7fa292c00640 1 -- 172.21.15.62:0/2701551306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28c1a6f90 con 0x7fa28c103e30 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.155+0000 7fa296dde740 1 Processor -- start 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.155+0000 7fa28a000640 1 -- 172.21.15.62:0/2701551306 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa2800041d0 con 0x7fa28c103e30 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.155+0000 7fa296dde740 1 -- start start 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.155+0000 7fa296dde740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759d94e0 0x564b759d98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.155+0000 7fa296dde740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759e4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa296dde740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759e46c0 0x564b759e6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa296dde740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b7593f0b0 con 0x564b759d9e00 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa296dde740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564b758e6ab0 con 0x564b759e46c0 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa296dde740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564b7593b070 con 0x564b759d94e0 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa291800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa290e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759e46c0 0x564b759e6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa292200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759d94e0 0x564b759d98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa291800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759e4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46628/0 (socket says 172.21.15.62:46628) 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa291800640 1 -- 172.21.15.62:0/1621586726 learned_addr learned my addr 172.21.15.62:0/1621586726 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa292200640 1 -- 172.21.15.62:0/1621586726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759e46c0 msgr2=0x564b759e6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa292200640 1 --2- 172.21.15.62:0/1621586726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759e46c0 0x564b759e6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa292200640 1 -- 172.21.15.62:0/1621586726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 msgr2=0x564b759e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa292200640 1 --2- 172.21.15.62:0/1621586726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759e4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.156+0000 7fa292200640 1 -- 172.21.15.62:0/1621586726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b758f34a0 con 0x564b759d94e0 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.157+0000 7fa28a000640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa2740a2c90 0x7fa2740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.157+0000 7fa292200640 1 --2- 172.21.15.62:0/1621586726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759d94e0 0x564b759d98c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa284005e30 tx=0x7fa28402f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afbf61dd3c692258 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.157+0000 7fa28a000640 1 -- 172.21.15.62:0/2701551306 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fa2800ceeb0 con 0x7fa28c103e30 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.157+0000 7fa291800640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa2740a2c90 0x7fa2740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.157+0000 7fa27ea00640 1 -- 172.21.15.62:0/1621586726 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284003970 con 0x564b759d94e0 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.157+0000 7fa27ea00640 1 -- 172.21.15.62:0/1621586726 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa284036030 con 0x564b759d94e0 2024-09-12T01:58:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.157+0000 7fa27ea00640 1 -- 172.21.15.62:0/1621586726 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284004330 con 0x564b759d94e0 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa296dde740 1 -- 172.21.15.62:0/1621586726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759d94e0 msgr2=0x564b759d98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa296dde740 1 --2- 172.21.15.62:0/1621586726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759d94e0 0x564b759d98c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa284005e30 tx=0x7fa28402f3c0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa291800640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa2740a2c90 0x7fa2740a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa280009610 tx=0x7fa2800d2960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa296dde740 1 -- 172.21.15.62:0/1621586726 shutdown_connections 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa296dde740 1 --2- 172.21.15.62:0/1621586726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759e46c0 0x564b759e6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa296dde740 1 --2- 172.21.15.62:0/1621586726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa296dde740 1 --2- 172.21.15.62:0/1621586726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759d94e0 0x564b759d98c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa296dde740 1 -- 172.21.15.62:0/1621586726 >> 172.21.15.62:0/1621586726 conn(0x564b759d5a70 msgr2=0x564b759d5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa296dde740 1 -- 172.21.15.62:0/1621586726 shutdown_connections 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa296dde740 1 -- 172.21.15.62:0/1621586726 wait complete. 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.158+0000 7fa296dde740 1 -- start start 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa296dde740 1 Processor -- start 2024-09-12T01:58:38.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa296dde740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759e1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa296dde740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759e1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa296dde740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa296dde740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b759e71b0 con 0x564b759d9e00 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa296dde740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564b758c7920 con 0x564b759d94e0 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa296dde740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564b759e7330 con 0x564b759e46c0 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa296dde740 10 client.0 _ll_register_callbacks cb 0x564b758eb8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa292200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759e1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa290e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759e1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa292200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759e1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:52888/0 (socket says 172.21.15.62:52888) 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.159+0000 7fa292200640 1 -- 172.21.15.62:0/2670944904 learned_addr learned my addr 172.21.15.62:0/2670944904 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.160+0000 7fa292200640 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.160+0000 7fa290e00640 1 -- 172.21.15.62:0/2670944904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 msgr2=0x564b759e1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.160+0000 7fa290e00640 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759e1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.160+0000 7fa290e00640 1 -- 172.21.15.62:0/2670944904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 msgr2=0x564b759e1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.160+0000 7fa290e00640 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759e1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.160+0000 7fa290e00640 1 -- 172.21.15.62:0/2670944904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b756b02b0 con 0x564b759d9e00 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.160+0000 7fa292200640 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759e1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.160+0000 7fa290e00640 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759e1ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa2780126d0 tx=0x7fa278012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c0bc63221f6e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.160+0000 7fa273400640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa273400640 1 -- 172.21.15.62:0/2670944904 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278004030 con 0x564b759d9e00 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa273400640 1 -- 172.21.15.62:0/2670944904 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fa2780041d0 con 0x564b759d9e00 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa296dde740 1 -- 172.21.15.62:0/2670944904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa284036030 con 0x564b759d9e00 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa273400640 1 -- 172.21.15.62:0/2670944904 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa2780043d0 con 0x564b759d9e00 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa296dde740 10 client.14928 fetch_fsmap learned FSMap version 21 2024-09-12T01:58:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa296dde740 1 -- 172.21.15.62:0/2670944904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564b759f2e90 con 0x564b759d9e00 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa273400640 1 -- 172.21.15.62:0/2670944904 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa284036030 con 0x564b759d9e00 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa273400640 1 -- 172.21.15.62:0/2670944904 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa278003af0 con 0x564b759d9e00 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa296dde740 10 client.14928 fetch_fsmap finished waiting for FSMap version 21 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa296dde740 10 client.14928 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa296dde740 20 client.14928 populate_metadata read hostname 'smithi062' 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.161+0000 7fa296dde740 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x564b759f54c0 0x564b759f6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.162+0000 7fa296dde740 4 client.14928 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.162+0000 7fa296dde740 1 -- 172.21.15.62:0/2670944904 --> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b7594c620 con 0x564b759f54c0 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.162+0000 7fa292200640 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x564b759f54c0 0x564b759f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.162+0000 7fa292200640 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x564b759f54c0 0x564b759f6930 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=397bff781192fef3 server_cookie=5e8188411a2c4ef9 in_seq=0 out_seq=0 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.162+0000 7fa273400640 10 client.14928 ms_handle_connect on v2:172.21.15.77:6838/1365701824 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa273400640 1 -- 172.21.15.62:0/2670944904 <== mds.0 v2:172.21.15.77:6838/1365701824 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b7594c620 con 0x564b759f54c0 2024-09-12T01:58:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa273400640 10 client.14928 handle_command_reply: tid=0 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa296dde740 1 client.14928 shutdown 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa296dde740 1 -- 172.21.15.62:0/2670944904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 msgr2=0x564b759e1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa296dde740 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759e1ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa2780126d0 tx=0x7fa278012b90 comp rx=0 tx=0).stop 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa296dde740 1 -- 172.21.15.62:0/2670944904 shutdown_connections 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa296dde740 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x564b759f54c0 0x564b759f6930 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa296dde740 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759e1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa296dde740 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759e1ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa296dde740 1 --2- 172.21.15.62:0/2670944904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759e1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa273400640 0 client.14928 ms_handle_reset on v2:172.21.15.77:6838/1365701824 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.163+0000 7fa296dde740 1 -- 172.21.15.62:0/2670944904 >> 172.21.15.62:0/2670944904 conn(0x564b759d5a70 msgr2=0x564b759d4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.164+0000 7fa296dde740 1 -- 172.21.15.62:0/2670944904 shutdown_connections 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.164+0000 7fa296dde740 1 -- 172.21.15.62:0/2670944904 wait complete. 2024-09-12T01:58:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.164+0000 7fa296dde740 20 client.14928 trim_cache size 0 max 16384 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.183+0000 7fa296dde740 1 Processor -- start 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa296dde740 1 -- start start 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa296dde740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759e1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa296dde740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759de7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa296dde740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759ded10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa296dde740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b759f4c70 con 0x564b759d9e00 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa296dde740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564b759f5340 con 0x564b759d94e0 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa296dde740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564b759f5a10 con 0x564b759e46c0 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa290e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759de7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa290e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759de7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46652/0 (socket says 172.21.15.62:46652) 2024-09-12T01:58:38.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa290e00640 1 -- 172.21.15.62:0/3093328975 learned_addr learned my addr 172.21.15.62:0/3093328975 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa292200640 1 --2- 172.21.15.62:0/3093328975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759ded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.184+0000 7fa292200640 1 --2- 172.21.15.62:0/3093328975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759e1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.185+0000 7fa290e00640 1 -- 172.21.15.62:0/3093328975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 msgr2=0x564b759ded10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.185+0000 7fa290e00640 1 --2- 172.21.15.62:0/3093328975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759ded10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.185+0000 7fa290e00640 1 -- 172.21.15.62:0/3093328975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 msgr2=0x564b759e1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.185+0000 7fa290e00640 1 --2- 172.21.15.62:0/3093328975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759e1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.185+0000 7fa290e00640 1 -- 172.21.15.62:0/3093328975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b759d9310 con 0x564b759d9e00 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.185+0000 7fa290e00640 1 --2- 172.21.15.62:0/3093328975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759de7d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa27801c4b0 tx=0x7fa278005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470c6161df6a5a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.185+0000 7fa27e000640 1 -- 172.21.15.62:0/3093328975 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27802e070 con 0x564b759d9e00 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.185+0000 7fa27e000640 1 -- 172.21.15.62:0/3093328975 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa27801c530 con 0x564b759d9e00 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.185+0000 7fa27e000640 1 -- 172.21.15.62:0/3093328975 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27800fb60 con 0x564b759d9e00 2024-09-12T01:58:38.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.186+0000 7fa296dde740 1 -- 172.21.15.62:0/3093328975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 msgr2=0x564b759de7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.186+0000 7fa296dde740 1 --2- 172.21.15.62:0/3093328975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759de7d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa27801c4b0 tx=0x7fa278005db0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.186+0000 7fa296dde740 1 -- 172.21.15.62:0/3093328975 shutdown_connections 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.186+0000 7fa296dde740 1 --2- 172.21.15.62:0/3093328975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759ded10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.186+0000 7fa296dde740 1 --2- 172.21.15.62:0/3093328975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759de7d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.186+0000 7fa296dde740 1 --2- 172.21.15.62:0/3093328975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759e1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.186+0000 7fa296dde740 1 -- 172.21.15.62:0/3093328975 >> 172.21.15.62:0/3093328975 conn(0x564b759d5a70 msgr2=0x564b759dfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.186+0000 7fa296dde740 1 -- 172.21.15.62:0/3093328975 shutdown_connections 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.186+0000 7fa296dde740 1 -- 172.21.15.62:0/3093328975 wait complete. 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.187+0000 7fa296dde740 1 -- start start 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.187+0000 7fa296dde740 1 Processor -- start 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.187+0000 7fa296dde740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759ff370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.187+0000 7fa296dde740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.187+0000 7fa296dde740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.187+0000 7fa296dde740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b759f67b0 con 0x564b759d9e00 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.187+0000 7fa296dde740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564b759f60e0 con 0x564b759d94e0 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.187+0000 7fa296dde740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564b759f6e80 con 0x564b759e46c0 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.187+0000 7fa296dde740 10 client.0 _ll_register_callbacks cb 0x7fa278009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa290e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa292200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759ff370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa292200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759ff370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:52908/0 (socket says 172.21.15.62:52908) 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa292200640 1 -- 172.21.15.62:0/3217893315 learned_addr learned my addr 172.21.15.62:0/3217893315 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa292200640 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa292200640 1 -- 172.21.15.62:0/3217893315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 msgr2=0x564b759f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa292200640 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa292200640 1 -- 172.21.15.62:0/3217893315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 msgr2=0x564b759f86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa292200640 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759f86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa292200640 1 -- 172.21.15.62:0/3217893315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b759f9470 con 0x564b759d94e0 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa292200640 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759ff370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa284004af0 tx=0x7fa28402f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df4286e11443d72f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.188+0000 7fa273400640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa273400640 1 -- 172.21.15.62:0/3217893315 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284003c40 con 0x564b759d94e0 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa273400640 1 -- 172.21.15.62:0/3217893315 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fa284003de0 con 0x564b759d94e0 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa296dde740 1 -- 172.21.15.62:0/3217893315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa27801c530 con 0x564b759d94e0 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa273400640 1 -- 172.21.15.62:0/3217893315 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa284004b40 con 0x564b759d94e0 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa296dde740 10 client.24971 fetch_fsmap learned FSMap version 21 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa296dde740 1 -- 172.21.15.62:0/3217893315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564b75a5fc90 con 0x564b759d94e0 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa273400640 1 -- 172.21.15.62:0/3217893315 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa27801c530 con 0x564b759d94e0 2024-09-12T01:58:38.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa273400640 1 -- 172.21.15.62:0/3217893315 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa284043070 con 0x564b759d94e0 2024-09-12T01:58:38.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa296dde740 10 client.24971 fetch_fsmap finished waiting for FSMap version 21 2024-09-12T01:58:38.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa296dde740 10 client.24971 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:58:38.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa296dde740 20 client.24971 populate_metadata read hostname 'smithi062' 2024-09-12T01:58:38.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.189+0000 7fa296dde740 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x564b75a645b0 0x564b75a632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:38.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.190+0000 7fa296dde740 4 client.24971 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:58:38.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.190+0000 7fa296dde740 1 -- 172.21.15.62:0/3217893315 --> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] -- command(tid 0: {"prefix": "status"}) -- 0x564b75946b30 con 0x564b75a645b0 2024-09-12T01:58:38.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.190+0000 7fa290e00640 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x564b75a645b0 0x564b75a632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:38.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.190+0000 7fa290e00640 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x564b75a645b0 0x564b75a632c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=867e540a0587be64 server_cookie=8b747839e932c95b in_seq=0 out_seq=0 2024-09-12T01:58:38.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.190+0000 7fa273400640 10 client.24971 ms_handle_connect on v2:172.21.15.77:6838/1365701824 2024-09-12T01:58:38.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.190+0000 7fa273400640 1 -- 172.21.15.62:0/3217893315 <== mds.0 v2:172.21.15.77:6838/1365701824 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x564b75946b30 con 0x564b75a645b0 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.190+0000 7fa273400640 10 client.24971 handle_command_reply: tid=0 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.190+0000 7fa296dde740 1 client.24971 shutdown 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 1 -- 172.21.15.62:0/3217893315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 msgr2=0x564b759ff370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759ff370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa284004af0 tx=0x7fa28402f3c0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 1 -- 172.21.15.62:0/3217893315 shutdown_connections 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x564b75a645b0 0x564b75a632c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564b759e46c0 0x564b759f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b759d9e00 0x564b759f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 1 --2- 172.21.15.62:0/3217893315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b759d94e0 0x564b759ff370 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa273400640 0 client.24971 ms_handle_reset on v2:172.21.15.77:6838/1365701824 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 1 -- 172.21.15.62:0/3217893315 >> 172.21.15.62:0/3217893315 conn(0x564b759d5a70 msgr2=0x564b759d4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 1 -- 172.21.15.62:0/3217893315 shutdown_connections 2024-09-12T01:58:38.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 1 -- 172.21.15.62:0/3217893315 wait complete. 2024-09-12T01:58:38.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.191+0000 7fa296dde740 20 client.24971 trim_cache size 0 max 16384 2024-09-12T01:58:38.198 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:58:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "f18ee350-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:58:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2024-09-12T01:58:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 24530, 2024-09-12T01:58:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2024-09-12T01:58:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2024-09-12T01:58:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2024-09-12T01:58:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 115.399981959, 2024-09-12T01:58:38.198 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 21, 2024-09-12T01:58:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 94, 2024-09-12T01:58:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 92, 2024-09-12T01:58:38.199 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 127.982485165 2024-09-12T01:58:38.199 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:58:38.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 -- 172.21.15.62:0/2701551306 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa2740a2c90 msgr2=0x7fa2740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa2740a2c90 0x7fa2740a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa280009610 tx=0x7fa2800d2960 comp rx=0 tx=0).stop 2024-09-12T01:58:38.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 -- 172.21.15.62:0/2701551306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28c103e30 msgr2=0x7fa28c19a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:38.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28c103e30 0x7fa28c19a410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa28000d950 tx=0x7fa28000de10 comp rx=0 tx=0).stop 2024-09-12T01:58:38.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 -- 172.21.15.62:0/2701551306 shutdown_connections 2024-09-12T01:58:38.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fa2740a2c90 0x7fa2740a5150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa28c108f60 0x7fa28c19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28c1047e0 0x7fa28c19a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 --2- 172.21.15.62:0/2701551306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28c103e30 0x7fa28c19a410 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:38.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 -- 172.21.15.62:0/2701551306 >> 172.21.15.62:0/2701551306 conn(0x7fa28c0ff8d0 msgr2=0x7fa28c100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:38.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 -- 172.21.15.62:0/2701551306 shutdown_connections 2024-09-12T01:58:38.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:38.192+0000 7fa292c00640 1 -- 172.21.15.62:0/2701551306 wait complete. 2024-09-12T01:58:38.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:38 smithi062 ceph-mon[30666]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:38.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:38 smithi107 ceph-mon[35463]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:38.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:38 smithi077 ceph-mon[35095]: pgmap v362: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:38.969 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T01:58:38.970 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:58:38.979 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:58:38.980 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T01:58:39.355 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:39.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.925+0000 7f0824800640 1 -- 172.21.15.62:0/3286623333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f081c105920 msgr2=0x7f081c10c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.925+0000 7f0824800640 1 --2- 172.21.15.62:0/3286623333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f081c105920 0x7f081c10c240 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0818009ca0 tx=0x7f081802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.926+0000 7f0824800640 1 -- 172.21.15.62:0/3286623333 shutdown_connections 2024-09-12T01:58:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.926+0000 7f0824800640 1 --2- 172.21.15.62:0/3286623333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f081c105920 0x7f081c10c240 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.926+0000 7f0824800640 1 --2- 172.21.15.62:0/3286623333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f081c104f60 0x7f081c1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.926+0000 7f0824800640 1 --2- 172.21.15.62:0/3286623333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f081c103e00 0x7f081c104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.926+0000 7f0824800640 1 -- 172.21.15.62:0/3286623333 >> 172.21.15.62:0/3286623333 conn(0x7f081c0ff5b0 msgr2=0x7f081c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.926+0000 7f0824800640 1 -- 172.21.15.62:0/3286623333 shutdown_connections 2024-09-12T01:58:39.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.926+0000 7f0824800640 1 -- 172.21.15.62:0/3286623333 wait complete. 2024-09-12T01:58:39.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0824800640 1 Processor -- start 2024-09-12T01:58:39.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0824800640 1 -- start start 2024-09-12T01:58:39.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0824800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f081c103e00 0x7f081c19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0824800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f081c104f60 0x7f081c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0824800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f081c105920 0x7f081c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0824800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f081c10fb00 con 0x7f081c104f60 2024-09-12T01:58:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0824800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f081c10f980 con 0x7f081c105920 2024-09-12T01:58:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0824800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f081c10fc80 con 0x7f081c103e00 2024-09-12T01:58:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0821e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f081c103e00 0x7f081c19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0821400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f081c104f60 0x7f081c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0821e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f081c103e00 0x7f081c19a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:50406/0 (socket says 172.21.15.62:50406) 2024-09-12T01:58:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0821e00640 1 -- 172.21.15.62:0/329682637 learned_addr learned my addr 172.21.15.62:0/329682637 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:39.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.927+0000 7f0822800640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f081c105920 0x7f081c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.928+0000 7f0821400640 1 -- 172.21.15.62:0/329682637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f081c103e00 msgr2=0x7f081c19a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.928+0000 7f0821400640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f081c103e00 0x7f081c19a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.928+0000 7f0821400640 1 -- 172.21.15.62:0/329682637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f081c105920 msgr2=0x7f081c1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.928+0000 7f0821400640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f081c105920 0x7f081c1a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.928+0000 7f0821400640 1 -- 172.21.15.62:0/329682637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081c1a1ca0 con 0x7f081c104f60 2024-09-12T01:58:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.928+0000 7f0822800640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f081c105920 0x7f081c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.928+0000 7f0821400640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f081c104f60 0x7f081c19a5b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f080c00e9c0 tx=0x7f080c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.928+0000 7f0816a00640 1 -- 172.21.15.62:0/329682637 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c00ccc0 con 0x7f081c104f60 2024-09-12T01:58:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.929+0000 7f0816a00640 1 -- 172.21.15.62:0/329682637 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f080c0035f0 con 0x7f081c104f60 2024-09-12T01:58:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.929+0000 7f0824800640 1 -- 172.21.15.62:0/329682637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081c1a1f90 con 0x7f081c104f60 2024-09-12T01:58:39.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.929+0000 7f0816a00640 1 -- 172.21.15.62:0/329682637 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c00ce60 con 0x7f081c104f60 2024-09-12T01:58:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.929+0000 7f0824800640 1 -- 172.21.15.62:0/329682637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f081c1a2440 con 0x7f081c104f60 2024-09-12T01:58:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.930+0000 7f0824800640 1 -- 172.21.15.62:0/329682637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f081c10b120 con 0x7f081c104f60 2024-09-12T01:58:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.932+0000 7f0816a00640 1 -- 172.21.15.62:0/329682637 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f080c0037a0 con 0x7f081c104f60 2024-09-12T01:58:39.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.933+0000 7f0816a00640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f08040a2cc0 0x7f08040a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.933+0000 7f0816a00640 1 -- 172.21.15.62:0/329682637 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f080c0cfa20 con 0x7f081c104f60 2024-09-12T01:58:39.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.933+0000 7f0821e00640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f08040a2cc0 0x7f08040a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.934+0000 7f0821e00640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f08040a2cc0 0x7f08040a5180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f08100095f0 tx=0x7f0810005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:39.937+0000 7f0816a00640 1 -- 172.21.15.62:0/329682637 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f080c09c410 con 0x7f081c104f60 2024-09-12T01:58:40.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.138+0000 7f0824800640 1 -- 172.21.15.62:0/329682637 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f081c062630 con 0x7f08040a2cc0 2024-09-12T01:58:40.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.139+0000 7f0816a00640 1 -- 172.21.15.62:0/329682637 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f081c062630 con 0x7f08040a2cc0 2024-09-12T01:58:40.140 INFO:teuthology.orchestra.run.smithi062.stdout:Backend: cephadm 2024-09-12T01:58:40.140 INFO:teuthology.orchestra.run.smithi062.stdout:Available: Yes 2024-09-12T01:58:40.140 INFO:teuthology.orchestra.run.smithi062.stdout:Paused: No 2024-09-12T01:58:40.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 -- 172.21.15.62:0/329682637 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f08040a2cc0 msgr2=0x7f08040a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f08040a2cc0 0x7f08040a5180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f08100095f0 tx=0x7f0810005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 -- 172.21.15.62:0/329682637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f081c104f60 msgr2=0x7f081c19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f081c104f60 0x7f081c19a5b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f080c00e9c0 tx=0x7f080c00ee80 comp rx=0 tx=0).stop 2024-09-12T01:58:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 -- 172.21.15.62:0/329682637 shutdown_connections 2024-09-12T01:58:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f08040a2cc0 0x7f08040a5180 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f081c105920 0x7f081c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f081c104f60 0x7f081c19a5b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 --2- 172.21.15.62:0/329682637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f081c103e00 0x7f081c19a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 -- 172.21.15.62:0/329682637 >> 172.21.15.62:0/329682637 conn(0x7f081c0ff5b0 msgr2=0x7f081c1082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 -- 172.21.15.62:0/329682637 shutdown_connections 2024-09-12T01:58:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:40.142+0000 7f0824800640 1 -- 172.21.15.62:0/329682637 wait complete. 2024-09-12T01:58:40.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:40 smithi062 ceph-mon[30666]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:40.824 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:40 smithi062 ceph-mon[30666]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:40.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T01:58:40.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:40 smithi107 ceph-mon[35463]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:40.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:40 smithi107 ceph-mon[35463]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:40.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:40 smithi077 ceph-mon[35095]: pgmap v363: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:40.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:40 smithi077 ceph-mon[35095]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:41.236 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:41.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.971+0000 7f84cb400640 1 -- 172.21.15.62:0/191167798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c4104f60 msgr2=0x7f84c41053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:41.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.971+0000 7f84cb400640 1 --2- 172.21.15.62:0/191167798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c4104f60 0x7f84c41053e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009860 tx=0x7f84b002a340 comp rx=0 tx=0).stop 2024-09-12T01:58:41.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.971+0000 7f84cb400640 1 -- 172.21.15.62:0/191167798 shutdown_connections 2024-09-12T01:58:41.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.971+0000 7f84cb400640 1 --2- 172.21.15.62:0/191167798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c4105920 0x7f84c410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:41.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.971+0000 7f84cb400640 1 --2- 172.21.15.62:0/191167798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c4104f60 0x7f84c41053e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:41.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.971+0000 7f84cb400640 1 --2- 172.21.15.62:0/191167798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84c4103e00 0x7f84c4104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:41.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.971+0000 7f84cb400640 1 -- 172.21.15.62:0/191167798 >> 172.21.15.62:0/191167798 conn(0x7f84c40ff5b0 msgr2=0x7f84c41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:41.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.971+0000 7f84cb400640 1 -- 172.21.15.62:0/191167798 shutdown_connections 2024-09-12T01:58:41.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.971+0000 7f84cb400640 1 -- 172.21.15.62:0/191167798 wait complete. 2024-09-12T01:58:41.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.972+0000 7f84cb400640 1 Processor -- start 2024-09-12T01:58:41.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.972+0000 7f84cb400640 1 -- start start 2024-09-12T01:58:41.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.972+0000 7f84cb400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84c4103e00 0x7f84c419a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:41.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.972+0000 7f84cb400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c4104f60 0x7f84c419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:41.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.972+0000 7f84cb400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c4105920 0x7f84c41a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:41.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.972+0000 7f84cb400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f84c410fab0 con 0x7f84c4105920 2024-09-12T01:58:41.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.972+0000 7f84cb400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f84c410f930 con 0x7f84c4104f60 2024-09-12T01:58:41.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.972+0000 7f84cb400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f84c410fc30 con 0x7f84c4103e00 2024-09-12T01:58:41.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.972+0000 7f84c8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84c4103e00 0x7f84c419a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:41.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84c4103e00 0x7f84c419a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:48056/0 (socket says 172.21.15.62:48056) 2024-09-12T01:58:41.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c8a00640 1 -- 172.21.15.62:0/1671248754 learned_addr learned my addr 172.21.15.62:0/1671248754 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:41.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c9400640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c4105920 0x7f84c41a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:41.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c3e00640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c4104f60 0x7f84c419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:41.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c8a00640 1 -- 172.21.15.62:0/1671248754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c4104f60 msgr2=0x7f84c419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c8a00640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c4104f60 0x7f84c419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c8a00640 1 -- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c4105920 msgr2=0x7f84c41a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c8a00640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c4105920 0x7f84c41a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c8a00640 1 -- 172.21.15.62:0/1671248754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c41a1d70 con 0x7f84c4103e00 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c3e00640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c4104f60 0x7f84c419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c9400640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c4105920 0x7f84c41a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c8a00640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84c4103e00 0x7f84c419a140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f84b800e9f0 tx=0x7f84b800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.973+0000 7f84c1600640 1 -- 172.21.15.62:0/1671248754 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b800ccc0 con 0x7f84c4103e00 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.974+0000 7f84c1600640 1 -- 172.21.15.62:0/1671248754 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84b8005500 con 0x7f84c4103e00 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.974+0000 7f84cb400640 1 -- 172.21.15.62:0/1671248754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c41a2060 con 0x7f84c4103e00 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.974+0000 7f84c1600640 1 -- 172.21.15.62:0/1671248754 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8010690 con 0x7f84c4103e00 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.974+0000 7f84cb400640 1 -- 172.21.15.62:0/1671248754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c41a2520 con 0x7f84c4103e00 2024-09-12T01:58:41.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.975+0000 7f84cb400640 1 -- 172.21.15.62:0/1671248754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c410b260 con 0x7f84c4103e00 2024-09-12T01:58:41.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.977+0000 7f84c1600640 1 -- 172.21.15.62:0/1671248754 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f84b80046c0 con 0x7f84c4103e00 2024-09-12T01:58:41.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.978+0000 7f84c1600640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84ac0a2c40 0x7f84ac0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:41.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.978+0000 7f84c1600640 1 -- 172.21.15.62:0/1671248754 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f84b80cfb90 con 0x7f84c4103e00 2024-09-12T01:58:41.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.978+0000 7f84c3e00640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84ac0a2c40 0x7f84ac0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:41.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.979+0000 7f84c3e00640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84ac0a2c40 0x7f84ac0a5100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84b002a930 tx=0x7f84b0030550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:41.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:41.980+0000 7f84c1600640 1 -- 172.21.15.62:0/1671248754 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84b80541b0 con 0x7f84c4103e00 2024-09-12T01:58:42.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.171+0000 7f84cb400640 1 -- 172.21.15.62:0/1671248754 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f84c4062630 con 0x7f84ac0a2c40 2024-09-12T01:58:42.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.183+0000 7f84c1600640 1 -- 172.21.15.62:0/1671248754 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7f84c4062630 con 0x7f84ac0a2c40 2024-09-12T01:58:42.184 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:58:42.185 INFO:teuthology.orchestra.run.smithi062.stdout:mds.a smithi062 running (2m) 59s ago 2m 12.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 927db4987c1c 2024-09-12T01:58:42.185 INFO:teuthology.orchestra.run.smithi062.stdout:mds.b smithi077 running (2m) 61s ago 2m 25.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 68f5bc005918 2024-09-12T01:58:42.185 INFO:teuthology.orchestra.run.smithi062.stdout:mds.c smithi107 running (2m) 61s ago 2m 15.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 efd3a644ad09 2024-09-12T01:58:42.185 INFO:teuthology.orchestra.run.smithi062.stdout:mds.d smithi062 running (2m) 59s ago 2m 12.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 c011d2c1515f 2024-09-12T01:58:42.185 INFO:teuthology.orchestra.run.smithi062.stdout:mds.e smithi077 running (2m) 61s ago 2m 13.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 f0ed852c5795 2024-09-12T01:58:42.185 INFO:teuthology.orchestra.run.smithi062.stdout:mds.f smithi107 running (2m) 61s ago 2m 16.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 588b9e99331b 2024-09-12T01:58:42.185 INFO:teuthology.orchestra.run.smithi062.stdout:mds.g smithi062 running (2m) 59s ago 2m 12.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 0e9f16d8fc64 2024-09-12T01:58:42.185 INFO:teuthology.orchestra.run.smithi062.stdout:mds.h smithi077 running (2m) 61s ago 2m 16.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 566c45f3f9ba 2024-09-12T01:58:42.185 INFO:teuthology.orchestra.run.smithi062.stdout:mds.i smithi107 running (2m) 61s ago 2m 18.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 c8c800cfffdf 2024-09-12T01:58:42.185 INFO:teuthology.orchestra.run.smithi062.stdout:mds.j smithi062 running (2m) 59s ago 2m 12.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 ac2606fdddea 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:mds.k smithi077 running (2m) 61s ago 2m 15.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 dce792c92bc6 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:mds.l smithi107 running (2m) 61s ago 2m 16.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 4b7050e0c909 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.x smithi062 *:9283,8765 running (10m) 59s ago 10m 507M - 19.1.1-298-gb53b6d3e 54467abc55f8 d0e9031ef5e8 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.y smithi077 *:8443,8765 running (8m) 61s ago 8m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 e399527f2314 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.z smithi107 *:8443,8765 running (8m) 61s ago 8m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 f38e15141b95 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a smithi062 running (10m) 59s ago 10m 46.6M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 39307ccb1c72 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b smithi077 running (8m) 61s ago 8m 42.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 fb80326a66f4 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c smithi107 running (8m) 61s ago 8m 41.2M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 b08c8381ddef 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (7m) 59s ago 7m 53.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 5952e09d58b6 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi077 running (7m) 61s ago 7m 46.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 7d433f223e48 2024-09-12T01:58:42.186 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi107 running (7m) 61s ago 7m 46.2M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 681e4ceb24dc 2024-09-12T01:58:42.187 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi062 running (6m) 59s ago 6m 51.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ebadf660d2fb 2024-09-12T01:58:42.187 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi077 running (6m) 61s ago 6m 42.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 aba4758a23df 2024-09-12T01:58:42.187 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi107 running (5m) 61s ago 5m 56.2M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 0acd70f7713d 2024-09-12T01:58:42.187 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 smithi062 running (5m) 59s ago 5m 41.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 bc9ecf714e9f 2024-09-12T01:58:42.187 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 smithi077 running (4m) 61s ago 4m 52.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 abbbba64419c 2024-09-12T01:58:42.187 INFO:teuthology.orchestra.run.smithi062.stdout:osd.8 smithi107 running (4m) 61s ago 4m 43.7M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 b3995a1e2862 2024-09-12T01:58:42.187 INFO:teuthology.orchestra.run.smithi062.stdout:osd.9 smithi062 running (3m) 59s ago 3m 41.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 b787c50ff905 2024-09-12T01:58:42.187 INFO:teuthology.orchestra.run.smithi062.stdout:osd.10 smithi077 running (3m) 61s ago 3m 55.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 b1e1265fdd0b 2024-09-12T01:58:42.187 INFO:teuthology.orchestra.run.smithi062.stdout:osd.11 smithi107 running (3m) 61s ago 3m 42.3M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 f96120a3b344 2024-09-12T01:58:42.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.185+0000 7f84cb400640 1 -- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84ac0a2c40 msgr2=0x7f84ac0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:42.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.185+0000 7f84cb400640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84ac0a2c40 0x7f84ac0a5100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84b002a930 tx=0x7f84b0030550 comp rx=0 tx=0).stop 2024-09-12T01:58:42.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.185+0000 7f84cb400640 1 -- 172.21.15.62:0/1671248754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84c4103e00 msgr2=0x7f84c419a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:42.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.185+0000 7f84cb400640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84c4103e00 0x7f84c419a140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f84b800e9f0 tx=0x7f84b800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.186+0000 7f84cb400640 1 -- 172.21.15.62:0/1671248754 shutdown_connections 2024-09-12T01:58:42.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.186+0000 7f84cb400640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f84ac0a2c40 0x7f84ac0a5100 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.186+0000 7f84cb400640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84c4105920 0x7f84c41a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.186+0000 7f84cb400640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c4104f60 0x7f84c419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.186+0000 7f84cb400640 1 --2- 172.21.15.62:0/1671248754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84c4103e00 0x7f84c419a140 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.186+0000 7f84cb400640 1 -- 172.21.15.62:0/1671248754 >> 172.21.15.62:0/1671248754 conn(0x7f84c40ff5b0 msgr2=0x7f84c4108430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:42.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.186+0000 7f84cb400640 1 -- 172.21.15.62:0/1671248754 shutdown_connections 2024-09-12T01:58:42.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:42.186+0000 7f84cb400640 1 -- 172.21.15.62:0/1671248754 wait complete. 2024-09-12T01:58:42.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:42 smithi062 ceph-mon[30666]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:42.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:42 smithi062 ceph-mon[30666]: from='client.25012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:42.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:42 smithi107 ceph-mon[35463]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:42.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:42 smithi107 ceph-mon[35463]: from='client.25012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:42.955 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T01:58:42.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:42 smithi077 ceph-mon[35095]: pgmap v364: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:42.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:42 smithi077 ceph-mon[35095]: from='client.25012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:43.331 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:43.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.867+0000 7fd4f7000640 1 -- 172.21.15.62:0/1111992637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4f01017d0 msgr2=0x7fd4f0101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:43.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.867+0000 7fd4f7000640 1 --2- 172.21.15.62:0/1111992637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4f01017d0 0x7fd4f0101c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009ca0 tx=0x7fd4e802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:43.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.867+0000 7fd4f7000640 1 -- 172.21.15.62:0/1111992637 shutdown_connections 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.867+0000 7fd4f7000640 1 --2- 172.21.15.62:0/1111992637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4f01017d0 0x7fd4f0101c80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.867+0000 7fd4f7000640 1 --2- 172.21.15.62:0/1111992637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f0100e30 0x7fd4f0101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.867+0000 7fd4f7000640 1 --2- 172.21.15.62:0/1111992637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f01004f0 0x7fd4f01008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.867+0000 7fd4f7000640 1 -- 172.21.15.62:0/1111992637 >> 172.21.15.62:0/1111992637 conn(0x7fd4f00fc2a0 msgr2=0x7fd4f00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.867+0000 7fd4f7000640 1 -- 172.21.15.62:0/1111992637 shutdown_connections 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.867+0000 7fd4f7000640 1 -- 172.21.15.62:0/1111992637 wait complete. 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.868+0000 7fd4f7000640 1 Processor -- start 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.868+0000 7fd4f7000640 1 -- start start 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.868+0000 7fd4f7000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f01004f0 0x7fd4f019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.868+0000 7fd4f7000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f0100e30 0x7fd4f019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:43.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.868+0000 7fd4f7000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4f01017d0 0x7fd4f01a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:43.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.868+0000 7fd4f7000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f010fab0 con 0x7fd4f01017d0 2024-09-12T01:58:43.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.868+0000 7fd4f7000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f010f930 con 0x7fd4f01004f0 2024-09-12T01:58:43.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.868+0000 7fd4f7000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f010fc30 con 0x7fd4f0100e30 2024-09-12T01:58:43.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.868+0000 7fd4efe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f01004f0 0x7fd4f019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:43.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.869+0000 7fd4efe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f01004f0 0x7fd4f019a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:60750/0 (socket says 172.21.15.62:60750) 2024-09-12T01:58:43.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.869+0000 7fd4efe00640 1 -- 172.21.15.62:0/2583071525 learned_addr learned my addr 172.21.15.62:0/2583071525 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:43.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.869+0000 7fd4f5000640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4f01017d0 0x7fd4f01a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:43.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.869+0000 7fd4e7e00640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f0100e30 0x7fd4f019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:43.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.869+0000 7fd4efe00640 1 -- 172.21.15.62:0/2583071525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f0100e30 msgr2=0x7fd4f019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.869+0000 7fd4efe00640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f0100e30 0x7fd4f019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.869+0000 7fd4efe00640 1 -- 172.21.15.62:0/2583071525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4f01017d0 msgr2=0x7fd4f01a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.869+0000 7fd4efe00640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4f01017d0 0x7fd4f01a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.869+0000 7fd4efe00640 1 -- 172.21.15.62:0/2583071525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f01a1d10 con 0x7fd4f01004f0 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.869+0000 7fd4efe00640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f01004f0 0x7fd4f019a0e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000d950 tx=0x7fd4e000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.870+0000 7fd4ed600640 1 -- 172.21.15.62:0/2583071525 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0017030 con 0x7fd4f01004f0 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.870+0000 7fd4ed600640 1 -- 172.21.15.62:0/2583071525 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4e0004020 con 0x7fd4f01004f0 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.870+0000 7fd4ed600640 1 -- 172.21.15.62:0/2583071525 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00047a0 con 0x7fd4f01004f0 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.870+0000 7fd4f7000640 1 -- 172.21.15.62:0/2583071525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f01a1fa0 con 0x7fd4f01004f0 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.870+0000 7fd4f7000640 1 -- 172.21.15.62:0/2583071525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f01a24a0 con 0x7fd4f01004f0 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.871+0000 7fd4f7000640 1 -- 172.21.15.62:0/2583071525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f010b240 con 0x7fd4f01004f0 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.873+0000 7fd4ed600640 1 -- 172.21.15.62:0/2583071525 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd4e00041d0 con 0x7fd4f01004f0 2024-09-12T01:58:43.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.874+0000 7fd4ed600640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4d40a2cc0 0x7fd4d40a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:43.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.874+0000 7fd4ed600640 1 -- 172.21.15.62:0/2583071525 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fd4e00ceee0 con 0x7fd4f01004f0 2024-09-12T01:58:43.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.874+0000 7fd4e7e00640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4d40a2cc0 0x7fd4d40a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:43.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.875+0000 7fd4e7e00640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4d40a2cc0 0x7fd4d40a5180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd4f019b600 tx=0x7fd4d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:43.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:43.878+0000 7fd4ed600640 1 -- 172.21.15.62:0/2583071525 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4e009b8d0 con 0x7fd4f01004f0 2024-09-12T01:58:44.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.075+0000 7fd4f7000640 1 -- 172.21.15.62:0/2583071525 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fd4f0062630 con 0x7fd4d40a2cc0 2024-09-12T01:58:44.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.081+0000 7fd4ed600640 1 -- 172.21.15.62:0/2583071525 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fd4f0062630 con 0x7fd4d40a2cc0 2024-09-12T01:58:44.082 INFO:teuthology.orchestra.run.smithi062.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T01:58:44.082 INFO:teuthology.orchestra.run.smithi062.stdout:mds.all 12/12 63s ago 2m smithi062=a;smithi062=d;smithi062=g;smithi062=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi107=c;smithi107=f;smithi107=i;smithi107=l;count:12 2024-09-12T01:58:44.082 INFO:teuthology.orchestra.run.smithi062.stdout:mgr 3/3 63s ago 8m smithi062=x;smithi077=y;smithi107=z;count:3 2024-09-12T01:58:44.082 INFO:teuthology.orchestra.run.smithi062.stdout:mon 3/3 63s ago 8m smithi062:172.21.15.62=a;smithi077:172.21.15.77=b;smithi107:172.21.15.107=c;count:3 2024-09-12T01:58:44.082 INFO:teuthology.orchestra.run.smithi062.stdout:osd 12 63s ago - 2024-09-12T01:58:44.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.083+0000 7fd4f7000640 1 -- 172.21.15.62:0/2583071525 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4d40a2cc0 msgr2=0x7fd4d40a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.083+0000 7fd4f7000640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4d40a2cc0 0x7fd4d40a5180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd4f019b600 tx=0x7fd4d8005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.083+0000 7fd4f7000640 1 -- 172.21.15.62:0/2583071525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f01004f0 msgr2=0x7fd4f019a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.083+0000 7fd4f7000640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f01004f0 0x7fd4f019a0e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000d950 tx=0x7fd4e000de10 comp rx=0 tx=0).stop 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.083+0000 7fd4f7000640 1 -- 172.21.15.62:0/2583071525 shutdown_connections 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.083+0000 7fd4f7000640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fd4d40a2cc0 0x7fd4d40a5180 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.083+0000 7fd4f7000640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4f01017d0 0x7fd4f01a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.083+0000 7fd4f7000640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4f0100e30 0x7fd4f019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.083+0000 7fd4f7000640 1 --2- 172.21.15.62:0/2583071525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f01004f0 0x7fd4f019a0e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.083+0000 7fd4f7000640 1 -- 172.21.15.62:0/2583071525 >> 172.21.15.62:0/2583071525 conn(0x7fd4f00fc2a0 msgr2=0x7fd4f00fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.084+0000 7fd4f7000640 1 -- 172.21.15.62:0/2583071525 shutdown_connections 2024-09-12T01:58:44.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:44.084+0000 7fd4f7000640 1 -- 172.21.15.62:0/2583071525 wait complete. 2024-09-12T01:58:44.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:44 smithi062 ceph-mon[30666]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:44.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:44 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:44.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:44 smithi062 ceph-mon[30666]: from='client.24989 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:44.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T01:58:44.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:44 smithi107 ceph-mon[35463]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:44.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:44 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:44.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:44 smithi107 ceph-mon[35463]: from='client.24989 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:44.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:44 smithi077 ceph-mon[35095]: pgmap v365: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:44.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:44 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:44.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:44 smithi077 ceph-mon[35095]: from='client.24989 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:45.920 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:46.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:46 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.508+0000 7f37d3800640 1 -- 172.21.15.62:0/2304602314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37cc105920 msgr2=0x7f37cc10c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.508+0000 7f37d3800640 1 --2- 172.21.15.62:0/2304602314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37cc105920 0x7f37cc10c240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009ca0 tx=0x7f37c402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.508+0000 7f37d3800640 1 -- 172.21.15.62:0/2304602314 shutdown_connections 2024-09-12T01:58:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.508+0000 7f37d3800640 1 --2- 172.21.15.62:0/2304602314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37cc105920 0x7f37cc10c240 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.508+0000 7f37d3800640 1 --2- 172.21.15.62:0/2304602314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37cc104f60 0x7f37cc1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.508+0000 7f37d3800640 1 --2- 172.21.15.62:0/2304602314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37cc103e00 0x7f37cc104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.508+0000 7f37d3800640 1 -- 172.21.15.62:0/2304602314 >> 172.21.15.62:0/2304602314 conn(0x7f37cc0ff5b0 msgr2=0x7f37cc1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.508+0000 7f37d3800640 1 -- 172.21.15.62:0/2304602314 shutdown_connections 2024-09-12T01:58:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.508+0000 7f37d3800640 1 -- 172.21.15.62:0/2304602314 wait complete. 2024-09-12T01:58:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.509+0000 7f37d3800640 1 Processor -- start 2024-09-12T01:58:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.509+0000 7f37d3800640 1 -- start start 2024-09-12T01:58:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.509+0000 7f37d3800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37cc103e00 0x7f37cc19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.509+0000 7f37d3800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37cc104f60 0x7f37cc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.509+0000 7f37d3800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37cc105920 0x7f37cc1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.509+0000 7f37d3800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc10fae0 con 0x7f37cc104f60 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.509+0000 7f37d3800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc10f960 con 0x7f37cc105920 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.509+0000 7f37d3800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc10fc60 con 0x7f37cc103e00 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d0e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37cc103e00 0x7f37cc19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d0e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37cc103e00 0x7f37cc19a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:48100/0 (socket says 172.21.15.62:48100) 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d0e00640 1 -- 172.21.15.62:0/1529334516 learned_addr learned my addr 172.21.15.62:0/1529334516 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d1800640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37cc105920 0x7f37cc1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37c3e00640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37cc104f60 0x7f37cc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d0e00640 1 -- 172.21.15.62:0/1529334516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37cc105920 msgr2=0x7f37cc1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d0e00640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37cc105920 0x7f37cc1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d0e00640 1 -- 172.21.15.62:0/1529334516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37cc104f60 msgr2=0x7f37cc19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d0e00640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37cc104f60 0x7f37cc19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d0e00640 1 -- 172.21.15.62:0/1529334516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37cc1a1c80 con 0x7f37cc103e00 2024-09-12T01:58:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d1800640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37cc105920 0x7f37cc1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.510+0000 7f37d0e00640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37cc103e00 0x7f37cc19a050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00ea60 tx=0x7f37bc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.511+0000 7f37ca000640 1 -- 172.21.15.62:0/1529334516 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00cde0 con 0x7f37cc103e00 2024-09-12T01:58:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.511+0000 7f37ca000640 1 -- 172.21.15.62:0/1529334516 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37bc0035f0 con 0x7f37cc103e00 2024-09-12T01:58:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.511+0000 7f37d3800640 1 -- 172.21.15.62:0/1529334516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37cc1a1f70 con 0x7f37cc103e00 2024-09-12T01:58:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.511+0000 7f37ca000640 1 -- 172.21.15.62:0/1529334516 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc010670 con 0x7f37cc103e00 2024-09-12T01:58:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.511+0000 7f37d3800640 1 -- 172.21.15.62:0/1529334516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37cc1a2420 con 0x7f37cc103e00 2024-09-12T01:58:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.512+0000 7f37d3800640 1 -- 172.21.15.62:0/1529334516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37cc10b120 con 0x7f37cc103e00 2024-09-12T01:58:46.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.514+0000 7f37ca000640 1 -- 172.21.15.62:0/1529334516 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f37bc0037a0 con 0x7f37cc103e00 2024-09-12T01:58:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.515+0000 7f37ca000640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37b00a2cc0 0x7f37b00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.515+0000 7f37ca000640 1 -- 172.21.15.62:0/1529334516 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f37bc0cf880 con 0x7f37cc103e00 2024-09-12T01:58:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.515+0000 7f37c3e00640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37b00a2cc0 0x7f37b00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.516+0000 7f37c3e00640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37b00a2cc0 0x7f37b00a5180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37b40095f0 tx=0x7f37b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.517+0000 7f37ca000640 1 -- 172.21.15.62:0/1529334516 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37bc09c270 con 0x7f37cc103e00 2024-09-12T01:58:46.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:46 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:46 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:46.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.718+0000 7f37d3800640 1 -- 172.21.15.62:0/1529334516 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f37cc062630 con 0x7f37b00a2cc0 2024-09-12T01:58:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.719+0000 7f37ca000640 1 -- 172.21.15.62:0/1529334516 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f37cc062630 con 0x7f37b00a2cc0 2024-09-12T01:58:46.720 INFO:teuthology.orchestra.run.smithi062.stdout:HOST ADDR LABELS STATUS 2024-09-12T01:58:46.720 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062 172.21.15.62 2024-09-12T01:58:46.720 INFO:teuthology.orchestra.run.smithi062.stdout:smithi077 172.21.15.77 2024-09-12T01:58:46.720 INFO:teuthology.orchestra.run.smithi062.stdout:smithi107 172.21.15.107 2024-09-12T01:58:46.721 INFO:teuthology.orchestra.run.smithi062.stdout:3 hosts in cluster 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.722+0000 7f37d3800640 1 -- 172.21.15.62:0/1529334516 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37b00a2cc0 msgr2=0x7f37b00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.722+0000 7f37d3800640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37b00a2cc0 0x7f37b00a5180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37b40095f0 tx=0x7f37b4005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.722+0000 7f37d3800640 1 -- 172.21.15.62:0/1529334516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37cc103e00 msgr2=0x7f37cc19a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.722+0000 7f37d3800640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37cc103e00 0x7f37cc19a050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00ea60 tx=0x7f37bc00ef20 comp rx=0 tx=0).stop 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.723+0000 7f37d3800640 1 -- 172.21.15.62:0/1529334516 shutdown_connections 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.723+0000 7f37d3800640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f37b00a2cc0 0x7f37b00a5180 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.723+0000 7f37d3800640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37cc105920 0x7f37cc1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.723+0000 7f37d3800640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37cc104f60 0x7f37cc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.723+0000 7f37d3800640 1 --2- 172.21.15.62:0/1529334516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37cc103e00 0x7f37cc19a050 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.723+0000 7f37d3800640 1 -- 172.21.15.62:0/1529334516 >> 172.21.15.62:0/1529334516 conn(0x7f37cc0ff5b0 msgr2=0x7f37cc1082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:46.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.723+0000 7f37d3800640 1 -- 172.21.15.62:0/1529334516 shutdown_connections 2024-09-12T01:58:46.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:46.723+0000 7f37d3800640 1 -- 172.21.15.62:0/1529334516 wait complete. 2024-09-12T01:58:47.504 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:47 smithi062 ceph-mon[30666]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:47.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T01:58:47.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:47 smithi107 ceph-mon[35463]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:47.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:47 smithi077 ceph-mon[35095]: pgmap v366: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:47.965 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:48.435 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:48 smithi062 ceph-mon[30666]: from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:48.435 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:48 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:48.435 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:48 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.555+0000 7f1a16600640 1 -- 172.21.15.62:0/2922066697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a10102c40 msgr2=0x7f1a101030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.555+0000 7f1a16600640 1 --2- 172.21.15.62:0/2922066697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a10102c40 0x7f1a101030c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009900 tx=0x7f19fc02a3f0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.555+0000 7f1a16600640 1 -- 172.21.15.62:0/2922066697 shutdown_connections 2024-09-12T01:58:48.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.555+0000 7f1a16600640 1 --2- 172.21.15.62:0/2922066697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a10103600 0x7f1a10109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.555+0000 7f1a16600640 1 --2- 172.21.15.62:0/2922066697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a10102c40 0x7f1a101030c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.555+0000 7f1a16600640 1 --2- 172.21.15.62:0/2922066697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10101a40 0x7f1a10101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.555+0000 7f1a16600640 1 -- 172.21.15.62:0/2922066697 >> 172.21.15.62:0/2922066697 conn(0x7f1a100fd1f0 msgr2=0x7f1a100ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.555+0000 7f1a16600640 1 -- 172.21.15.62:0/2922066697 shutdown_connections 2024-09-12T01:58:48.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.555+0000 7f1a16600640 1 -- 172.21.15.62:0/2922066697 wait complete. 2024-09-12T01:58:48.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.556+0000 7f1a16600640 1 Processor -- start 2024-09-12T01:58:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a16600640 1 -- start start 2024-09-12T01:58:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a16600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a10101a40 0x7f1a10197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a16600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a10102c40 0x7f1a10198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a16600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10103600 0x7f1a1019f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a16600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1010d710 con 0x7f1a10102c40 2024-09-12T01:58:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a16600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1010d590 con 0x7f1a10103600 2024-09-12T01:58:48.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a16600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1010d890 con 0x7f1a10101a40 2024-09-12T01:58:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a0fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a10102c40 0x7f1a10198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a0fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a10102c40 0x7f1a10198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52094/0 (socket says 172.21.15.62:52094) 2024-09-12T01:58:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a0fe00640 1 -- 172.21.15.62:0/3498804200 learned_addr learned my addr 172.21.15.62:0/3498804200 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.557+0000 7f1a15200640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a10101a40 0x7f1a10197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.558+0000 7f1a15c00640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10103600 0x7f1a1019f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.558+0000 7f1a0fe00640 1 -- 172.21.15.62:0/3498804200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a10101a40 msgr2=0x7f1a10197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.558+0000 7f1a0fe00640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a10101a40 0x7f1a10197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.558+0000 7f1a0fe00640 1 -- 172.21.15.62:0/3498804200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10103600 msgr2=0x7f1a1019f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.558+0000 7f1a0fe00640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10103600 0x7f1a1019f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.558+0000 7f1a0fe00640 1 -- 172.21.15.62:0/3498804200 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a10074420 con 0x7f1a10102c40 2024-09-12T01:58:48.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.558+0000 7f1a0fe00640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a10102c40 0x7f1a10198240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f19fc031440 tx=0x7f19fc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.559+0000 7f1a0d600640 1 -- 172.21.15.62:0/3498804200 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc03f030 con 0x7f1a10102c40 2024-09-12T01:58:48.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.559+0000 7f1a0d600640 1 -- 172.21.15.62:0/3498804200 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19fc003ce0 con 0x7f1a10102c40 2024-09-12T01:58:48.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.559+0000 7f1a16600640 1 -- 172.21.15.62:0/3498804200 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a100746b0 con 0x7f1a10102c40 2024-09-12T01:58:48.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.559+0000 7f1a0d600640 1 -- 172.21.15.62:0/3498804200 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc035070 con 0x7f1a10102c40 2024-09-12T01:58:48.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.559+0000 7f1a16600640 1 -- 172.21.15.62:0/3498804200 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a10074be0 con 0x7f1a10102c40 2024-09-12T01:58:48.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.560+0000 7f1a16600640 1 -- 172.21.15.62:0/3498804200 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a1002d7c0 con 0x7f1a10102c40 2024-09-12T01:58:48.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.562+0000 7f1a0d600640 1 -- 172.21.15.62:0/3498804200 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f19fc042030 con 0x7f1a10102c40 2024-09-12T01:58:48.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.563+0000 7f1a0d600640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f19f80a2c90 0x7f19f80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.564+0000 7f1a0d600640 1 -- 172.21.15.62:0/3498804200 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f19fc0efa20 con 0x7f1a10102c40 2024-09-12T01:58:48.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.564+0000 7f1a15200640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f19f80a2c90 0x7f19f80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.565+0000 7f1a15200640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f19f80a2c90 0x7f19f80a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a101991e0 tx=0x7f1a04005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.568+0000 7f1a0d600640 1 -- 172.21.15.62:0/3498804200 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19fc0bbdc0 con 0x7f1a10102c40 2024-09-12T01:58:48.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:48 smithi107 ceph-mon[35463]: from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:48.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:48 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:48.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:48 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:48.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:48 smithi077 ceph-mon[35095]: from='client.25024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:48.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:48 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:48.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:48 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:48.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.769+0000 7f1a16600640 1 -- 172.21.15.62:0/3498804200 --> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f1a10108970 con 0x7f19f80a2c90 2024-09-12T01:58:48.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.771+0000 7f1a0d600640 1 -- 172.21.15.62:0/3498804200 <== mgr.14152 v2:172.21.15.62:6800/1859863767 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f1a10108970 con 0x7f19f80a2c90 2024-09-12T01:58:48.772 INFO:teuthology.orchestra.run.smithi062.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T01:58:48.772 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53440094400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T01:58:48.772 INFO:teuthology.orchestra.run.smithi062.stdout:smithi077 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZJ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T01:58:48.772 INFO:teuthology.orchestra.run.smithi062.stdout:smithi107 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NK400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T01:58:48.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 -- 172.21.15.62:0/3498804200 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f19f80a2c90 msgr2=0x7f19f80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f19f80a2c90 0x7f19f80a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a101991e0 tx=0x7f1a04005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 -- 172.21.15.62:0/3498804200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a10102c40 msgr2=0x7f1a10198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a10102c40 0x7f1a10198240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f19fc031440 tx=0x7f19fc032ce0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 -- 172.21.15.62:0/3498804200 shutdown_connections 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f19f80a2c90 0x7f19f80a5150 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10103600 0x7f1a1019f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a10102c40 0x7f1a10198240 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 --2- 172.21.15.62:0/3498804200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a10101a40 0x7f1a10197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 -- 172.21.15.62:0/3498804200 >> 172.21.15.62:0/3498804200 conn(0x7f1a100fd1f0 msgr2=0x7f1a10105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 -- 172.21.15.62:0/3498804200 shutdown_connections 2024-09-12T01:58:48.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:48.775+0000 7f1a16600640 1 -- 172.21.15.62:0/3498804200 wait complete. 2024-09-12T01:58:49.505 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:49 smithi062 ceph-mon[30666]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:49.505 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:49.505 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:49.505 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:49 smithi062 ceph-mon[30666]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:49.544 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:58:49.553 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:58:49.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T01:58:49.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:49 smithi107 ceph-mon[35463]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:49.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:49.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:49.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:49 smithi107 ceph-mon[35463]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:49.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:49 smithi077 ceph-mon[35095]: pgmap v367: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:58:49.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:49.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:49.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:49 smithi077 ceph-mon[35095]: from='mgr.14152 172.21.15.62:0/3453612602' entity='mgr.x' 2024-09-12T01:58:49.943 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:50.509 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:50 smithi062 ceph-mon[30666]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:50.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.524+0000 7f4ffb800640 1 -- 172.21.15.62:0/1442857715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ff4105920 msgr2=0x7f4ff410c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:50.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.524+0000 7f4ffb800640 1 --2- 172.21.15.62:0/1442857715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ff4105920 0x7f4ff410c240 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009ca0 tx=0x7f4fec02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.525+0000 7f4ffb800640 1 -- 172.21.15.62:0/1442857715 shutdown_connections 2024-09-12T01:58:50.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.525+0000 7f4ffb800640 1 --2- 172.21.15.62:0/1442857715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ff4105920 0x7f4ff410c240 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.525+0000 7f4ffb800640 1 --2- 172.21.15.62:0/1442857715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff4104f60 0x7f4ff41053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.525+0000 7f4ffb800640 1 --2- 172.21.15.62:0/1442857715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ff4103e00 0x7f4ff4104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.525+0000 7f4ffb800640 1 -- 172.21.15.62:0/1442857715 >> 172.21.15.62:0/1442857715 conn(0x7f4ff40ff5b0 msgr2=0x7f4ff41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:50.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.525+0000 7f4ffb800640 1 -- 172.21.15.62:0/1442857715 shutdown_connections 2024-09-12T01:58:50.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.525+0000 7f4ffb800640 1 -- 172.21.15.62:0/1442857715 wait complete. 2024-09-12T01:58:50.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ffb800640 1 Processor -- start 2024-09-12T01:58:50.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ffb800640 1 -- start start 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ffb800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ffb800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff4104f60 0x7f4ff419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ffb800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ff4105920 0x7f4ff41a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ffb800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410fb00 con 0x7f4ff4103e00 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ffb800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410f980 con 0x7f4ff4104f60 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ffb800640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410fc80 con 0x7f4ff4105920 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ff8e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ff8e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52116/0 (socket says 172.21.15.62:52116) 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.526+0000 7f4ff8e00640 1 -- 172.21.15.62:0/2914883623 learned_addr learned my addr 172.21.15.62:0/2914883623 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.527+0000 7f4febe00640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff4104f60 0x7f4ff419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:50.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.527+0000 7f4ff9800640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ff4105920 0x7f4ff41a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:50.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.527+0000 7f4ff8e00640 1 -- 172.21.15.62:0/2914883623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ff4105920 msgr2=0x7f4ff41a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:50.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.527+0000 7f4ff8e00640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ff4105920 0x7f4ff41a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.527+0000 7f4ff8e00640 1 -- 172.21.15.62:0/2914883623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff4104f60 msgr2=0x7f4ff419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:50.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.527+0000 7f4ff8e00640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff4104f60 0x7f4ff419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.527+0000 7f4ff8e00640 1 -- 172.21.15.62:0/2914883623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff41a1cd0 con 0x7f4ff4103e00 2024-09-12T01:58:50.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.527+0000 7f4ff8e00640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a0a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400e9f0 tx=0x7f4fe400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:50.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.527+0000 7f4ff2000640 1 -- 172.21.15.62:0/2914883623 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400cd80 con 0x7f4ff4103e00 2024-09-12T01:58:50.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.527+0000 7f4ff2000640 1 -- 172.21.15.62:0/2914883623 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe4005500 con 0x7f4ff4103e00 2024-09-12T01:58:50.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.528+0000 7f4ff2000640 1 -- 172.21.15.62:0/2914883623 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4010690 con 0x7f4ff4103e00 2024-09-12T01:58:50.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.528+0000 7f4ffb800640 1 -- 172.21.15.62:0/2914883623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff41a1fc0 con 0x7f4ff4103e00 2024-09-12T01:58:50.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.528+0000 7f4ffb800640 1 -- 172.21.15.62:0/2914883623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff41a23c0 con 0x7f4ff4103e00 2024-09-12T01:58:50.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.529+0000 7f4ffb800640 1 -- 172.21.15.62:0/2914883623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff410b120 con 0x7f4ff4103e00 2024-09-12T01:58:50.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.531+0000 7f4ff2000640 1 -- 172.21.15.62:0/2914883623 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4fe40046c0 con 0x7f4ff4103e00 2024-09-12T01:58:50.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.532+0000 7f4ff2000640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fd80a2c40 0x7f4fd80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:50.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.532+0000 7f4ff2000640 1 -- 172.21.15.62:0/2914883623 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f4fe40cf9b0 con 0x7f4ff4103e00 2024-09-12T01:58:50.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.532+0000 7f4febe00640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fd80a2c40 0x7f4fd80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:50.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.533+0000 7f4febe00640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fd80a2c40 0x7f4fd80a5100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ff419b5c0 tx=0x7f4fdc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:50.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.536+0000 7f4ff2000640 1 -- 172.21.15.62:0/2914883623 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fe409c3a0 con 0x7f4ff4103e00 2024-09-12T01:58:50.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:50 smithi107 ceph-mon[35463]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:50.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:50 smithi077 ceph-mon[35095]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:58:50.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.755+0000 7f4ffb800640 1 -- 172.21.15.62:0/2914883623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4ff402d7c0 con 0x7f4ff4103e00 2024-09-12T01:58:50.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.755+0000 7f4ff2000640 1 -- 172.21.15.62:0/2914883623 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3048 (secure 0 0 0) 0x7f4fe409bca0 con 0x7f4ff4103e00 2024-09-12T01:58:50.756 INFO:teuthology.orchestra.run.smithi062.stdout:e21 2024-09-12T01:58:50.756 INFO:teuthology.orchestra.run.smithi062.stdout:btime 2024-09-12T01:57:25:959947+0000 2024-09-12T01:58:50.756 INFO:teuthology.orchestra.run.smithi062.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:legacy client fscid: 1 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:fs_name cephfs 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 21 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-09-12T01:56:41.854823+0000 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-09-12T01:57:25.905993+0000 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:tableserver 0 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:root 0 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:session_timeout 300 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:session_autoclose 300 2024-09-12T01:58:50.757 INFO:teuthology.orchestra.run.smithi062.stdout:max_file_size 1099511627776 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:max_xattr_size 65536 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:required_client_features {} 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure 0 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:last_failure_osd_epoch 0 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:max_mds 1 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:in 0 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:up {0=24530} 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:failed 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:damaged 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:stopped 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:data_pools [3,4] 2024-09-12T01:58:50.758 INFO:teuthology.orchestra.run.smithi062.stdout:metadata_pool 2 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:inline_data disabled 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:balancer 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:bal_rank_mask -1 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:standby_count_wanted 0 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:qdb_cluster leader: 24530 members: 24530 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b{0:24530} state up:active seq 5 addr [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.i{0:24529} state up:standby-replay seq 1 addr [v2:172.21.15.107:6838/4011311424,v1:172.21.15.107:6839/4011311424] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:Standby daemons: 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d{-1:14433} state up:standby seq 1 addr [v2:172.21.15.62:6836/2380166524,v1:172.21.15.62:6837/2380166524] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.759 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.g{-1:14481} state up:standby seq 1 addr [v2:172.21.15.62:6838/3993694747,v1:172.21.15.62:6839/3993694747] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.k{-1:24443} state up:standby seq 1 addr [v2:172.21.15.77:6832/2149975547,v1:172.21.15.77:6833/2149975547] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.j{-1:24455} state up:standby seq 1 addr [v2:172.21.15.62:6834/2717043895,v1:172.21.15.62:6835/2717043895] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.l{-1:24460} state up:standby seq 1 addr [v2:172.21.15.107:6832/1286528646,v1:172.21.15.107:6833/1286528646] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.e{-1:24479} state up:standby seq 1 addr [v2:172.21.15.77:6834/2003629503,v1:172.21.15.77:6835/2003629503] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.h{-1:24497} state up:standby seq 1 addr [v2:172.21.15.77:6836/1577534280,v1:172.21.15.77:6837/1577534280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.f{-1:24505} state up:standby seq 1 addr [v2:172.21.15.107:6834/3488072304,v1:172.21.15.107:6835/3488072304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c{-1:24517} state up:standby seq 1 addr [v2:172.21.15.107:6836/2432202684,v1:172.21.15.107:6837/2432202684] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.760 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a{-1:24524} state up:standby seq 1 addr [v2:172.21.15.62:6840/886174121,v1:172.21.15.62:6841/886174121] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:58:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2024-09-12T01:58:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 -- 172.21.15.62:0/2914883623 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fd80a2c40 msgr2=0x7f4fd80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fd80a2c40 0x7f4fd80a5100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ff419b5c0 tx=0x7f4fdc005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 -- 172.21.15.62:0/2914883623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ff4103e00 msgr2=0x7f4ff419a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a0a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400e9f0 tx=0x7f4fe400edf0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 -- 172.21.15.62:0/2914883623 shutdown_connections 2024-09-12T01:58:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4fd80a2c40 0x7f4fd80a5100 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ff4105920 0x7f4ff41a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff4104f60 0x7f4ff419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 --2- 172.21.15.62:0/2914883623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ff4103e00 0x7f4ff419a0a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 -- 172.21.15.62:0/2914883623 >> 172.21.15.62:0/2914883623 conn(0x7f4ff40ff5b0 msgr2=0x7f4ff41082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 -- 172.21.15.62:0/2914883623 shutdown_connections 2024-09-12T01:58:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:50.758+0000 7f4ffb800640 1 -- 172.21.15.62:0/2914883623 wait complete. 2024-09-12T01:58:51.497 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:51 smithi062 ceph-mon[30666]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:51.497 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:51 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2914883623' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:58:51.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T01:58:51.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:51 smithi107 ceph-mon[35463]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:51.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:51 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2914883623' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:58:51.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:51 smithi077 ceph-mon[35095]: pgmap v368: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:51.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:51 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2914883623' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:58:51.943 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:52.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.515+0000 7fe47a400640 1 -- 172.21.15.62:0/2964151990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe474109a70 msgr2=0x7fe47410bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:52.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.515+0000 7fe47a400640 1 --2- 172.21.15.62:0/2964151990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe474109a70 0x7fe47410bf30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009ca0 tx=0x7fe46c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.516+0000 7fe47a400640 1 -- 172.21.15.62:0/2964151990 shutdown_connections 2024-09-12T01:58:52.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.516+0000 7fe47a400640 1 --2- 172.21.15.62:0/2964151990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe474109a70 0x7fe47410bf30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.516+0000 7fe47a400640 1 --2- 172.21.15.62:0/2964151990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe474074b40 0x7fe474074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.516+0000 7fe47a400640 1 --2- 172.21.15.62:0/2964151990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4740761a0 0x7fe474074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.516+0000 7fe47a400640 1 -- 172.21.15.62:0/2964151990 >> 172.21.15.62:0/2964151990 conn(0x7fe4740fd390 msgr2=0x7fe4740ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:52.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.516+0000 7fe47a400640 1 -- 172.21.15.62:0/2964151990 shutdown_connections 2024-09-12T01:58:52.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.516+0000 7fe47a400640 1 -- 172.21.15.62:0/2964151990 wait complete. 2024-09-12T01:58:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe47a400640 1 Processor -- start 2024-09-12T01:58:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe47a400640 1 -- start start 2024-09-12T01:58:52.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe47a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe474074b40 0x7fe47419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe47a400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4740761a0 0x7fe47419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe47a400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe474109a70 0x7fe4741a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe47a400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe47410faa0 con 0x7fe4740761a0 2024-09-12T01:58:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe47a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe47410f920 con 0x7fe474074b40 2024-09-12T01:58:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe47a400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe47410fc20 con 0x7fe474109a70 2024-09-12T01:58:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe472a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4740761a0 0x7fe47419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe473400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe474074b40 0x7fe47419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe473400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe474074b40 0x7fe47419a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:48838/0 (socket says 172.21.15.62:48838) 2024-09-12T01:58:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe473400640 1 -- 172.21.15.62:0/321610703 learned_addr learned my addr 172.21.15.62:0/321610703 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe472a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4740761a0 0x7fe47419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47410/0 (socket says 172.21.15.62:47410) 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.517+0000 7fe473e00640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe474109a70 0x7fe4741a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.518+0000 7fe473400640 1 -- 172.21.15.62:0/321610703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe474109a70 msgr2=0x7fe4741a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.518+0000 7fe473400640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe474109a70 0x7fe4741a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.518+0000 7fe473400640 1 -- 172.21.15.62:0/321610703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4740761a0 msgr2=0x7fe47419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.518+0000 7fe473400640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4740761a0 0x7fe47419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.518+0000 7fe473400640 1 -- 172.21.15.62:0/321610703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4741a1c80 con 0x7fe474074b40 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.518+0000 7fe472a00640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4740761a0 0x7fe47419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.518+0000 7fe473400640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe474074b40 0x7fe47419a050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe46400e9f0 tx=0x7fe46400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.518+0000 7fe46be00640 1 -- 172.21.15.62:0/321610703 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46400cd80 con 0x7fe474074b40 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.518+0000 7fe46be00640 1 -- 172.21.15.62:0/321610703 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe464010910 con 0x7fe474074b40 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.518+0000 7fe46be00640 1 -- 172.21.15.62:0/321610703 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464018990 con 0x7fe474074b40 2024-09-12T01:58:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.519+0000 7fe47a400640 1 -- 172.21.15.62:0/321610703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4741a1f70 con 0x7fe474074b40 2024-09-12T01:58:52.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.519+0000 7fe47a400640 1 -- 172.21.15.62:0/321610703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4741a2370 con 0x7fe474074b40 2024-09-12T01:58:52.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.520+0000 7fe47a400640 1 -- 172.21.15.62:0/321610703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe474108880 con 0x7fe474074b40 2024-09-12T01:58:52.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.522+0000 7fe46be00640 1 -- 172.21.15.62:0/321610703 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe464010ac0 con 0x7fe474074b40 2024-09-12T01:58:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.523+0000 7fe46be00640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe4580a2bb0 0x7fe4580a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.523+0000 7fe46be00640 1 -- 172.21.15.62:0/321610703 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fe4640cfca0 con 0x7fe474074b40 2024-09-12T01:58:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.523+0000 7fe472a00640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe4580a2bb0 0x7fe4580a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.524+0000 7fe472a00640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe4580a2bb0 0x7fe4580a5070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe47419b570 tx=0x7fe46000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:52.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.525+0000 7fe46be00640 1 -- 172.21.15.62:0/321610703 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe46409c1a0 con 0x7fe474074b40 2024-09-12T01:58:52.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.708+0000 7fe47a400640 1 -- 172.21.15.62:0/321610703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fe47402da50 con 0x7fe474074b40 2024-09-12T01:58:52.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.710+0000 7fe46be00640 1 -- 172.21.15.62:0/321610703 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v94) ==== 56+0+5668 (secure 0 0 0) 0x7fe4640a04a0 con 0x7fe474074b40 2024-09-12T01:58:52.711 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 94 2024-09-12T01:58:52.711 INFO:teuthology.orchestra.run.smithi062.stdout:fsid f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T01:58:52.711 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-09-12T01:48:25.739472+0000 2024-09-12T01:58:52.711 INFO:teuthology.orchestra.run.smithi062.stdout:modified 2024-09-12T01:58:23.527829+0000 2024-09-12T01:58:52.711 INFO:teuthology.orchestra.run.smithi062.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T01:58:52.711 INFO:teuthology.orchestra.run.smithi062.stdout:crush_version 27 2024-09-12T01:58:52.711 INFO:teuthology.orchestra.run.smithi062.stdout:full_ratio 0.95 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:backfillfull_ratio 0.9 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:nearfull_ratio 0.85 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:require_min_compat_client luminous 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:min_compat_client luminous 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:require_osd_release squid 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:stretch_mode_enabled false 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 90 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:max_osd 12 2024-09-12T01:58:52.712 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 up in weight 1 up_from 8 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6802/2091859274,v1:172.21.15.62:6803/2091859274] [v2:172.21.15.62:6804/2091859274,v1:172.21.15.62:6805/2091859274] exists,up 20d96bd8-b481-4413-8fa6-bf7ce632c28a 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 up in weight 1 up_from 13 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6800/2738000605,v1:172.21.15.77:6801/2738000605] [v2:172.21.15.77:6802/2738000605,v1:172.21.15.77:6803/2738000605] exists,up 00fd72ef-fa59-4e8b-a2a2-18771c177672 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 up in weight 1 up_from 18 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6800/1089319427,v1:172.21.15.107:6801/1089319427] [v2:172.21.15.107:6802/1089319427,v1:172.21.15.107:6803/1089319427] exists,up 8177e19a-60ca-40e1-a2b1-e7aef2bfdef9 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 up in weight 1 up_from 26 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6810/1756749723,v1:172.21.15.62:6811/1756749723] [v2:172.21.15.62:6812/1756749723,v1:172.21.15.62:6813/1756749723] exists,up 5c620376-fea1-40d0-b6e6-ba93bb6485ad 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 up in weight 1 up_from 33 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6808/1516569462,v1:172.21.15.77:6809/1516569462] [v2:172.21.15.77:6810/1516569462,v1:172.21.15.77:6811/1516569462] exists,up 8bf123c0-af2f-48cb-a299-10aca3199c26 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 up in weight 1 up_from 38 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6808/2023940642,v1:172.21.15.107:6809/2023940642] [v2:172.21.15.107:6810/2023940642,v1:172.21.15.107:6811/2023940642] exists,up a80c7a20-45c7-4e5c-8291-77a5e55959aa 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 up in weight 1 up_from 45 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6818/2615132641,v1:172.21.15.62:6819/2615132641] [v2:172.21.15.62:6820/2615132641,v1:172.21.15.62:6821/2615132641] exists,up 6b148e87-4039-458c-a49c-2b632348cdf4 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 up in weight 1 up_from 50 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6816/1202278855,v1:172.21.15.77:6817/1202278855] [v2:172.21.15.77:6818/1202278855,v1:172.21.15.77:6819/1202278855] exists,up dde7bf9d-fe60-486c-9cf5-bcba5af89a45 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.8 up in weight 1 up_from 57 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6816/3632359823,v1:172.21.15.107:6817/3632359823] [v2:172.21.15.107:6818/3632359823,v1:172.21.15.107:6819/3632359823] exists,up c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.9 up in weight 1 up_from 64 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.62:6826/2067861247,v1:172.21.15.62:6827/2067861247] [v2:172.21.15.62:6828/2067861247,v1:172.21.15.62:6829/2067861247] exists,up 0cc19007-e92e-4135-8154-2556a77daf4e 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.10 up in weight 1 up_from 69 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6824/454508594,v1:172.21.15.77:6825/454508594] [v2:172.21.15.77:6826/454508594,v1:172.21.15.77:6827/454508594] exists,up 1f714105-925d-4bfe-9ec9-066ee4ea1632 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:osd.11 up in weight 1 up_from 76 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6824/2990277085,v1:172.21.15.107:6825/2990277085] [v2:172.21.15.107:6826/2990277085,v1:172.21.15.107:6827/2990277085] exists,up 136b8ea9-0ba2-453f-bcd4-2f2a0a058fff 2024-09-12T01:58:52.713 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 2.6 [8,11] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 2.b [8,11] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 2.c [2,1] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 2.e [2,4] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 3.0 [5,9] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 3.13 [4,9] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 3.17 [4,6] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 3.1e [3,9] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 3.31 [4,8] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 4.f [5,8] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 4.13 [9,8] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 4.1b [9,8] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:pg_upmap_items 4.1c [9,10] 2024-09-12T01:58:52.714 INFO:teuthology.orchestra.run.smithi062.stdout:blocklist 172.21.15.62:6801/1515578586 expires 2024-09-13T01:49:21.439435+0000 2024-09-12T01:58:52.715 INFO:teuthology.orchestra.run.smithi062.stdout:blocklist 172.21.15.62:0/4054298843 expires 2024-09-13T01:49:21.439435+0000 2024-09-12T01:58:52.715 INFO:teuthology.orchestra.run.smithi062.stdout:blocklist 172.21.15.62:6800/1515578586 expires 2024-09-13T01:49:21.439435+0000 2024-09-12T01:58:52.715 INFO:teuthology.orchestra.run.smithi062.stdout:blocklist 172.21.15.62:0/934108526 expires 2024-09-13T01:49:21.439435+0000 2024-09-12T01:58:52.715 INFO:teuthology.orchestra.run.smithi062.stdout:blocklist 172.21.15.62:0/91320952 expires 2024-09-13T01:49:21.439435+0000 2024-09-12T01:58:52.715 INFO:teuthology.orchestra.run.smithi062.stdout:blocklist 172.21.15.62:6801/2854042842 expires 2024-09-13T01:48:53.659705+0000 2024-09-12T01:58:52.715 INFO:teuthology.orchestra.run.smithi062.stdout:blocklist 172.21.15.62:6800/2854042842 expires 2024-09-13T01:48:53.659705+0000 2024-09-12T01:58:52.715 INFO:teuthology.orchestra.run.smithi062.stdout:blocklist 172.21.15.62:0/1208654241 expires 2024-09-13T01:48:53.659705+0000 2024-09-12T01:58:52.715 INFO:teuthology.orchestra.run.smithi062.stdout:blocklist 172.21.15.62:0/409574397 expires 2024-09-13T01:48:53.659705+0000 2024-09-12T01:58:52.715 INFO:teuthology.orchestra.run.smithi062.stdout:blocklist 172.21.15.62:0/3603814798 expires 2024-09-13T01:48:53.659705+0000 2024-09-12T01:58:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 -- 172.21.15.62:0/321610703 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe4580a2bb0 msgr2=0x7fe4580a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe4580a2bb0 0x7fe4580a5070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe47419b570 tx=0x7fe46000b390 comp rx=0 tx=0).stop 2024-09-12T01:58:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 -- 172.21.15.62:0/321610703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe474074b40 msgr2=0x7fe47419a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe474074b40 0x7fe47419a050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe46400e9f0 tx=0x7fe46400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 -- 172.21.15.62:0/321610703 shutdown_connections 2024-09-12T01:58:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fe4580a2bb0 0x7fe4580a5070 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe474109a70 0x7fe4741a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4740761a0 0x7fe47419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 --2- 172.21.15.62:0/321610703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe474074b40 0x7fe47419a050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 -- 172.21.15.62:0/321610703 >> 172.21.15.62:0/321610703 conn(0x7fe4740fd390 msgr2=0x7fe474105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 -- 172.21.15.62:0/321610703 shutdown_connections 2024-09-12T01:58:52.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:52.712+0000 7fe47a400640 1 -- 172.21.15.62:0/321610703 wait complete. 2024-09-12T01:58:53.553 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T01:58:53.570 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:58:53.619 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:53 smithi062 ceph-mon[30666]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:53.620 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:53 smithi062 ceph-mon[30666]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T01:58:53.620 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:53 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/321610703' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:58:53.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:53 smithi107 ceph-mon[35463]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:53.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:53 smithi107 ceph-mon[35463]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T01:58:53.704 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:53 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/321610703' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:58:53.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:53 smithi077 ceph-mon[35095]: pgmap v369: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:58:53.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:53 smithi077 ceph-mon[35095]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T01:58:53.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:53 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/321610703' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:58:53.949 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:54.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.521+0000 7fc1c6200640 1 -- 172.21.15.62:0/1637875742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c0104010 msgr2=0x7fc1c01043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.521+0000 7fc1c6200640 1 --2- 172.21.15.62:0/1637875742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c0104010 0x7fc1c01043f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009900 tx=0x7fc1b002a3f0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.521+0000 7fc1c6200640 1 -- 172.21.15.62:0/1637875742 shutdown_connections 2024-09-12T01:58:54.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.521+0000 7fc1c6200640 1 --2- 172.21.15.62:0/1637875742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1c0109140 0x7fc1c0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.521+0000 7fc1c6200640 1 --2- 172.21.15.62:0/1637875742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c01049c0 0x7fc1c0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.521+0000 7fc1c6200640 1 --2- 172.21.15.62:0/1637875742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c0104010 0x7fc1c01043f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.521+0000 7fc1c6200640 1 -- 172.21.15.62:0/1637875742 >> 172.21.15.62:0/1637875742 conn(0x7fc1c00ffa50 msgr2=0x7fc1c0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.521+0000 7fc1c6200640 1 -- 172.21.15.62:0/1637875742 shutdown_connections 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.521+0000 7fc1c6200640 1 -- 172.21.15.62:0/1637875742 wait complete. 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.522+0000 7fc1c6200640 1 Processor -- start 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1c6200640 1 -- start start 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1c6200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c0104010 0x7fc1c019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1c6200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c01049c0 0x7fc1c019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1c6200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1c0109140 0x7fc1c019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1c6200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c0114170 con 0x7fc1c0104010 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1c6200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c0113ff0 con 0x7fc1c01049c0 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1c6200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01142f0 con 0x7fc1c0109140 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1bf400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c0104010 0x7fc1c019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1bf400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c0104010 0x7fc1c019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47432/0 (socket says 172.21.15.62:47432) 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1bf400640 1 -- 172.21.15.62:0/2066039159 learned_addr learned my addr 172.21.15.62:0/2066039159 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1bfe00640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1c0109140 0x7fc1c019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.523+0000 7fc1bea00640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c01049c0 0x7fc1c019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.524+0000 7fc1bf400640 1 -- 172.21.15.62:0/2066039159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1c0109140 msgr2=0x7fc1c019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.524+0000 7fc1bf400640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1c0109140 0x7fc1c019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.524+0000 7fc1bf400640 1 -- 172.21.15.62:0/2066039159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c01049c0 msgr2=0x7fc1c019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.524+0000 7fc1bf400640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c01049c0 0x7fc1c019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.524+0000 7fc1bf400640 1 -- 172.21.15.62:0/2066039159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c019f600 con 0x7fc1c0104010 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.524+0000 7fc1bfe00640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1c0109140 0x7fc1c019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.524+0000 7fc1bea00640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c01049c0 0x7fc1c019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.524+0000 7fc1bf400640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c0104010 0x7fc1c019a650 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0006010 tx=0x7fc1b0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.525+0000 7fc1b7e00640 1 -- 172.21.15.62:0/2066039159 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b003f030 con 0x7fc1c0104010 2024-09-12T01:58:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.525+0000 7fc1b7e00640 1 -- 172.21.15.62:0/2066039159 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b0004440 con 0x7fc1c0104010 2024-09-12T01:58:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.525+0000 7fc1b7e00640 1 -- 172.21.15.62:0/2066039159 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0035070 con 0x7fc1c0104010 2024-09-12T01:58:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.525+0000 7fc1c6200640 1 -- 172.21.15.62:0/2066039159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c019f890 con 0x7fc1c0104010 2024-09-12T01:58:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.525+0000 7fc1c6200640 1 -- 172.21.15.62:0/2066039159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c019fd20 con 0x7fc1c0104010 2024-09-12T01:58:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.526+0000 7fc1c6200640 1 -- 172.21.15.62:0/2066039159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c01043f0 con 0x7fc1c0104010 2024-09-12T01:58:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.528+0000 7fc1b7e00640 1 -- 172.21.15.62:0/2066039159 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc1b0042030 con 0x7fc1c0104010 2024-09-12T01:58:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.529+0000 7fc1b7e00640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1a40a2c00 0x7fc1a40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.529+0000 7fc1b7e00640 1 -- 172.21.15.62:0/2066039159 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7fc1b00ef710 con 0x7fc1c0104010 2024-09-12T01:58:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.530+0000 7fc1bea00640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1a40a2c00 0x7fc1a40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.530+0000 7fc1bea00640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1a40a2c00 0x7fc1a40a50c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0095f0 tx=0x7fc1ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:54.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.534+0000 7fc1b7e00640 1 -- 172.21.15.62:0/2066039159 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1b00bbc10 con 0x7fc1c0104010 2024-09-12T01:58:54.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.753+0000 7fc1c6200640 1 -- 172.21.15.62:0/2066039159 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1c002d7c0 con 0x7fc1c0104010 2024-09-12T01:58:54.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.754+0000 7fc1b7e00640 1 -- 172.21.15.62:0/2066039159 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11851 (secure 0 0 0) 0x7fc1b00bff10 con 0x7fc1c0104010 2024-09-12T01:58:54.755 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:54.755 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"btime":"2024-09-12T01:57:25:959947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:56:41.854823+0000","modified":"2024-09-12T01:57:25.905993+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24529":{"gid":24529,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24530]},"id":1}]} 2024-09-12T01:58:54.755 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2024-09-12T01:58:54.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.756+0000 7fc1c6200640 1 -- 172.21.15.62:0/2066039159 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1a40a2c00 msgr2=0x7fc1a40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.756+0000 7fc1c6200640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1a40a2c00 0x7fc1a40a50c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0095f0 tx=0x7fc1ac005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.756+0000 7fc1c6200640 1 -- 172.21.15.62:0/2066039159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c0104010 msgr2=0x7fc1c019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.756+0000 7fc1c6200640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c0104010 0x7fc1c019a650 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0006010 tx=0x7fc1b0004040 comp rx=0 tx=0).stop 2024-09-12T01:58:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.757+0000 7fc1c6200640 1 -- 172.21.15.62:0/2066039159 shutdown_connections 2024-09-12T01:58:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.757+0000 7fc1c6200640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7fc1a40a2c00 0x7fc1a40a50c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.757+0000 7fc1c6200640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1c0109140 0x7fc1c019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.757+0000 7fc1c6200640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c01049c0 0x7fc1c019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.757+0000 7fc1c6200640 1 --2- 172.21.15.62:0/2066039159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c0104010 0x7fc1c019a650 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.757+0000 7fc1c6200640 1 -- 172.21.15.62:0/2066039159 >> 172.21.15.62:0/2066039159 conn(0x7fc1c00ffa50 msgr2=0x7fc1c0100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.757+0000 7fc1c6200640 1 -- 172.21.15.62:0/2066039159 shutdown_connections 2024-09-12T01:58:54.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:54.757+0000 7fc1c6200640 1 -- 172.21.15.62:0/2066039159 wait complete. 2024-09-12T01:58:55.481 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:55 smithi062 ceph-mon[30666]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:58:55.481 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:55 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2066039159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:55.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:58:55.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:55 smithi107 ceph-mon[35463]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:58:55.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:55 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2066039159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:55.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:55 smithi077 ceph-mon[35095]: pgmap v370: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:58:55.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:55 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2066039159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:55.904 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:56.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.441+0000 7f16d2a00640 1 -- 172.21.15.62:0/1115138989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16cc103e30 msgr2=0x7f16cc104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.441+0000 7f16d2a00640 1 --2- 172.21.15.62:0/1115138989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16cc103e30 0x7f16cc104210 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009900 tx=0x7f16c002a410 comp rx=0 tx=0).stop 2024-09-12T01:58:56.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.441+0000 7f16d2a00640 1 -- 172.21.15.62:0/1115138989 shutdown_connections 2024-09-12T01:58:56.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.441+0000 7f16d2a00640 1 --2- 172.21.15.62:0/1115138989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16cc108f60 0x7f16cc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.441+0000 7f16d2a00640 1 --2- 172.21.15.62:0/1115138989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16cc1047e0 0x7f16cc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.441+0000 7f16d2a00640 1 --2- 172.21.15.62:0/1115138989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16cc103e30 0x7f16cc104210 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.441+0000 7f16d2a00640 1 -- 172.21.15.62:0/1115138989 >> 172.21.15.62:0/1115138989 conn(0x7f16cc0ff8d0 msgr2=0x7f16cc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:56.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.441+0000 7f16d2a00640 1 -- 172.21.15.62:0/1115138989 shutdown_connections 2024-09-12T01:58:56.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.441+0000 7f16d2a00640 1 -- 172.21.15.62:0/1115138989 wait complete. 2024-09-12T01:58:56.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.442+0000 7f16d2a00640 1 Processor -- start 2024-09-12T01:58:56.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.442+0000 7f16d2a00640 1 -- start start 2024-09-12T01:58:56.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16cc103e30 0x7f16cc19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16cc1047e0 0x7f16cc19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16cc108f60 0x7f16cc19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc113fc0 con 0x7f16cc108f60 2024-09-12T01:58:56.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc113e40 con 0x7f16cc1047e0 2024-09-12T01:58:56.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc114140 con 0x7f16cc103e30 2024-09-12T01:58:56.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16cc108f60 0x7f16cc19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16cc108f60 0x7f16cc19ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47450/0 (socket says 172.21.15.62:47450) 2024-09-12T01:58:56.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2000640 1 -- 172.21.15.62:0/542710838 learned_addr learned my addr 172.21.15.62:0/542710838 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:56.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d1600640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16cc103e30 0x7f16cc19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d0c00640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16cc1047e0 0x7f16cc19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2000640 1 -- 172.21.15.62:0/542710838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16cc103e30 msgr2=0x7f16cc19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2000640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16cc103e30 0x7f16cc19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2000640 1 -- 172.21.15.62:0/542710838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16cc1047e0 msgr2=0x7f16cc19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2000640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16cc1047e0 0x7f16cc19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.443+0000 7f16d2000640 1 -- 172.21.15.62:0/542710838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16cc19f450 con 0x7f16cc108f60 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.444+0000 7f16d2000640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16cc108f60 0x7f16cc19ed70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f16c400eb10 tx=0x7f16c400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.444+0000 7f16ca000640 1 -- 172.21.15.62:0/542710838 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4004b20 con 0x7f16cc108f60 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.444+0000 7f16ca000640 1 -- 172.21.15.62:0/542710838 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16c4004cc0 con 0x7f16cc108f60 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.444+0000 7f16ca000640 1 -- 172.21.15.62:0/542710838 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4010760 con 0x7f16cc108f60 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.444+0000 7f16d2a00640 1 -- 172.21.15.62:0/542710838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16cc19f740 con 0x7f16cc108f60 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.444+0000 7f16d2a00640 1 -- 172.21.15.62:0/542710838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16cc1a7020 con 0x7f16cc108f60 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.445+0000 7f16d2a00640 1 -- 172.21.15.62:0/542710838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16cc104210 con 0x7f16cc108f60 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.447+0000 7f16ca000640 1 -- 172.21.15.62:0/542710838 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f16c4005020 con 0x7f16cc108f60 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.448+0000 7f16ca000640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f16b40a2c00 0x7f16b40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.448+0000 7f16ca000640 1 -- 172.21.15.62:0/542710838 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f16c40cf8e0 con 0x7f16cc108f60 2024-09-12T01:58:56.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.449+0000 7f16d1600640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f16b40a2c00 0x7f16b40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.449+0000 7f16d1600640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f16b40a2c00 0x7f16b40a50c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009230 tx=0x7f16c00058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:56.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.452+0000 7f16ca000640 1 -- 172.21.15.62:0/542710838 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16c409c430 con 0x7f16cc108f60 2024-09-12T01:58:56.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.678+0000 7f16d2a00640 1 -- 172.21.15.62:0/542710838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16cc02d7c0 con 0x7f16cc108f60 2024-09-12T01:58:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.679+0000 7f16ca000640 1 -- 172.21.15.62:0/542710838 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11851 (secure 0 0 0) 0x7f16c409bd30 con 0x7f16cc108f60 2024-09-12T01:58:56.681 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:56.681 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"btime":"2024-09-12T01:57:25:959947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:56:41.854823+0000","modified":"2024-09-12T01:57:25.905993+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24529":{"gid":24529,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24530]},"id":1}]} 2024-09-12T01:58:56.682 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2024-09-12T01:58:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.681+0000 7f16d2a00640 1 -- 172.21.15.62:0/542710838 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f16b40a2c00 msgr2=0x7f16b40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.681+0000 7f16d2a00640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f16b40a2c00 0x7f16b40a50c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009230 tx=0x7f16c00058d0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.681+0000 7f16d2a00640 1 -- 172.21.15.62:0/542710838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16cc108f60 msgr2=0x7f16cc19ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.681+0000 7f16d2a00640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16cc108f60 0x7f16cc19ed70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f16c400eb10 tx=0x7f16c400c2d0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.681+0000 7f16d2a00640 1 -- 172.21.15.62:0/542710838 shutdown_connections 2024-09-12T01:58:56.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.681+0000 7f16d2a00640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f16b40a2c00 0x7f16b40a50c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.681+0000 7f16d2a00640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16cc108f60 0x7f16cc19ed70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.681+0000 7f16d2a00640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16cc1047e0 0x7f16cc19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.681+0000 7f16d2a00640 1 --2- 172.21.15.62:0/542710838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f16cc103e30 0x7f16cc19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.681+0000 7f16d2a00640 1 -- 172.21.15.62:0/542710838 >> 172.21.15.62:0/542710838 conn(0x7f16cc0ff8d0 msgr2=0x7f16cc100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.682+0000 7f16d2a00640 1 -- 172.21.15.62:0/542710838 shutdown_connections 2024-09-12T01:58:56.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:56.682+0000 7f16d2a00640 1 -- 172.21.15.62:0/542710838 wait complete. 2024-09-12T01:58:57.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:58:57.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:57 smithi107 ceph-mon[35463]: pgmap v371: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:58:57.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:57 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/542710838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:57.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:57 smithi077 ceph-mon[35095]: pgmap v371: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:58:57.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:57 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/542710838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:57.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:57 smithi062 ceph-mon[30666]: pgmap v371: 129 pgs: 129 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:58:57.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:57 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/542710838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.388+0000 7efdf3e00640 1 -- 172.21.15.62:0/399445081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec106f10 msgr2=0x7efdec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.388+0000 7efdf3e00640 1 --2- 172.21.15.62:0/399445081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec106f10 0x7efdec10ea90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efde4009ca0 tx=0x7efde402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.388+0000 7efdf3e00640 1 -- 172.21.15.62:0/399445081 shutdown_connections 2024-09-12T01:58:58.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.388+0000 7efdf3e00640 1 --2- 172.21.15.62:0/399445081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec106f10 0x7efdec10ea90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.388+0000 7efdf3e00640 1 --2- 172.21.15.62:0/399445081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdec102790 0x7efdec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.388+0000 7efdf3e00640 1 --2- 172.21.15.62:0/399445081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec101de0 0x7efdec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.388+0000 7efdf3e00640 1 -- 172.21.15.62:0/399445081 >> 172.21.15.62:0/399445081 conn(0x7efdec0fd8c0 msgr2=0x7efdec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:58.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.388+0000 7efdf3e00640 1 -- 172.21.15.62:0/399445081 shutdown_connections 2024-09-12T01:58:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.388+0000 7efdf3e00640 1 -- 172.21.15.62:0/399445081 wait complete. 2024-09-12T01:58:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.389+0000 7efdf3e00640 1 Processor -- start 2024-09-12T01:58:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.389+0000 7efdf3e00640 1 -- start start 2024-09-12T01:58:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdec101de0 0x7efdec1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf3e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec102790 0x7efdec1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec106f10 0x7efdec19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf3e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efdec111f70 con 0x7efdec106f10 2024-09-12T01:58:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf3e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efdec111df0 con 0x7efdec102790 2024-09-12T01:58:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf3e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efdec1120f0 con 0x7efdec101de0 2024-09-12T01:58:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf1400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdec101de0 0x7efdec1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf1400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdec101de0 0x7efdec1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:54304/0 (socket says 172.21.15.62:54304) 2024-09-12T01:58:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf1400640 1 -- 172.21.15.62:0/226874656 learned_addr learned my addr 172.21.15.62:0/226874656 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:58:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf1e00640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec106f10 0x7efdec19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.390+0000 7efdf0a00640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec102790 0x7efdec1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdf1400640 1 -- 172.21.15.62:0/226874656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec102790 msgr2=0x7efdec1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdf1400640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec102790 0x7efdec1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdf1400640 1 -- 172.21.15.62:0/226874656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec106f10 msgr2=0x7efdec19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdf1400640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec106f10 0x7efdec19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdf1400640 1 -- 172.21.15.62:0/226874656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdec19d360 con 0x7efdec101de0 2024-09-12T01:58:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdf1400640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdec101de0 0x7efdec1983b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efde000d950 tx=0x7efde000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdea000640 1 -- 172.21.15.62:0/226874656 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0017030 con 0x7efdec101de0 2024-09-12T01:58:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdea000640 1 -- 172.21.15.62:0/226874656 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efde0004020 con 0x7efdec101de0 2024-09-12T01:58:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdea000640 1 -- 172.21.15.62:0/226874656 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde00047a0 con 0x7efdec101de0 2024-09-12T01:58:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdf3e00640 1 -- 172.21.15.62:0/226874656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdec19d650 con 0x7efdec101de0 2024-09-12T01:58:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.391+0000 7efdf3e00640 1 -- 172.21.15.62:0/226874656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdec1a4f30 con 0x7efdec101de0 2024-09-12T01:58:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.392+0000 7efdf3e00640 1 -- 172.21.15.62:0/226874656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdec1021c0 con 0x7efdec101de0 2024-09-12T01:58:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.394+0000 7efdea000640 1 -- 172.21.15.62:0/226874656 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efde00041d0 con 0x7efdec101de0 2024-09-12T01:58:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.396+0000 7efdea000640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efdd40a2c00 0x7efdd40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.396+0000 7efdea000640 1 -- 172.21.15.62:0/226874656 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7efde00ced00 con 0x7efdec101de0 2024-09-12T01:58:58.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.396+0000 7efdf0a00640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efdd40a2c00 0x7efdd40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:58.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.396+0000 7efdf0a00640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efdd40a2c00 0x7efdd40a50c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efdec0fdce0 tx=0x7efdd8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:58.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.400+0000 7efdea000640 1 -- 172.21.15.62:0/226874656 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efde009b850 con 0x7efdec101de0 2024-09-12T01:58:58.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.584+0000 7efdf3e00640 1 -- 172.21.15.62:0/226874656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdec199710 con 0x7efdec101de0 2024-09-12T01:58:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.586+0000 7efdea000640 1 -- 172.21.15.62:0/226874656 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24864 (secure 0 0 0) 0x7efde009b150 con 0x7efdec101de0 2024-09-12T01:58:58.587 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:58:58.587 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":94,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T01:58:23.527829+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:58:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.588+0000 7efdf3e00640 1 -- 172.21.15.62:0/226874656 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efdd40a2c00 msgr2=0x7efdd40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.588+0000 7efdf3e00640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efdd40a2c00 0x7efdd40a50c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efdec0fdce0 tx=0x7efdd8005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.588+0000 7efdf3e00640 1 -- 172.21.15.62:0/226874656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdec101de0 msgr2=0x7efdec1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.588+0000 7efdf3e00640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdec101de0 0x7efdec1983b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efde000d950 tx=0x7efde000de10 comp rx=0 tx=0).stop 2024-09-12T01:58:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.588+0000 7efdf3e00640 1 -- 172.21.15.62:0/226874656 shutdown_connections 2024-09-12T01:58:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.588+0000 7efdf3e00640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7efdd40a2c00 0x7efdd40a50c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.588+0000 7efdf3e00640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdec106f10 0x7efdec19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.588+0000 7efdf3e00640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdec102790 0x7efdec1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.588+0000 7efdf3e00640 1 --2- 172.21.15.62:0/226874656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdec101de0 0x7efdec1983b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.588+0000 7efdf3e00640 1 -- 172.21.15.62:0/226874656 >> 172.21.15.62:0/226874656 conn(0x7efdec0fd8c0 msgr2=0x7efdec0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.589+0000 7efdf3e00640 1 -- 172.21.15.62:0/226874656 shutdown_connections 2024-09-12T01:58:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:58:58.589+0000 7efdf3e00640 1 -- 172.21.15.62:0/226874656 wait complete. 2024-09-12T01:58:59.413 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:56:41.854823+0000', 'modified': '2024-09-12T01:57:25.905993+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24530}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24529': {'gid': 24529, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6839/4011311424', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 4011311424}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 4011311424}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24530': {'gid': 24530, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.77:6839/1365701824', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6838', 'nonce': 1365701824}, {'type': 'v1', 'addr': '172.21.15.77:6839', 'nonce': 1365701824}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24530, 'qdb_cluster': [24530]} 2024-09-12T01:58:59.413 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:58:59.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:58:59.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:59 smithi107 ceph-mon[35463]: pgmap v372: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:58:59.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:58:59 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/226874656' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:58:59.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:59 smithi077 ceph-mon[35095]: pgmap v372: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:58:59.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:58:59 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/226874656' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:58:59.792 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:59.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:59 smithi062 ceph-mon[30666]: pgmap v372: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:58:59.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:58:59 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/226874656' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:59:00.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.322+0000 7f4cda600640 1 -- 172.21.15.62:0/105181345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd4103ff0 msgr2=0x7f4cd41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.322+0000 7f4cda600640 1 --2- 172.21.15.62:0/105181345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd4103ff0 0x7f4cd41043d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009900 tx=0x7f4cc402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.322+0000 7f4cda600640 1 -- 172.21.15.62:0/105181345 shutdown_connections 2024-09-12T01:59:00.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.322+0000 7f4cda600640 1 --2- 172.21.15.62:0/105181345 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4109120 0x7f4cd4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.322+0000 7f4cda600640 1 --2- 172.21.15.62:0/105181345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd41049a0 0x7f4cd41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.322+0000 7f4cda600640 1 --2- 172.21.15.62:0/105181345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd4103ff0 0x7f4cd41043d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.322+0000 7f4cda600640 1 -- 172.21.15.62:0/105181345 >> 172.21.15.62:0/105181345 conn(0x7f4cd40ffa90 msgr2=0x7f4cd4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.322+0000 7f4cda600640 1 -- 172.21.15.62:0/105181345 shutdown_connections 2024-09-12T01:59:00.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.322+0000 7f4cda600640 1 -- 172.21.15.62:0/105181345 wait complete. 2024-09-12T01:59:00.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.323+0000 7f4cda600640 1 Processor -- start 2024-09-12T01:59:00.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.323+0000 7f4cda600640 1 -- start start 2024-09-12T01:59:00.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cda600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4103ff0 0x7f4cd419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cda600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd41049a0 0x7f4cd419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cda600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd4109120 0x7f4cd419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cda600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd4114120 con 0x7f4cd4109120 2024-09-12T01:59:00.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cda600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd4113fa0 con 0x7f4cd41049a0 2024-09-12T01:59:00.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cda600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd41142a0 con 0x7f4cd4103ff0 2024-09-12T01:59:00.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cd3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4103ff0 0x7f4cd419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cd2a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd41049a0 0x7f4cd419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cd3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4103ff0 0x7f4cd419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:54314/0 (socket says 172.21.15.62:54314) 2024-09-12T01:59:00.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cd3400640 1 -- 172.21.15.62:0/2790881221 learned_addr learned my addr 172.21.15.62:0/2790881221 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:00.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.324+0000 7f4cd3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd4109120 0x7f4cd419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4cd2a00640 1 -- 172.21.15.62:0/2790881221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4103ff0 msgr2=0x7f4cd419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4103ff0 0x7f4cd419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4cd2a00640 1 -- 172.21.15.62:0/2790881221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd4109120 msgr2=0x7f4cd419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd4109120 0x7f4cd419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4cd2a00640 1 -- 172.21.15.62:0/2790881221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd419f5d0 con 0x7f4cd41049a0 2024-09-12T01:59:00.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd41049a0 0x7f4cd419ab60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e9f0 tx=0x7f4cc000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:00.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4ccbe00640 1 -- 172.21.15.62:0/2790881221 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000cd80 con 0x7f4cd41049a0 2024-09-12T01:59:00.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4cda600640 1 -- 172.21.15.62:0/2790881221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd419f8c0 con 0x7f4cd41049a0 2024-09-12T01:59:00.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4ccbe00640 1 -- 172.21.15.62:0/2790881221 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cc00035f0 con 0x7f4cd41049a0 2024-09-12T01:59:00.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4ccbe00640 1 -- 172.21.15.62:0/2790881221 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0010670 con 0x7f4cd41049a0 2024-09-12T01:59:00.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.325+0000 7f4cda600640 1 -- 172.21.15.62:0/2790881221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd41a71a0 con 0x7f4cd41049a0 2024-09-12T01:59:00.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.328+0000 7f4cdd089740 1 Processor -- start 2024-09-12T01:59:00.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cdd089740 1 -- start start 2024-09-12T01:59:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912f3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3c50 0x556f912fdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912fe510 0x556f91300900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cdd089740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556f912590b0 con 0x556f912fe510 2024-09-12T01:59:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cdd089740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556f91200ab0 con 0x556f912f3c50 2024-09-12T01:59:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cdd089740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556f91255070 con 0x556f912f3330 2024-09-12T01:59:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cd3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cd3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3c50 0x556f912fdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cd3e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912f3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:54320/0 (socket says 172.21.15.62:54320) 2024-09-12T01:59:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.329+0000 7f4cd3e00640 1 -- 172.21.15.62:0/410172430 learned_addr learned my addr 172.21.15.62:0/410172430 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.330+0000 7f4cd3e00640 1 -- 172.21.15.62:0/410172430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3c50 msgr2=0x556f912fdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.330+0000 7f4cd3e00640 1 --2- 172.21.15.62:0/410172430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3c50 0x556f912fdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.330+0000 7f4cd3e00640 1 -- 172.21.15.62:0/410172430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912fe510 msgr2=0x556f91300900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:59:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.330+0000 7f4cd3e00640 1 --2- 172.21.15.62:0/410172430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912fe510 0x556f91300900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.330+0000 7f4cd3e00640 1 -- 172.21.15.62:0/410172430 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f9120d4a0 con 0x556f912f3330 2024-09-12T01:59:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.330+0000 7f4cd3e00640 1 --2- 172.21.15.62:0/410172430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912f3710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009f50 tx=0x7f4ccc0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa2a07ea52371c07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.330+0000 7f4cc8c00640 1 -- 172.21.15.62:0/410172430 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc004d20 con 0x556f912f3330 2024-09-12T01:59:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.330+0000 7f4cc8c00640 1 -- 172.21.15.62:0/410172430 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ccc004050 con 0x556f912f3330 2024-09-12T01:59:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.330+0000 7f4cc8c00640 1 -- 172.21.15.62:0/410172430 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc005260 con 0x556f912f3330 2024-09-12T01:59:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.330+0000 7f4ccbe00640 1 -- 172.21.15.62:0/2790881221 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4cc00037a0 con 0x7f4cd41049a0 2024-09-12T01:59:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.331+0000 7f4cdd089740 1 -- 172.21.15.62:0/410172430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 msgr2=0x556f912f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.331+0000 7f4cdd089740 1 --2- 172.21.15.62:0/410172430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912f3710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009f50 tx=0x7f4ccc0118d0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.331+0000 7f4cdd089740 1 -- 172.21.15.62:0/410172430 shutdown_connections 2024-09-12T01:59:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.331+0000 7f4cdd089740 1 --2- 172.21.15.62:0/410172430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912fe510 0x556f91300900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.331+0000 7f4cdd089740 1 --2- 172.21.15.62:0/410172430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3c50 0x556f912fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.331+0000 7f4cdd089740 1 --2- 172.21.15.62:0/410172430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912f3710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.331+0000 7f4cdd089740 1 -- 172.21.15.62:0/410172430 >> 172.21.15.62:0/410172430 conn(0x556f912ef8c0 msgr2=0x556f912efca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.331+0000 7f4cdd089740 1 -- 172.21.15.62:0/410172430 shutdown_connections 2024-09-12T01:59:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.331+0000 7f4cdd089740 1 -- 172.21.15.62:0/410172430 wait complete. 2024-09-12T01:59:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.332+0000 7f4cdd089740 1 -- start start 2024-09-12T01:59:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.332+0000 7f4ccbe00640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cb80a2aa0 0x7f4cb80a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.332+0000 7f4cdd089740 1 Processor -- start 2024-09-12T01:59:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.332+0000 7f4ccbe00640 1 -- 172.21.15.62:0/2790881221 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f4cc00cf6d0 con 0x7f4cd41049a0 2024-09-12T01:59:00.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.332+0000 7f4cd3e00640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cb80a2aa0 0x7f4cb80a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912fb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3c50 0x556f912fbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 0x556f912fc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cdd089740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556f91301060 con 0x556f912f3c50 2024-09-12T01:59:00.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cdd089740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556f911e1920 con 0x556f912fe510 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cdd089740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556f913011e0 con 0x556f912f3330 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cdd089740 10 client.0 _ll_register_callbacks cb 0x556f912058a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cd3e00640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cb80a2aa0 0x7f4cb80a4f60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009d60 tx=0x7f4ccc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cd3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cd2a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3c50 0x556f912fbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cd3400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912fb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:54330/0 (socket says 172.21.15.62:54330) 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cd3400640 1 -- 172.21.15.62:0/650259184 learned_addr learned my addr 172.21.15.62:0/650259184 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.333+0000 7f4cd3e00640 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 0x556f912fc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.334+0000 7f4cd3400640 1 -- 172.21.15.62:0/650259184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 msgr2=0x556f912fc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.334+0000 7f4cd3400640 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 0x556f912fc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.334+0000 7f4cd3400640 1 -- 172.21.15.62:0/650259184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3c50 msgr2=0x556f912fbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.334+0000 7f4cd3400640 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3c50 0x556f912fbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.334+0000 7f4cd3400640 1 -- 172.21.15.62:0/650259184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f90fca2b0 con 0x556f912f3330 2024-09-12T01:59:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.334+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3c50 0x556f912fbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.334+0000 7f4cd3400640 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912fb590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4000c00 tx=0x7f4cc4032ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8be4858060aea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.334+0000 7f4cbd600640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-09-12T01:59:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.334+0000 7f4cbd600640 1 -- 172.21.15.62:0/650259184 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4035040 con 0x556f912f3330 2024-09-12T01:59:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.334+0000 7f4cbd600640 1 -- 172.21.15.62:0/650259184 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f4cc40318b0 con 0x556f912f3330 2024-09-12T01:59:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.335+0000 7f4cdd089740 1 -- 172.21.15.62:0/650259184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ccc004050 con 0x556f912f3330 2024-09-12T01:59:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.335+0000 7f4cbd600640 1 -- 172.21.15.62:0/650259184 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4cc4004040 con 0x556f912f3330 2024-09-12T01:59:00.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.335+0000 7f4cdd089740 10 client.25072 fetch_fsmap learned FSMap version 21 2024-09-12T01:59:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.335+0000 7f4cdd089740 1 -- 172.21.15.62:0/650259184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556f9130ce30 con 0x556f912f3330 2024-09-12T01:59:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.335+0000 7f4cbd600640 1 -- 172.21.15.62:0/650259184 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ccc004050 con 0x556f912f3330 2024-09-12T01:59:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.336+0000 7f4cbd600640 1 -- 172.21.15.62:0/650259184 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4cc40047d0 con 0x556f912f3330 2024-09-12T01:59:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.336+0000 7f4cdd089740 10 client.25072 fetch_fsmap finished waiting for FSMap version 21 2024-09-12T01:59:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.336+0000 7f4cdd089740 10 client.25072 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:59:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.336+0000 7f4cdd089740 20 client.25072 populate_metadata read hostname 'smithi062' 2024-09-12T01:59:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.336+0000 7f4cdd089740 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x556f9130f430 0x556f913108a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.336+0000 7f4cdd089740 4 client.25072 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:00.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.336+0000 7f4cdd089740 1 -- 172.21.15.62:0/650259184 --> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f91266620 con 0x556f9130f430 2024-09-12T01:59:00.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.336+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x556f9130f430 0x556f913108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.337+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x556f9130f430 0x556f913108a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f762dfb61b129c80 server_cookie=7e85c7e987fa51ab in_seq=0 out_seq=0 2024-09-12T01:59:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.337+0000 7f4cbd600640 10 client.25072 ms_handle_connect on v2:172.21.15.77:6838/1365701824 2024-09-12T01:59:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cbd600640 1 -- 172.21.15.62:0/650259184 <== mds.0 v2:172.21.15.77:6838/1365701824 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f91266620 con 0x556f9130f430 2024-09-12T01:59:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cbd600640 10 client.25072 handle_command_reply: tid=0 2024-09-12T01:59:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 client.25072 shutdown 2024-09-12T01:59:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 -- 172.21.15.62:0/650259184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 msgr2=0x556f912fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912fb590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4000c00 tx=0x7f4cc4032ed0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 -- 172.21.15.62:0/650259184 shutdown_connections 2024-09-12T01:59:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x556f9130f430 0x556f913108a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 0x556f912fc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3c50 0x556f912fbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 --2- 172.21.15.62:0/650259184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3330 0x556f912fb590 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cbd600640 0 client.25072 ms_handle_reset on v2:172.21.15.77:6838/1365701824 2024-09-12T01:59:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 -- 172.21.15.62:0/650259184 >> 172.21.15.62:0/650259184 conn(0x556f912ef8c0 msgr2=0x556f912f55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 -- 172.21.15.62:0/650259184 shutdown_connections 2024-09-12T01:59:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.338+0000 7f4cdd089740 1 -- 172.21.15.62:0/650259184 wait complete. 2024-09-12T01:59:00.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.339+0000 7f4cdd089740 20 client.25072 trim_cache size 0 max 16384 2024-09-12T01:59:00.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.359+0000 7f4cdd089740 1 Processor -- start 2024-09-12T01:59:00.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.359+0000 7f4cdd089740 1 -- start start 2024-09-12T01:59:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.359+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3330 0x556f913101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.359+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 0x556f912f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.359+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 0x556f912fbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.359+0000 7f4cdd089740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556f9130ebe0 con 0x556f912f3330 2024-09-12T01:59:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.359+0000 7f4cdd089740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556f9130f2b0 con 0x556f912fe510 2024-09-12T01:59:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.359+0000 7f4cdd089740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556f9130f980 con 0x556f912f3c50 2024-09-12T01:59:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.359+0000 7f4cd3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3330 0x556f913101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.359+0000 7f4cd3e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 0x556f912fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3330 0x556f913101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47482/0 (socket says 172.21.15.62:47482) 2024-09-12T01:59:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd3400640 1 -- 172.21.15.62:0/2750451435 learned_addr learned my addr 172.21.15.62:0/2750451435 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:00.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/2750451435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 0x556f912f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd3e00640 1 -- 172.21.15.62:0/2750451435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 msgr2=0x556f912f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:00.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd3e00640 1 --2- 172.21.15.62:0/2750451435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 0x556f912f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd3e00640 1 -- 172.21.15.62:0/2750451435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3330 msgr2=0x556f913101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd3e00640 1 --2- 172.21.15.62:0/2750451435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3330 0x556f913101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd3e00640 1 -- 172.21.15.62:0/2750451435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f912f3a80 con 0x556f912fe510 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd3400640 1 --2- 172.21.15.62:0/2750451435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3330 0x556f913101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/2750451435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 0x556f912f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.360+0000 7f4cd3e00640 1 --2- 172.21.15.62:0/2750451435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 0x556f912fbb60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc01b040 tx=0x7f4ccc009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4334a94ddfdce46f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.361+0000 7f4cbfe00640 1 -- 172.21.15.62:0/2750451435 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc035070 con 0x556f912fe510 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.361+0000 7f4cbfe00640 1 -- 172.21.15.62:0/2750451435 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ccc005730 con 0x556f912fe510 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.361+0000 7f4cbfe00640 1 -- 172.21.15.62:0/2750451435 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc025c00 con 0x556f912fe510 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.361+0000 7f4cdd089740 1 -- 172.21.15.62:0/2750451435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 msgr2=0x556f912fbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.361+0000 7f4cdd089740 1 --2- 172.21.15.62:0/2750451435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 0x556f912fbb60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc01b040 tx=0x7f4ccc009500 comp rx=0 tx=0).stop 2024-09-12T01:59:00.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.362+0000 7f4cdd089740 1 -- 172.21.15.62:0/2750451435 shutdown_connections 2024-09-12T01:59:00.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.362+0000 7f4cdd089740 1 --2- 172.21.15.62:0/2750451435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912fe510 0x556f912fbb60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.362+0000 7f4cdd089740 1 --2- 172.21.15.62:0/2750451435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 0x556f912f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.362+0000 7f4cdd089740 1 --2- 172.21.15.62:0/2750451435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912f3330 0x556f913101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.362+0000 7f4cdd089740 1 -- 172.21.15.62:0/2750451435 >> 172.21.15.62:0/2750451435 conn(0x556f912ef8c0 msgr2=0x556f912f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.362+0000 7f4cdd089740 1 -- 172.21.15.62:0/2750451435 shutdown_connections 2024-09-12T01:59:00.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.362+0000 7f4cdd089740 1 -- 172.21.15.62:0/2750451435 wait complete. 2024-09-12T01:59:00.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.362+0000 7f4cdd089740 1 -- start start 2024-09-12T01:59:00.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cdd089740 1 Processor -- start 2024-09-12T01:59:00.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3330 0x556f912f8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 0x556f912f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cdd089740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912fe510 0x556f912f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cdd089740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556f91310720 con 0x556f912fe510 2024-09-12T01:59:00.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cdd089740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556f91310050 con 0x556f912f3330 2024-09-12T01:59:00.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cdd089740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556f91310df0 con 0x556f912f3c50 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cdd089740 10 client.0 _ll_register_callbacks cb 0x7f4cc4005dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cd3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3330 0x556f912f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cd3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3330 0x556f912f8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:48956/0 (socket says 172.21.15.62:48956) 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cd3400640 1 -- 172.21.15.62:0/135258856 learned_addr learned my addr 172.21.15.62:0/135258856 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.363+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 0x556f912f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.364+0000 7f4cd3e00640 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912fe510 0x556f912f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.364+0000 7f4cd3400640 1 -- 172.21.15.62:0/135258856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 msgr2=0x556f912f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.364+0000 7f4cd3400640 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 0x556f912f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.364+0000 7f4cd3400640 1 -- 172.21.15.62:0/135258856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912fe510 msgr2=0x556f912f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.364+0000 7f4cd3400640 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912fe510 0x556f912f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.364+0000 7f4cd3400640 1 -- 172.21.15.62:0/135258856 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f91317110 con 0x556f912f3330 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.364+0000 7f4cd3400640 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3330 0x556f912f8670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4031550 tx=0x7f4cc4004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a82181f1bf428fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:00.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.364+0000 7f4cbd600640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-12T01:59:00.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.367+0000 7f4cbd600640 1 -- 172.21.15.62:0/135258856 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4035070 con 0x556f912f3330 2024-09-12T01:59:00.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.367+0000 7f4cdd089740 1 -- 172.21.15.62:0/135258856 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ccc005730 con 0x556f912f3330 2024-09-12T01:59:00.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.367+0000 7f4cbd600640 1 -- 172.21.15.62:0/135258856 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f4cc4003cb0 con 0x556f912f3330 2024-09-12T01:59:00.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.367+0000 7f4cbd600640 1 -- 172.21.15.62:0/135258856 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4cc4005850 con 0x556f912f3330 2024-09-12T01:59:00.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.367+0000 7f4cdd089740 10 client.25049 fetch_fsmap learned FSMap version 21 2024-09-12T01:59:00.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.367+0000 7f4cdd089740 1 -- 172.21.15.62:0/135258856 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556f91379e00 con 0x556f912f3330 2024-09-12T01:59:00.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.367+0000 7f4cbd600640 1 -- 172.21.15.62:0/135258856 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ccc005730 con 0x556f912f3330 2024-09-12T01:59:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.368+0000 7f4cbd600640 1 -- 172.21.15.62:0/135258856 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4cc40315b0 con 0x556f912f3330 2024-09-12T01:59:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.368+0000 7f4cdd089740 10 client.25049 fetch_fsmap finished waiting for FSMap version 21 2024-09-12T01:59:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.368+0000 7f4cdd089740 10 client.25049 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:59:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.368+0000 7f4cdd089740 20 client.25049 populate_metadata read hostname 'smithi062' 2024-09-12T01:59:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.368+0000 7f4cdd089740 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x556f9137e9c0 0x556f9137d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.368+0000 7f4cdd089740 4 client.25049 mds_command: new command op to 24530 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:59:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.368+0000 7f4cdd089740 1 -- 172.21.15.62:0/135258856 --> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] -- command(tid 0: {"prefix": "status"}) -- 0x556f91260b30 con 0x556f9137e9c0 2024-09-12T01:59:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.368+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x556f9137e9c0 0x556f9137d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:00.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cd2a00640 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x556f9137e9c0 0x556f9137d6d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5408b0e13d07e27b server_cookie=9b62c183f394e716 in_seq=0 out_seq=0 2024-09-12T01:59:00.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cbd600640 10 client.25049 ms_handle_connect on v2:172.21.15.77:6838/1365701824 2024-09-12T01:59:00.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cbd600640 1 -- 172.21.15.62:0/135258856 <== mds.0 v2:172.21.15.77:6838/1365701824 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x556f91260b30 con 0x556f9137e9c0 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cbd600640 10 client.25049 handle_command_reply: tid=0 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 client.25049 shutdown 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 -- 172.21.15.62:0/135258856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3330 msgr2=0x556f912f8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3330 0x556f912f8670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4031550 tx=0x7f4cc4004410 comp rx=0 tx=0).stop 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 -- 172.21.15.62:0/135258856 shutdown_connections 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.77:6838/1365701824,v1:172.21.15.77:6839/1365701824] conn(0x556f9137e9c0 0x556f9137d6d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f912fe510 0x556f912f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f912f3c50 0x556f912f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 --2- 172.21.15.62:0/135258856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f912f3330 0x556f912f8670 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cbd600640 0 client.25049 ms_handle_reset on v2:172.21.15.77:6838/1365701824 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 -- 172.21.15.62:0/135258856 >> 172.21.15.62:0/135258856 conn(0x556f912ef8c0 msgr2=0x556f91309430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 -- 172.21.15.62:0/135258856 shutdown_connections 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 1 -- 172.21.15.62:0/135258856 wait complete. 2024-09-12T01:59:00.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.369+0000 7f4cdd089740 20 client.25049 trim_cache size 0 max 16384 2024-09-12T01:59:00.372 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:59:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "f18ee350-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:59:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2024-09-12T01:59:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 24530, 2024-09-12T01:59:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2024-09-12T01:59:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2024-09-12T01:59:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2024-09-12T01:59:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 137.578299708, 2024-09-12T01:59:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 21, 2024-09-12T01:59:00.372 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 94, 2024-09-12T01:59:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 92, 2024-09-12T01:59:00.373 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 150.16080327 2024-09-12T01:59:00.373 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 -- 172.21.15.62:0/2790881221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cb80a2aa0 msgr2=0x7f4cb80a4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cb80a2aa0 0x7f4cb80a4f60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009d60 tx=0x7f4ccc005fd0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 -- 172.21.15.62:0/2790881221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd41049a0 msgr2=0x7f4cd419ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd41049a0 0x7f4cd419ab60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e9f0 tx=0x7f4cc000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 -- 172.21.15.62:0/2790881221 shutdown_connections 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f4cb80a2aa0 0x7f4cb80a4f60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4cd4109120 0x7f4cd419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cd41049a0 0x7f4cd419ab60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 --2- 172.21.15.62:0/2790881221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4103ff0 0x7f4cd419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 -- 172.21.15.62:0/2790881221 >> 172.21.15.62:0/2790881221 conn(0x7f4cd40ffa90 msgr2=0x7f4cd4100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.370+0000 7f4cda600640 1 -- 172.21.15.62:0/2790881221 shutdown_connections 2024-09-12T01:59:00.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:00.371+0000 7f4cda600640 1 -- 172.21.15.62:0/2790881221 wait complete. 2024-09-12T01:59:01.111 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T01:59:01.120 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T01:59:01.120 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T01:59:01.121 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T01:59:01.121 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-12T01:59:01.121 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T01:59:01.122 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:59:01.122 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-12T01:59:01.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.276+0000 7f18ed600640 1 -- 172.21.15.62:0/4071458843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18e8105910 msgr2=0x7f18e810c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.276+0000 7f18ed600640 1 --2- 172.21.15.62:0/4071458843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18e8105910 0x7f18e810c1a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009ca0 tx=0x7f18e002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.276+0000 7f18ed600640 1 -- 172.21.15.62:0/4071458843 shutdown_connections 2024-09-12T01:59:01.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.276+0000 7f18ed600640 1 --2- 172.21.15.62:0/4071458843 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18e8105910 0x7f18e810c1a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.276+0000 7f18ed600640 1 --2- 172.21.15.62:0/4071458843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18e8104f50 0x7f18e81053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.276+0000 7f18ed600640 1 --2- 172.21.15.62:0/4071458843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18e8103d60 0x7f18e8104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.276+0000 7f18ed600640 1 -- 172.21.15.62:0/4071458843 >> 172.21.15.62:0/4071458843 conn(0x7f18e80ff4e0 msgr2=0x7f18e8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.277+0000 7f18ed600640 1 -- 172.21.15.62:0/4071458843 shutdown_connections 2024-09-12T01:59:01.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.277+0000 7f18ed600640 1 -- 172.21.15.62:0/4071458843 wait complete. 2024-09-12T01:59:01.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.277+0000 7f18ed600640 1 Processor -- start 2024-09-12T01:59:01.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18ed600640 1 -- start start 2024-09-12T01:59:01.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18ed600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18e8103d60 0x7f18e8199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18ed600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18e8104f50 0x7f18e819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18ed600640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18e8105910 0x7f18e81a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18ed600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f18e810fa30 con 0x7f18e8103d60 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18ed600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18e810f8b0 con 0x7f18e8104f50 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18ed600640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f18e810fbb0 con 0x7f18e8105910 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18e6a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18e8103d60 0x7f18e8199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18e6a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18e8103d60 0x7f18e8199f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47508/0 (socket says 172.21.15.62:47508) 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18e6a00640 1 -- 172.21.15.62:0/3295855622 learned_addr learned my addr 172.21.15.62:0/3295855622 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18e6000640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18e8104f50 0x7f18e819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.278+0000 7f18e7400640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18e8105910 0x7f18e81a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18e6a00640 1 -- 172.21.15.62:0/3295855622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18e8105910 msgr2=0x7f18e81a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18e6a00640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18e8105910 0x7f18e81a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18e6a00640 1 -- 172.21.15.62:0/3295855622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18e8104f50 msgr2=0x7f18e819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18e6a00640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18e8104f50 0x7f18e819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18e6a00640 1 -- 172.21.15.62:0/3295855622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e81a1b80 con 0x7f18e8103d60 2024-09-12T01:59:01.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18e6a00640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18e8103d60 0x7f18e8199f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f18d800e9c0 tx=0x7f18d800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18df400640 1 -- 172.21.15.62:0/3295855622 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d800cd80 con 0x7f18e8103d60 2024-09-12T01:59:01.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18df400640 1 -- 172.21.15.62:0/3295855622 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18d80035f0 con 0x7f18e8103d60 2024-09-12T01:59:01.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18ed600640 1 -- 172.21.15.62:0/3295855622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e81a1e70 con 0x7f18e8103d60 2024-09-12T01:59:01.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18df400640 1 -- 172.21.15.62:0/3295855622 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8010690 con 0x7f18e8103d60 2024-09-12T01:59:01.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.279+0000 7f18ed600640 1 -- 172.21.15.62:0/3295855622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e81a22d0 con 0x7f18e8103d60 2024-09-12T01:59:01.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.280+0000 7f18ed600640 1 -- 172.21.15.62:0/3295855622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e810afb0 con 0x7f18e8103d60 2024-09-12T01:59:01.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.282+0000 7f18df400640 1 -- 172.21.15.62:0/3295855622 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f18d80037a0 con 0x7f18e8103d60 2024-09-12T01:59:01.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.284+0000 7f18df400640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f18cc0a2c30 0x7f18cc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.284+0000 7f18df400640 1 -- 172.21.15.62:0/3295855622 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f18d80cf830 con 0x7f18e8103d60 2024-09-12T01:59:01.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.284+0000 7f18e6000640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f18cc0a2c30 0x7f18cc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.285+0000 7f18e6000640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f18cc0a2c30 0x7f18cc0a50f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18e819b470 tx=0x7f18d4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.288+0000 7f18df400640 1 -- 172.21.15.62:0/3295855622 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18d809c380 con 0x7f18e8103d60 2024-09-12T01:59:01.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:01.521+0000 7f18ed600640 1 -- 172.21.15.62:0/3295855622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f18e8062ef0 con 0x7f18e8103d60 2024-09-12T01:59:01.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:01 smithi107 ceph-mon[35463]: pgmap v373: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:59:01.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:01 smithi077 ceph-mon[35095]: pgmap v373: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:59:01.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:01 smithi062 ceph-mon[30666]: pgmap v373: 129 pgs: 129 active+clean; 641 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-12T01:59:02.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.374+0000 7f18df400640 1 -- 172.21.15.62:0/3295855622 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f18d809bc80 con 0x7f18e8103d60 2024-09-12T01:59:02.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.377+0000 7f18ed600640 1 -- 172.21.15.62:0/3295855622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f18cc0a2c30 msgr2=0x7f18cc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:02.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.377+0000 7f18ed600640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f18cc0a2c30 0x7f18cc0a50f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18e819b470 tx=0x7f18d4005f90 comp rx=0 tx=0).stop 2024-09-12T01:59:02.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.377+0000 7f18ed600640 1 -- 172.21.15.62:0/3295855622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18e8103d60 msgr2=0x7f18e8199f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:02.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.377+0000 7f18ed600640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18e8103d60 0x7f18e8199f60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f18d800e9c0 tx=0x7f18d800ee80 comp rx=0 tx=0).stop 2024-09-12T01:59:02.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.378+0000 7f18ed600640 1 -- 172.21.15.62:0/3295855622 shutdown_connections 2024-09-12T01:59:02.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.378+0000 7f18ed600640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f18cc0a2c30 0x7f18cc0a50f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:02.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.378+0000 7f18ed600640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18e8105910 0x7f18e81a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:02.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.378+0000 7f18ed600640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18e8104f50 0x7f18e819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:02.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.378+0000 7f18ed600640 1 --2- 172.21.15.62:0/3295855622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18e8103d60 0x7f18e8199f60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:02.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.378+0000 7f18ed600640 1 -- 172.21.15.62:0/3295855622 >> 172.21.15.62:0/3295855622 conn(0x7f18e80ff4e0 msgr2=0x7f18e8108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.380+0000 7f18ed600640 1 -- 172.21.15.62:0/3295855622 shutdown_connections 2024-09-12T01:59:02.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:02.381+0000 7f18ed600640 1 -- 172.21.15.62:0/3295855622 wait complete. 2024-09-12T01:59:02.403 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T01:59:02.418 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T01:59:02.419 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T01:59:02.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:59:02.419 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-09-12T01:59:02.455 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T01:59:02.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:59:02.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T01:59:02.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:59:02.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-09-12T01:59:02.638 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:02 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3295855622' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T01:59:02.639 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: ignoring --setuser ceph since I am not root 2024-09-12T01:59:02.639 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: ignoring --setgroup ceph since I am not root 2024-09-12T01:59:02.639 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:02.638+0000 7f2bcfe10040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:59:02.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:02 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3295855622' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T01:59:02.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: ignoring --setuser ceph since I am not root 2024-09-12T01:59:02.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: ignoring --setgroup ceph since I am not root 2024-09-12T01:59:02.704 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:02 smithi107 ceph-mgr[37276]: -- 172.21.15.107:0/234672729 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5631b897b0e0 con 0x5631b8959400 2024-09-12T01:59:02.704 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:02.529+0000 7f856c920040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:59:02.704 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:02.585+0000 7f856c920040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:59:02.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:02 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3295855622' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T01:59:02.715 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: ignoring --setuser ceph since I am not root 2024-09-12T01:59:02.715 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: ignoring --setgroup ceph since I am not root 2024-09-12T01:59:02.715 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:02 smithi077 ceph-mgr[36467]: -- 172.21.15.77:0/271562557 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5587161830e0 con 0x558716160800 2024-09-12T01:59:02.715 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:02.532+0000 7f9496d4f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:59:02.715 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:02.589+0000 7f9496d4f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:59:02.894 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:02.711+0000 7f2bcfe10040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:59:02.917 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-12T01:59:02.917 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:59:02.917 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:59:02.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T01:59:03.086 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:02.734+0000 7f856c920040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:59:03.086 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:02.799+0000 7f856c920040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:59:03.086 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:02.946+0000 7f856c920040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:59:03.089 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:02.737+0000 7f9496d4f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:59:03.089 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:02.803+0000 7f9496d4f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:59:03.089 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:02.949+0000 7f9496d4f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:59:03.089 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:03.089+0000 7f9496d4f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:59:03.181 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:02.912+0000 7f2bcfe10040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:59:03.181 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:02.997+0000 7f2bcfe10040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:59:03.181 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:03.180+0000 7f2bcfe10040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:59:03.314 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:03.376 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:03 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:03.086+0000 7f856c920040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:59:03.455 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:03 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3295855622' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T01:59:03.455 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:03 smithi062 ceph-mon[30666]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-12T01:59:03.455 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:03.369+0000 7f2bcfe10040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:59:03.642 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:03 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3295855622' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T01:59:03.642 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:03 smithi107 ceph-mon[35463]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-12T01:59:03.642 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:03 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:03.397+0000 7f856c920040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:59:03.642 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:03 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:03.458+0000 7f856c920040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:59:03.646 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:03 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3295855622' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T01:59:03.646 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:03 smithi077 ceph-mon[35095]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-12T01:59:03.646 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:03.402+0000 7f9496d4f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:59:03.646 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:03.463+0000 7f9496d4f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:59:03.646 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:03.645+0000 7f9496d4f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.869+0000 7f7617a00640 1 -- 172.21.15.62:0/3660138904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7610103ff0 msgr2=0x7f76101043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.869+0000 7f7617a00640 1 --2- 172.21.15.62:0/3660138904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7610103ff0 0x7f76101043d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7604009900 tx=0x7f760402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.869+0000 7f7617a00640 1 -- 172.21.15.62:0/3660138904 shutdown_connections 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.869+0000 7f7617a00640 1 --2- 172.21.15.62:0/3660138904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7610109120 0x7f7610110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.869+0000 7f7617a00640 1 --2- 172.21.15.62:0/3660138904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76101049a0 0x7f76101089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.869+0000 7f7617a00640 1 --2- 172.21.15.62:0/3660138904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7610103ff0 0x7f76101043d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.869+0000 7f7617a00640 1 -- 172.21.15.62:0/3660138904 >> 172.21.15.62:0/3660138904 conn(0x7f76100ffa90 msgr2=0x7f7610101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.870+0000 7f7617a00640 1 -- 172.21.15.62:0/3660138904 shutdown_connections 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.870+0000 7f7617a00640 1 -- 172.21.15.62:0/3660138904 wait complete. 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.871+0000 7f7617a00640 1 Processor -- start 2024-09-12T01:59:03.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.871+0000 7f7617a00640 1 -- start start 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.871+0000 7f7617a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7610103ff0 0x7f761019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.871+0000 7f7617a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76101049a0 0x7f761019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f7617a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7610109120 0x7f761019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f7617a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7610114120 con 0x7f7610109120 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f7617a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7610113fa0 con 0x7f7610103ff0 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f7617a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f76101142a0 con 0x7f76101049a0 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f7615000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7610103ff0 0x7f761019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f760fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76101049a0 0x7f761019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f7615000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7610103ff0 0x7f761019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:39660/0 (socket says 172.21.15.62:39660) 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f7615000640 1 -- 172.21.15.62:0/3272415577 learned_addr learned my addr 172.21.15.62:0/3272415577 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:03.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f7615a00640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7610109120 0x7f761019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f760fe00640 1 -- 172.21.15.62:0/3272415577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7610103ff0 msgr2=0x7f761019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f760fe00640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7610103ff0 0x7f761019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f760fe00640 1 -- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7610109120 msgr2=0x7f761019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f760fe00640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7610109120 0x7f761019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.872+0000 7f760fe00640 1 -- 172.21.15.62:0/3272415577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761019f590 con 0x7f76101049a0 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.873+0000 7f760fe00640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76101049a0 0x7f761019ab20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00e9f0 tx=0x7f75fc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.873+0000 7f760d600640 1 -- 172.21.15.62:0/3272415577 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00cd80 con 0x7f76101049a0 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.873+0000 7f760d600640 1 -- 172.21.15.62:0/3272415577 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75fc0035f0 con 0x7f76101049a0 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.873+0000 7f760d600640 1 -- 172.21.15.62:0/3272415577 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc010690 con 0x7f76101049a0 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.873+0000 7f7617a00640 1 -- 172.21.15.62:0/3272415577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761019f880 con 0x7f76101049a0 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.873+0000 7f7617a00640 1 -- 172.21.15.62:0/3272415577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76101a7160 con 0x7f76101049a0 2024-09-12T01:59:03.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.874+0000 7f7617a00640 1 -- 172.21.15.62:0/3272415577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76101043d0 con 0x7f76101049a0 2024-09-12T01:59:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.876+0000 7f760d600640 1 -- 172.21.15.62:0/3272415577 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f75fc003b30 con 0x7f76101049a0 2024-09-12T01:59:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.877+0000 7f760d600640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75f80a2bd0 0x7f75f80a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.877+0000 7f7615000640 1 -- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75f80a2bd0 msgr2=0x7f75f80a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1859863767 2024-09-12T01:59:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.877+0000 7f760d600640 1 -- 172.21.15.62:0/3272415577 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f75fc0cf790 con 0x7f76101049a0 2024-09-12T01:59:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.877+0000 7f7615000640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75f80a2bd0 0x7f75f80a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:59:03.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:03.881+0000 7f760d600640 1 -- 172.21.15.62:0/3272415577 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75fc09c2e0 con 0x7f76101049a0 2024-09-12T01:59:03.953 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:03 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:03.641+0000 7f856c920040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:59:04.064 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:03.760+0000 7f2bcfe10040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:59:04.064 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:03.838+0000 7f2bcfe10040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:59:04.065 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:04 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:04.063+0000 7f2bcfe10040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:59:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.078+0000 7f7615000640 1 -- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75f80a2bd0 msgr2=0x7f75f80a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1859863767 2024-09-12T01:59:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.078+0000 7f7615000640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75f80a2bd0 0x7f75f80a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:59:04.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.106+0000 7f7617a00640 1 -- 172.21.15.62:0/3272415577 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f761002d7c0 con 0x7f76101049a0 2024-09-12T01:59:04.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.107+0000 7f760d600640 1 -- 172.21.15.62:0/3272415577 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+88 (secure 0 0 0) 0x7f75fc09bbe0 con 0x7f76101049a0 2024-09-12T01:59:04.107 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T01:59:04.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.109+0000 7f7617a00640 1 -- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75f80a2bd0 msgr2=0x7f75f80a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:59:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.109+0000 7f7617a00640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75f80a2bd0 0x7f75f80a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.109+0000 7f7617a00640 1 -- 172.21.15.62:0/3272415577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76101049a0 msgr2=0x7f761019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.109+0000 7f7617a00640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76101049a0 0x7f761019ab20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00e9f0 tx=0x7f75fc00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:59:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.109+0000 7f7617a00640 1 -- 172.21.15.62:0/3272415577 shutdown_connections 2024-09-12T01:59:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.109+0000 7f7617a00640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f75f80a2bd0 0x7f75f80a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.109+0000 7f7617a00640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7610109120 0x7f761019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.109+0000 7f7617a00640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76101049a0 0x7f761019ab20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.109+0000 7f7617a00640 1 --2- 172.21.15.62:0/3272415577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7610103ff0 0x7f761019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:04.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.109+0000 7f7617a00640 1 -- 172.21.15.62:0/3272415577 >> 172.21.15.62:0/3272415577 conn(0x7f76100ffa90 msgr2=0x7f7610100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:04.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.110+0000 7f7617a00640 1 -- 172.21.15.62:0/3272415577 shutdown_connections 2024-09-12T01:59:04.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04.110+0000 7f7617a00640 1 -- 172.21.15.62:0/3272415577 wait complete. 2024-09-12T01:59:04.587 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:04 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3272415577' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:59:04.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:04 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3272415577' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:59:04.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:04.526+0000 7f856c920040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:59:04.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:04.592+0000 7f856c920040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:59:04.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:04 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3272415577' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:59:04.714 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:04 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:04.528+0000 7f9496d4f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:59:04.714 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:04 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:04.594+0000 7f9496d4f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:59:04.820 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:59:04.820 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:59:04.820 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2024-09-12T01:59:04.821 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:59:04.821 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:59:04.821 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:59:04.821 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:59:04.821 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:59:04.821 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:59:04.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:59:04.821 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2024-09-12T01:59:04.859 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:59:04.859 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:59:04.859 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:59:04.859 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:59:04.859 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-09-12T01:59:04.859 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:59:04.859 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42085sec preferred_lft 42085sec 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link noprefixroute 2024-09-12T01:59:04.860 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:59:04.861 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:59:04.861 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:59:04.861 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-09-12T01:59:04.861 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:59:04.861 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2024-09-12T01:59:04.861 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2024-09-12T01:59:04.861 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:59:04.861 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-09-12T01:59:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:59:05.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:59:05.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:59:05.092 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:59:05.149 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-09-12T01:59:05.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:59:05.152 DEBUG:teuthology.orchestra.run.smithi062:> route 2024-09-12T01:59:05.189 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2024-09-12T01:59:05.189 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:59:05.190 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:59:05.190 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:59:05.190 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:59:05.190 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:59:05.190 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-09-12T01:59:05.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:59:05.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:59:05.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:59:05.190 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-09-12T01:59:05.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:59:05.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:59:05.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:59:05.393 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-09-12T01:59:05.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:59:05.430 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2024-09-12T01:59:05.508 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:59:05.508 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-09-12T01:59:05.508 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:59:05.508 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T01:59:05.508 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-09-12T01:59:05.553 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:05.297+0000 7f856c920040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:59:05.554 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:05.411+0000 7f856c920040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:59:05.558 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:05.299+0000 7f9496d4f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:59:05.558 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:05.414+0000 7f9496d4f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:59:05.591 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:05 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:05.255+0000 7f2bcfe10040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:59:05.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:05 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:05.342+0000 7f2bcfe10040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:59:05.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:59:05.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:59:05.692 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T01:59:05.692 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:59:05.692 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-09-12T01:59:05.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T01:59:05.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:59:05.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T01:59:05.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T01:59:05.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T01:59:05.693 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-09-12T01:59:05.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:59:05.829 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:05.553+0000 7f856c920040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:59:05.829 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:05.614+0000 7f856c920040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:59:05.829 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:05.761+0000 7f856c920040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:59:05.829 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:05.828+0000 7f856c920040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:59:05.835 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:05.558+0000 7f9496d4f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:59:05.835 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:05.619+0000 7f9496d4f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:59:05.835 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:05.767+0000 7f9496d4f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:59:05.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:59:05.961 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:59:05.961 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-09-12T01:59:05.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2024-09-12T01:59:05.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:59:05.961 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-09-12T01:59:06.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:59:06.114 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:05.891+0000 7f856c920040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:59:06.114 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:06.049+0000 7f856c920040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:59:06.121 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:05.834+0000 7f9496d4f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:59:06.121 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:05.897+0000 7f9496d4f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:59:06.121 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:06.055+0000 7f9496d4f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:59:06.121 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:06.120+0000 7f9496d4f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:59:06.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:59:06.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:59:06.131 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:59:06.167 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:59:06.168 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:59:06.168 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:59:06.243 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T01:59:06.244 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T01:59:06.244 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/6ce17497-48d7-412a-802f-1f68aeacf26d 2024-09-12T01:59:06.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:59:06.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/6ce17497-48d7-412a-802f-1f68aeacf26d /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-12T01:59:06.376 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-12T01:59:06.376 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-12T01:59:06.376 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2024-09-12T01:59:06.379 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:06.113+0000 7f856c920040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:59:06.379 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:06.180+0000 7f856c920040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:59:06.379 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:06.261+0000 7f856c920040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:59:06.379 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:06.320+0000 7f856c920040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:59:06.387 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:06.186+0000 7f9496d4f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:59:06.387 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:06.268+0000 7f9496d4f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:59:06.387 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:06.328+0000 7f9496d4f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:59:06.387 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:06.387+0000 7f9496d4f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:59:06.591 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:06.349+0000 7f2bcfe10040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:59:06.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:06.498+0000 7f2bcfe10040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:59:06.703 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:06.379+0000 7f856c920040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:59:06.953 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:06.695+0000 7f2bcfe10040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:59:06.953 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:06.774+0000 7f2bcfe10040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:59:06.954 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:06.953+0000 7f2bcfe10040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:59:06.988 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-12T01:59:06.989 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-12T01:59:06.989 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2024-09-12T01:59:06.989 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:6789,172.21.15.77:6789,172.21.15.107:6789" 2024-09-12T01:59:06.989 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.62:6789,172.21.15.77:6789,172.21.15.107:6789:/volumes/qa/sv_1/6ce17497-48d7-412a-802f-1f68aeacf26d 2024-09-12T01:59:06.989 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=f18ee350-70a8-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T01:59:06.991 INFO:teuthology.orchestra.run.smithi062.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:59:06.991 INFO:teuthology.orchestra.run.smithi062.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:59:06.991 INFO:teuthology.orchestra.run.smithi062.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:59:06.991 INFO:teuthology.orchestra.run.smithi062.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:59:06.991 INFO:teuthology.orchestra.run.smithi062.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:59:06.994 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:59:06.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:59:06.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:59:07.054 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:59:07.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:59:07.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:59:07.148 INFO:teuthology.orchestra.run.smithi062.stdout:client25108 2024-09-12T01:59:07.148 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:59:07.148 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:59:07.190 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:59:07.236 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:07.042+0000 7f2bcfe10040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:59:07.236 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:07.119+0000 7f2bcfe10040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:59:07.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:59:07.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:59:07.323 INFO:teuthology.orchestra.run.smithi062.stdout:client25108 2024-09-12T01:59:07.324 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:59:07.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:59:07.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:59:07.453 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z[37272]: 2024-09-12T01:59:07.167+0000 7f856c920040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:59:07.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: Standby manager daemon z restarted 2024-09-12T01:59:07.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: Standby manager daemon z started 2024-09-12T01:59:07.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:59:07.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:07.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:59:07.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:07.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: Standby manager daemon y restarted 2024-09-12T01:59:07.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: Standby manager daemon y started 2024-09-12T01:59:07.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:59:07.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:07.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:59:07.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:07 smithi107 ceph-mon[35463]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:07.456 INFO:teuthology.orchestra.run.smithi062.stdout:client25108 2024-09-12T01:59:07.457 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f18ee350-70a8-11ef-bcea-c7b262605968.client25108/status') 2024-09-12T01:59:07.464 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y[36463]: 2024-09-12T01:59:07.180+0000 7f9496d4f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:59:07.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: Standby manager daemon z restarted 2024-09-12T01:59:07.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: Standby manager daemon z started 2024-09-12T01:59:07.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:59:07.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:07.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:59:07.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:07.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: Standby manager daemon y restarted 2024-09-12T01:59:07.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: Standby manager daemon y started 2024-09-12T01:59:07.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:59:07.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:07.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:59:07.466 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:07 smithi077 ceph-mon[35095]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:07.489 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:07.319+0000 7f2bcfe10040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:59:07.489 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:07.402+0000 7f2bcfe10040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:59:07.489 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:07.489+0000 7f2bcfe10040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:59:07.489 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: Standby manager daemon z restarted 2024-09-12T01:59:07.489 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: Standby manager daemon z started 2024-09-12T01:59:07.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:59:07.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:07.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:59:07.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.107:0/2589832686' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:07.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: Standby manager daemon y restarted 2024-09-12T01:59:07.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: Standby manager daemon y started 2024-09-12T01:59:07.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:59:07.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:59:07.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:59:07.490 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-mon[30666]: from='mgr.? 172.21.15.77:0/1813464362' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:59:07.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:59:07.559 INFO:teuthology.orchestra.run.smithi062.stdout:instance: client.25108 (3)172.21.15.62:0/3198576642 2024-09-12T01:59:07.559 INFO:teuthology.orchestra.run.smithi062.stdout:blocklisted: false 2024-09-12T01:59:07.559 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records in 2024-09-12T01:59:07.559 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records out 2024-09-12T01:59:07.560 INFO:teuthology.orchestra.run.smithi062.stderr:71 bytes copied, 7.9488e-05 s, 893 kB/s 2024-09-12T01:59:07.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:59:07.570 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T01:59:07.584 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T01:59:07.599 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T01:59:07.600 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:59:07.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-12T01:59:07.746 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:07.593+0000 7f2bcfe10040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:59:07.746 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:07.669+0000 7f2bcfe10040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:59:07.746 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:07.746+0000 7f2bcfe10040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:59:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.769+0000 7f63dc200640 1 -- 172.21.15.62:0/2587471233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d4102d50 msgr2=0x7f63d41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.769+0000 7f63dc200640 1 --2- 172.21.15.62:0/2587471233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d4102d50 0x7f63d41031d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009900 tx=0x7f63c002a410 comp rx=0 tx=0).stop 2024-09-12T01:59:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.770+0000 7f63dc200640 1 -- 172.21.15.62:0/2587471233 shutdown_connections 2024-09-12T01:59:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.770+0000 7f63dc200640 1 --2- 172.21.15.62:0/2587471233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d4103710 0x7f63d4109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.770+0000 7f63dc200640 1 --2- 172.21.15.62:0/2587471233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d4102d50 0x7f63d41031d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.770+0000 7f63dc200640 1 --2- 172.21.15.62:0/2587471233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d4101b60 0x7f63d4101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.770+0000 7f63dc200640 1 -- 172.21.15.62:0/2587471233 >> 172.21.15.62:0/2587471233 conn(0x7f63d40fd2e0 msgr2=0x7f63d40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.770+0000 7f63dc200640 1 -- 172.21.15.62:0/2587471233 shutdown_connections 2024-09-12T01:59:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.770+0000 7f63dc200640 1 -- 172.21.15.62:0/2587471233 wait complete. 2024-09-12T01:59:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63dc200640 1 Processor -- start 2024-09-12T01:59:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63dc200640 1 -- start start 2024-09-12T01:59:07.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63dc200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d4101b60 0x7f63d4197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:07.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63dc200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d4102d50 0x7f63d4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63dc200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d4103710 0x7f63d419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63dc200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f63d410d830 con 0x7f63d4101b60 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63dc200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f63d410d6b0 con 0x7f63d4103710 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63dc200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f63d410d9b0 con 0x7f63d4102d50 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63d8e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d4102d50 0x7f63d4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63d8e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d4102d50 0x7f63d4198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:52312/0 (socket says 172.21.15.62:52312) 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63d8e00640 1 -- 172.21.15.62:0/666292961 learned_addr learned my addr 172.21.15.62:0/666292961 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63d9800640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d4101b60 0x7f63d4197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.771+0000 7f63da200640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d4103710 0x7f63d419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63d8e00640 1 -- 172.21.15.62:0/666292961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d4103710 msgr2=0x7f63d419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63d8e00640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d4103710 0x7f63d419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63d8e00640 1 -- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d4101b60 msgr2=0x7f63d4197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:07.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63d8e00640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d4101b60 0x7f63d4197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63d8e00640 1 -- 172.21.15.62:0/666292961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d419fa20 con 0x7f63d4102d50 2024-09-12T01:59:07.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63d8e00640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d4102d50 0x7f63d4198340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f63c0031440 tx=0x7f63c0032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:07.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63d2000640 1 -- 172.21.15.62:0/666292961 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c003f030 con 0x7f63d4102d50 2024-09-12T01:59:07.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63d2000640 1 -- 172.21.15.62:0/666292961 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63c0003ce0 con 0x7f63d4102d50 2024-09-12T01:59:07.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63d2000640 1 -- 172.21.15.62:0/666292961 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c0035070 con 0x7f63d4102d50 2024-09-12T01:59:07.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63dc200640 1 -- 172.21.15.62:0/666292961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d419fcb0 con 0x7f63d4102d50 2024-09-12T01:59:07.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.772+0000 7f63dc200640 1 -- 172.21.15.62:0/666292961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d41a01a0 con 0x7f63d4102d50 2024-09-12T01:59:07.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.774+0000 7f63dc200640 1 -- 172.21.15.62:0/666292961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d4108e80 con 0x7f63d4102d50 2024-09-12T01:59:07.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.775+0000 7f63d2000640 1 -- 172.21.15.62:0/666292961 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 137850+0+0 (secure 0 0 0) 0x7f63c0042030 con 0x7f63d4102d50 2024-09-12T01:59:07.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.777+0000 7f63d2000640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63bc0a2c80 0x7f63bc0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:07.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.777+0000 7f63d2000640 1 -- 172.21.15.62:0/666292961 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f63c00efd90 con 0x7f63d4102d50 2024-09-12T01:59:07.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.777+0000 7f63d9800640 1 -- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63bc0a2c80 msgr2=0x7f63bc0a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1859863767 2024-09-12T01:59:07.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.777+0000 7f63d9800640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63bc0a2c80 0x7f63bc0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:59:07.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.780+0000 7f63d2000640 1 -- 172.21.15.62:0/666292961 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63c00bc8e0 con 0x7f63d4102d50 2024-09-12T01:59:07.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.974+0000 7f63dc200640 1 -- 172.21.15.62:0/666292961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f63d4062e60 con 0x7f63d4102d50 2024-09-12T01:59:07.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.978+0000 7f63d9800640 1 -- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63bc0a2c80 msgr2=0x7f63bc0a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1859863767 2024-09-12T01:59:07.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.978+0000 7f63d9800640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63bc0a2c80 0x7f63bc0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:59:07.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.980+0000 7f63d2000640 1 -- 172.21.15.62:0/666292961 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v28)=0 v28) ==== 129+0+0 (secure 0 0 0) 0x7f63c00dae20 con 0x7f63d4102d50 2024-09-12T01:59:07.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 -- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63bc0a2c80 msgr2=0x7f63bc0a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:59:07.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63bc0a2c80 0x7f63bc0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 -- 172.21.15.62:0/666292961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d4102d50 msgr2=0x7f63d4198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:07.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d4102d50 0x7f63d4198340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f63c0031440 tx=0x7f63c0032ce0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 -- 172.21.15.62:0/666292961 shutdown_connections 2024-09-12T01:59:07.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f63bc0a2c80 0x7f63bc0a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d4103710 0x7f63d419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d4102d50 0x7f63d4198340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 --2- 172.21.15.62:0/666292961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63d4101b60 0x7f63d4197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:07.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 -- 172.21.15.62:0/666292961 >> 172.21.15.62:0/666292961 conn(0x7f63d40fd2e0 msgr2=0x7f63d4106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:07.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 -- 172.21.15.62:0/666292961 shutdown_connections 2024-09-12T01:59:07.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:07.984+0000 7f63dc200640 1 -- 172.21.15.62:0/666292961 wait complete. 2024-09-12T01:59:07.999 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-12T01:59:08.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.156+0000 7f569f000640 1 -- 172.21.15.62:0/3572480950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5698103050 msgr2=0x7f5698103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.156+0000 7f569f000640 1 --2- 172.21.15.62:0/3572480950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5698103050 0x7f5698103450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f568c009900 tx=0x7f568c02a3f0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.156+0000 7f569f000640 1 -- 172.21.15.62:0/3572480950 shutdown_connections 2024-09-12T01:59:08.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.156+0000 7f569f000640 1 --2- 172.21.15.62:0/3572480950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5698101f40 0x7f5698109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.156+0000 7f569f000640 1 --2- 172.21.15.62:0/3572480950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698101580 0x7f5698101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.156+0000 7f569f000640 1 --2- 172.21.15.62:0/3572480950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5698103050 0x7f5698103450 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.156+0000 7f569f000640 1 -- 172.21.15.62:0/3572480950 >> 172.21.15.62:0/3572480950 conn(0x7f56980fd0d0 msgr2=0x7f56980ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.156+0000 7f569f000640 1 -- 172.21.15.62:0/3572480950 shutdown_connections 2024-09-12T01:59:08.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.156+0000 7f569f000640 1 -- 172.21.15.62:0/3572480950 wait complete. 2024-09-12T01:59:08.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.157+0000 7f569f000640 1 Processor -- start 2024-09-12T01:59:08.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.157+0000 7f569f000640 1 -- start start 2024-09-12T01:59:08.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569f000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698101580 0x7f569819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569f000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5698101f40 0x7f569819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569f000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5698103050 0x7f56981a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569f000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f569810d6f0 con 0x7f5698101f40 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569f000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f569810d570 con 0x7f5698101580 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569f000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f569810d870 con 0x7f5698103050 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569d200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5698101f40 0x7f569819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569dc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698101580 0x7f569819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569d200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5698101f40 0x7f569819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34328/0 (socket says 172.21.15.62:34328) 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569d200640 1 -- 172.21.15.62:0/2668245041 learned_addr learned my addr 172.21.15.62:0/2668245041 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569e600640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5698103050 0x7f56981a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569d200640 1 -- 172.21.15.62:0/2668245041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5698103050 msgr2=0x7f56981a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569d200640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5698103050 0x7f56981a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569d200640 1 -- 172.21.15.62:0/2668245041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698101580 msgr2=0x7f569819a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.158+0000 7f569d200640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698101580 0x7f569819a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.159+0000 7f569d200640 1 -- 172.21.15.62:0/2668245041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56981a1c60 con 0x7f5698101f40 2024-09-12T01:59:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.159+0000 7f569dc00640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698101580 0x7f569819a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.159+0000 7f569d200640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5698101f40 0x7f569819a580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f568400e9f0 tx=0x7f568400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.159+0000 7f5696000640 1 -- 172.21.15.62:0/2668245041 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568400cd80 con 0x7f5698101f40 2024-09-12T01:59:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.159+0000 7f5696000640 1 -- 172.21.15.62:0/2668245041 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5684005500 con 0x7f5698101f40 2024-09-12T01:59:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.159+0000 7f569f000640 1 -- 172.21.15.62:0/2668245041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56981a1f50 con 0x7f5698101f40 2024-09-12T01:59:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.159+0000 7f5696000640 1 -- 172.21.15.62:0/2668245041 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684010690 con 0x7f5698101f40 2024-09-12T01:59:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.159+0000 7f569f000640 1 -- 172.21.15.62:0/2668245041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56981a23c0 con 0x7f5698101f40 2024-09-12T01:59:08.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.161+0000 7f569f000640 1 -- 172.21.15.62:0/2668245041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5698101a00 con 0x7f5698101f40 2024-09-12T01:59:08.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.163+0000 7f5696000640 1 -- 172.21.15.62:0/2668245041 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 20) ==== 137850+0+0 (secure 0 0 0) 0x7f56840046c0 con 0x7f5698101f40 2024-09-12T01:59:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.164+0000 7f5696000640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f56800a2bd0 0x7f56800a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.164+0000 7f569dc00640 1 -- 172.21.15.62:0/2668245041 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f56800a2bd0 msgr2=0x7f56800a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1859863767 2024-09-12T01:59:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.164+0000 7f5696000640 1 -- 172.21.15.62:0/2668245041 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f56840cf880 con 0x7f5698101f40 2024-09-12T01:59:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.164+0000 7f569dc00640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f56800a2bd0 0x7f56800a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:59:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.168+0000 7f5696000640 1 -- 172.21.15.62:0/2668245041 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f568409c3d0 con 0x7f5698101f40 2024-09-12T01:59:08.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:08 smithi062 ceph-mon[30666]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-12T01:59:08.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:08 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' 2024-09-12T01:59:08.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.356+0000 7f569f000640 1 -- 172.21.15.62:0/2668245041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f56981a2d30 con 0x7f5698101f40 2024-09-12T01:59:08.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.360+0000 7f5696000640 1 -- 172.21.15.62:0/2668245041 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f568409bcd0 con 0x7f5698101f40 2024-09-12T01:59:08.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 -- 172.21.15.62:0/2668245041 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f56800a2bd0 msgr2=0x7f56800a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f56800a2bd0 0x7f56800a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 -- 172.21.15.62:0/2668245041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5698101f40 msgr2=0x7f569819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5698101f40 0x7f569819a580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f568400e9f0 tx=0x7f568400edf0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 -- 172.21.15.62:0/2668245041 shutdown_connections 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f56800a2bd0 0x7f56800a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5698103050 0x7f56981a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5698101f40 0x7f569819a580 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 --2- 172.21.15.62:0/2668245041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698101580 0x7f569819a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 -- 172.21.15.62:0/2668245041 >> 172.21.15.62:0/2668245041 conn(0x7f56980fd0d0 msgr2=0x7f5698074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 -- 172.21.15.62:0/2668245041 shutdown_connections 2024-09-12T01:59:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.363+0000 7f569f000640 1 -- 172.21.15.62:0/2668245041 wait complete. 2024-09-12T01:59:08.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-12T01:59:08.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.540+0000 7f7255c00640 1 -- 172.21.15.62:0/1209627686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7250101f40 msgr2=0x7f7250109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.540+0000 7f7255c00640 1 --2- 172.21.15.62:0/1209627686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7250101f40 0x7f7250109db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7248009be0 tx=0x7f724802a6c0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.540+0000 7f7255c00640 1 -- 172.21.15.62:0/1209627686 shutdown_connections 2024-09-12T01:59:08.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.540+0000 7f7255c00640 1 --2- 172.21.15.62:0/1209627686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7250101f40 0x7f7250109db0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.540+0000 7f7255c00640 1 --2- 172.21.15.62:0/1209627686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7250101580 0x7f7250101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.540+0000 7f7255c00640 1 --2- 172.21.15.62:0/1209627686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7250103050 0x7f7250103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.540+0000 7f7255c00640 1 -- 172.21.15.62:0/1209627686 >> 172.21.15.62:0/1209627686 conn(0x7f72500fd0d0 msgr2=0x7f72500ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.540+0000 7f7255c00640 1 -- 172.21.15.62:0/1209627686 shutdown_connections 2024-09-12T01:59:08.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.540+0000 7f7255c00640 1 -- 172.21.15.62:0/1209627686 wait complete. 2024-09-12T01:59:08.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.542+0000 7f7255c00640 1 Processor -- start 2024-09-12T01:59:08.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.542+0000 7f7255c00640 1 -- start start 2024-09-12T01:59:08.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.542+0000 7f7255c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7250101580 0x7f7250197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.542+0000 7f7255c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7250101f40 0x7f7250198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.542+0000 7f7255c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7250103050 0x7f725019f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.542+0000 7f7255c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f725010d6d0 con 0x7f7250101580 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.542+0000 7f7255c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f725010d550 con 0x7f7250103050 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.542+0000 7f7255c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f725010d850 con 0x7f7250101f40 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f724fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7250101580 0x7f7250197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7255200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7250103050 0x7f725019f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7247400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7250101f40 0x7f7250198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7255200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7250103050 0x7f725019f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:39706/0 (socket says 172.21.15.62:39706) 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f724fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7250101580 0x7f7250197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34354/0 (socket says 172.21.15.62:34354) 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7255200640 1 -- 172.21.15.62:0/3225435425 learned_addr learned my addr 172.21.15.62:0/3225435425 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7247400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7250101f40 0x7f7250198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:52360/0 (socket says 172.21.15.62:52360) 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7247400640 1 -- 172.21.15.62:0/3225435425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7250103050 msgr2=0x7f725019f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7247400640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7250103050 0x7f725019f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7247400640 1 -- 172.21.15.62:0/3225435425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7250101580 msgr2=0x7f7250197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7247400640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7250101580 0x7f7250197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7247400640 1 -- 172.21.15.62:0/3225435425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725019f970 con 0x7f7250101f40 2024-09-12T01:59:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f7247400640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7250101f40 0x7f7250198290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7238005fd0 tx=0x7f723800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.543+0000 7f724d600640 1 -- 172.21.15.62:0/3225435425 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723800cd00 con 0x7f7250101f40 2024-09-12T01:59:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.544+0000 7f724d600640 1 -- 172.21.15.62:0/3225435425 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72380035f0 con 0x7f7250101f40 2024-09-12T01:59:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.544+0000 7f724d600640 1 -- 172.21.15.62:0/3225435425 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238010670 con 0x7f7250101f40 2024-09-12T01:59:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.544+0000 7f7255c00640 1 -- 172.21.15.62:0/3225435425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725019fc60 con 0x7f7250101f40 2024-09-12T01:59:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.544+0000 7f7255c00640 1 -- 172.21.15.62:0/3225435425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72501a0160 con 0x7f7250101f40 2024-09-12T01:59:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.545+0000 7f7255c00640 1 -- 172.21.15.62:0/3225435425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7250101a00 con 0x7f7250101f40 2024-09-12T01:59:08.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.547+0000 7f724d600640 1 -- 172.21.15.62:0/3225435425 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 137850+0+0 (secure 0 0 0) 0x7f72380037a0 con 0x7f7250101f40 2024-09-12T01:59:08.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.548+0000 7f724d600640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f72340a2bd0 0x7f72340a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.548+0000 7f724fe00640 1 -- 172.21.15.62:0/3225435425 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f72340a2bd0 msgr2=0x7f72340a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.62:6800/1859863767 2024-09-12T01:59:08.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.548+0000 7f724d600640 1 -- 172.21.15.62:0/3225435425 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9179+0+0 (secure 0 0 0) 0x7f72380cf680 con 0x7f7250101f40 2024-09-12T01:59:08.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.548+0000 7f724fe00640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f72340a2bd0 0x7f72340a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:59:08.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.552+0000 7f724d600640 1 -- 172.21.15.62:0/3225435425 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7238009510 con 0x7f7250101f40 2024-09-12T01:59:08.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:08 smithi107 ceph-mon[35463]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-12T01:59:08.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:08 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' 2024-09-12T01:59:08.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:08 smithi077 ceph-mon[35095]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-12T01:59:08.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:08 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' 2024-09-12T01:59:08.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.739+0000 7f7255c00640 1 -- 172.21.15.62:0/3225435425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f7250062df0 con 0x7f7250101f40 2024-09-12T01:59:08.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.746+0000 7f724d600640 1 -- 172.21.15.62:0/3225435425 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7f723809c1d0 con 0x7f7250101f40 2024-09-12T01:59:08.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 -- 172.21.15.62:0/3225435425 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f72340a2bd0 msgr2=0x7f72340a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:59:08.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f72340a2bd0 0x7f72340a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 -- 172.21.15.62:0/3225435425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7250101f40 msgr2=0x7f7250198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7250101f40 0x7f7250198290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7238005fd0 tx=0x7f723800ee50 comp rx=0 tx=0).stop 2024-09-12T01:59:08.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 -- 172.21.15.62:0/3225435425 shutdown_connections 2024-09-12T01:59:08.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.62:6800/1859863767,v1:172.21.15.62:6801/1859863767] conn(0x7f72340a2bd0 0x7f72340a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7250103050 0x7f725019f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7250101f40 0x7f7250198290 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 --2- 172.21.15.62:0/3225435425 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7250101580 0x7f7250197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 -- 172.21.15.62:0/3225435425 >> 172.21.15.62:0/3225435425 conn(0x7f72500fd0d0 msgr2=0x7f7250105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 -- 172.21.15.62:0/3225435425 shutdown_connections 2024-09-12T01:59:08.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.748+0000 7f7255c00640 1 -- 172.21.15.62:0/3225435425 wait complete. 2024-09-12T01:59:08.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-12T01:59:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.990+0000 7f09bec00640 1 -- 172.21.15.62:0/3598041400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09b8078790 msgr2=0x7f09b8079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.990+0000 7f09bec00640 1 --2- 172.21.15.62:0/3598041400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09b8078790 0x7f09b8079030 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009be0 tx=0x7f09b002a6c0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.990+0000 7f09bec00640 1 -- 172.21.15.62:0/3598041400 shutdown_connections 2024-09-12T01:59:08.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.990+0000 7f09bec00640 1 --2- 172.21.15.62:0/3598041400 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09b8078790 0x7f09b8079030 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.990+0000 7f09bec00640 1 --2- 172.21.15.62:0/3598041400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09b8077df0 0x7f09b8078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.990+0000 7f09bec00640 1 --2- 172.21.15.62:0/3598041400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09b8076bb0 0x7f09b8076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.990+0000 7f09bec00640 1 -- 172.21.15.62:0/3598041400 >> 172.21.15.62:0/3598041400 conn(0x7f09b80ff4e0 msgr2=0x7f09b8101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.991+0000 7f09bec00640 1 -- 172.21.15.62:0/3598041400 shutdown_connections 2024-09-12T01:59:08.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.991+0000 7f09bec00640 1 -- 172.21.15.62:0/3598041400 wait complete. 2024-09-12T01:59:08.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.992+0000 7f09bec00640 1 Processor -- start 2024-09-12T01:59:08.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.992+0000 7f09bec00640 1 -- start start 2024-09-12T01:59:08.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.993+0000 7f09bec00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09b8076bb0 0x7f09b819e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.993+0000 7f09bec00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09b8077df0 0x7f09b819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.993+0000 7f09bec00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09b8078790 0x7f09b81a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.993+0000 7f09bec00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8113e30 con 0x7f09b8077df0 2024-09-12T01:59:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.993+0000 7f09bec00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8113cb0 con 0x7f09b8078790 2024-09-12T01:59:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.993+0000 7f09bec00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f09b8113fb0 con 0x7f09b8076bb0 2024-09-12T01:59:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.993+0000 7f09bcc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09b8078790 0x7f09b81a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.993+0000 7f09b7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09b8077df0 0x7f09b819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.994+0000 7f09bcc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09b8078790 0x7f09b81a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:39802/0 (socket says 172.21.15.62:39802) 2024-09-12T01:59:08.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.994+0000 7f09bcc00640 1 -- 172.21.15.62:0/1636415191 learned_addr learned my addr 172.21.15.62:0/1636415191 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:08.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.994+0000 7f09bcc00640 1 -- 172.21.15.62:0/1636415191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09b8076bb0 msgr2=0x7f09b819e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.994+0000 7f09bcc00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09b8076bb0 0x7f09b819e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.994+0000 7f09bcc00640 1 -- 172.21.15.62:0/1636415191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09b8077df0 msgr2=0x7f09b819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.994+0000 7f09bcc00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09b8077df0 0x7f09b819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.994+0000 7f09bcc00640 1 -- 172.21.15.62:0/1636415191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b81a5fb0 con 0x7f09b8078790 2024-09-12T01:59:08.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.994+0000 7f09b7400640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09b8077df0 0x7f09b819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:08.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.995+0000 7f09bcc00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09b8078790 0x7f09b81a5940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09b0034040 tx=0x7f09b00305b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.995+0000 7f09b4c00640 1 -- 172.21.15.62:0/1636415191 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0041020 con 0x7f09b8078790 2024-09-12T01:59:08.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.996+0000 7f09b4c00640 1 -- 172.21.15.62:0/1636415191 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09b0031920 con 0x7f09b8078790 2024-09-12T01:59:08.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.996+0000 7f09b4c00640 1 -- 172.21.15.62:0/1636415191 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0036040 con 0x7f09b8078790 2024-09-12T01:59:08.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.996+0000 7f09bec00640 1 -- 172.21.15.62:0/1636415191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b81a6240 con 0x7f09b8078790 2024-09-12T01:59:08.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.996+0000 7f09bec00640 1 -- 172.21.15.62:0/1636415191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b81a66e0 con 0x7f09b8078790 2024-09-12T01:59:08.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:08.998+0000 7f09bec00640 1 -- 172.21.15.62:0/1636415191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09980052c0 con 0x7f09b8078790 2024-09-12T01:59:09.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.001+0000 7f09b4c00640 1 -- 172.21.15.62:0/1636415191 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7f09b0044020 con 0x7f09b8078790 2024-09-12T01:59:09.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.003+0000 7f09b4c00640 1 -- 172.21.15.62:0/1636415191 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9437+0+0 (secure 0 0 0) 0x7f09b00efd40 con 0x7f09b8078790 2024-09-12T01:59:09.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.008+0000 7f09b4c00640 1 -- 172.21.15.62:0/1636415191 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09b004b020 con 0x7f09b8078790 2024-09-12T01:59:09.093 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:08 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:08.744+0000 7f2bcfe10040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:59:09.429 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:09.169+0000 7f2b2d000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:59:09.429 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:09.169+0000 7f2b2d000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:59:09.429 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:09.169+0000 7f2b2d000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:59:09.429 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:09.169+0000 7f2b2d000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:59:09.429 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:09.169+0000 7f2b2d000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:59:09.429 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:09.170+0000 7f2b28a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:59:09.429 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:09.170+0000 7f2b28a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:59:09.429 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:09.170+0000 7f2b28a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:59:09.430 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:09.170+0000 7f2b28a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:59:09.430 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:09.170+0000 7f2b28a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:59:09.430 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2668245041' entity='client.admin' 2024-09-12T01:59:09.430 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' 2024-09-12T01:59:09.430 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: Active manager daemon x restarted 2024-09-12T01:59:09.430 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: Activating manager daemon x 2024-09-12T01:59:09.430 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T01:59:09.430 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: mgrmap e21: x(active, starting, since 0.0112236s), standbys: y, z 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:59:09.431 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:59:09.432 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:59:09.433 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:59:09.433 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:59:09.433 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:59:09.433 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:59:09.433 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:59:09.433 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:59:09.436 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:59:09.436 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: Manager daemon x is now available 2024-09-12T01:59:09.436 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:09.436 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:59:09.437 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:59:09.437 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:59:09.437 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:09 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:59:09.452 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2668245041' entity='client.admin' 2024-09-12T01:59:09.452 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: Active manager daemon x restarted 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: Activating manager daemon x 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: mgrmap e21: x(active, starting, since 0.0112236s), standbys: y, z 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:59:09.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:09.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:59:09.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:59:09.456 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:59:09.456 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: Manager daemon x is now available 2024-09-12T01:59:09.456 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:09.456 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:59:09.456 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:59:09.456 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:59:09.456 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:09 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:59:09.474 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2668245041' entity='client.admin' 2024-09-12T01:59:09.474 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' 2024-09-12T01:59:09.474 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: Active manager daemon x restarted 2024-09-12T01:59:09.474 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: Activating manager daemon x 2024-09-12T01:59:09.474 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T01:59:09.474 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: mgrmap e21: x(active, starting, since 0.0112236s), standbys: y, z 2024-09-12T01:59:09.474 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:59:09.474 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:59:09.474 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:59:09.475 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:59:09.476 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:59:09.476 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:59:09.476 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:59:09.476 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:59:09.476 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:59:09.476 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:59:09.476 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:59:09.476 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:59:09.476 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:59:09.476 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: Manager daemon x is now available 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:59:09.477 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:59:09.478 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:09 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:59:09.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.773+0000 7f09b4c00640 1 -- 172.21.15.62:0/1636415191 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f09b00b81e0 con 0x7f09b8078790 2024-09-12T01:59:09.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.774+0000 7f09b4c00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f099c0ab1a0 0x7f099c0ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:09.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.774+0000 7f09b4c00640 1 -- 172.21.15.62:0/1636415191 --> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f09b000b0b0 con 0x7f099c0ab1a0 2024-09-12T01:59:09.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.775+0000 7f09b7e00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f099c0ab1a0 0x7f099c0ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:09.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.779+0000 7f09b7e00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f099c0ab1a0 0x7f099c0ad590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f09a80058c0 tx=0x7f09a8005850 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:09.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.852+0000 7f09b4c00640 1 -- 172.21.15.62:0/1636415191 <== mgr.25070 v2:172.21.15.62:6800/2226410445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f09b000b0b0 con 0x7f099c0ab1a0 2024-09-12T01:59:09.853 INFO:teuthology.orchestra.run.smithi062.stdout:Schedule set for path / 2024-09-12T01:59:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 -- 172.21.15.62:0/1636415191 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f099c0ab1a0 msgr2=0x7f099c0ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f099c0ab1a0 0x7f099c0ad590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f09a80058c0 tx=0x7f09a8005850 comp rx=0 tx=0).stop 2024-09-12T01:59:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 -- 172.21.15.62:0/1636415191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09b8078790 msgr2=0x7f09b81a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:09.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09b8078790 0x7f09b81a5940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09b0034040 tx=0x7f09b00305b0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 -- 172.21.15.62:0/1636415191 shutdown_connections 2024-09-12T01:59:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f099c0ab1a0 0x7f099c0ad590 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09b8078790 0x7f09b81a5940 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09b8077df0 0x7f09b819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 --2- 172.21.15.62:0/1636415191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09b8076bb0 0x7f09b819e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:09.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 -- 172.21.15.62:0/1636415191 >> 172.21.15.62:0/1636415191 conn(0x7f09b80ff4e0 msgr2=0x7f09b8100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 -- 172.21.15.62:0/1636415191 shutdown_connections 2024-09-12T01:59:09.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:09.855+0000 7f09bec00640 1 -- 172.21.15.62:0/1636415191 wait complete. 2024-09-12T01:59:09.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-12T01:59:10.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.053+0000 7f0177e00640 1 -- 172.21.15.62:0/1339040622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0178101580 msgr2=0x7f0178101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.053+0000 7f0177e00640 1 --2- 172.21.15.62:0/1339040622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0178101580 0x7f0178101a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0164009900 tx=0x7f016402a410 comp rx=0 tx=0).stop 2024-09-12T01:59:10.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.053+0000 7f0177e00640 1 -- 172.21.15.62:0/1339040622 shutdown_connections 2024-09-12T01:59:10.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.053+0000 7f0177e00640 1 --2- 172.21.15.62:0/1339040622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0178101f40 0x7f0178109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.053+0000 7f0177e00640 1 --2- 172.21.15.62:0/1339040622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0178101580 0x7f0178101a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.053+0000 7f0177e00640 1 --2- 172.21.15.62:0/1339040622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0178103050 0x7f0178103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.053+0000 7f0177e00640 1 -- 172.21.15.62:0/1339040622 >> 172.21.15.62:0/1339040622 conn(0x7f01780fd0d0 msgr2=0x7f01780ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:10.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.053+0000 7f0177e00640 1 -- 172.21.15.62:0/1339040622 shutdown_connections 2024-09-12T01:59:10.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.053+0000 7f0177e00640 1 -- 172.21.15.62:0/1339040622 wait complete. 2024-09-12T01:59:10.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.054+0000 7f0177e00640 1 Processor -- start 2024-09-12T01:59:10.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.054+0000 7f0177e00640 1 -- start start 2024-09-12T01:59:10.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0177e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0178101580 0x7f0178075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0177e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0178101f40 0x7f01780745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0177e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0178103050 0x7f0178074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0177e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f017810d720 con 0x7f0178101f40 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0177e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f017810d5a0 con 0x7f0178101580 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0177e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f017810d8a0 con 0x7f0178103050 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0176a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0178101580 0x7f0178075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0176a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0178101580 0x7f0178075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:39882/0 (socket says 172.21.15.62:39882) 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0176a00640 1 -- 172.21.15.62:0/2373341239 learned_addr learned my addr 172.21.15.62:0/2373341239 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0176000640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0178101f40 0x7f01780745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0177400640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0178103050 0x7f0178074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0176a00640 1 -- 172.21.15.62:0/2373341239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0178103050 msgr2=0x7f0178074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0176a00640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0178103050 0x7f0178074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0176a00640 1 -- 172.21.15.62:0/2373341239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0178101f40 msgr2=0x7f01780745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0176a00640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0178101f40 0x7f01780745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.055+0000 7f0176a00640 1 -- 172.21.15.62:0/2373341239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01780753b0 con 0x7f0178101580 2024-09-12T01:59:10.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.056+0000 7f0176a00640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0178101580 0x7f0178075fa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f016800e9c0 tx=0x7f016800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:10.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.056+0000 7f016f400640 1 -- 172.21.15.62:0/2373341239 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016800ccc0 con 0x7f0178101580 2024-09-12T01:59:10.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.056+0000 7f016f400640 1 -- 172.21.15.62:0/2373341239 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01680035f0 con 0x7f0178101580 2024-09-12T01:59:10.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.056+0000 7f016f400640 1 -- 172.21.15.62:0/2373341239 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016800ce60 con 0x7f0178101580 2024-09-12T01:59:10.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.056+0000 7f0177e00640 1 -- 172.21.15.62:0/2373341239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01781a1ef0 con 0x7f0178101580 2024-09-12T01:59:10.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.056+0000 7f0177e00640 1 -- 172.21.15.62:0/2373341239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01781a22a0 con 0x7f0178101580 2024-09-12T01:59:10.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.057+0000 7f0177e00640 1 -- 172.21.15.62:0/2373341239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0178101a00 con 0x7f0178101580 2024-09-12T01:59:10.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.060+0000 7f016f400640 1 -- 172.21.15.62:0/2373341239 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f01680037a0 con 0x7f0178101580 2024-09-12T01:59:10.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.062+0000 7f016f400640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f015c0a29f0 0x7f015c0a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.062+0000 7f016f400640 1 -- 172.21.15.62:0/2373341239 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9437+0+0 (secure 0 0 0) 0x7f01680cf5f0 con 0x7f0178101580 2024-09-12T01:59:10.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.062+0000 7f0176000640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f015c0a29f0 0x7f015c0a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.063+0000 7f0176000640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f015c0a29f0 0x7f015c0a4eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0164006010 tx=0x7f0164000bc0 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:10.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.065+0000 7f016f400640 1 -- 172.21.15.62:0/2373341239 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f016809c390 con 0x7f0178101580 2024-09-12T01:59:10.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.316+0000 7f0177e00640 1 -- 172.21.15.62:0/2373341239 --> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f0178062830 con 0x7f015c0a29f0 2024-09-12T01:59:10.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.381+0000 7f016f400640 1 -- 172.21.15.62:0/2373341239 <== mgr.25070 v2:172.21.15.62:6800/2226410445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f0178062830 con 0x7f015c0a29f0 2024-09-12T01:59:10.381 INFO:teuthology.orchestra.run.smithi062.stdout:Retention added to path / 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 -- 172.21.15.62:0/2373341239 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f015c0a29f0 msgr2=0x7f015c0a4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f015c0a29f0 0x7f015c0a4eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0164006010 tx=0x7f0164000bc0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 -- 172.21.15.62:0/2373341239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0178101580 msgr2=0x7f0178075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0178101580 0x7f0178075fa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f016800e9c0 tx=0x7f016800edc0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 -- 172.21.15.62:0/2373341239 shutdown_connections 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f015c0a29f0 0x7f015c0a4eb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0178103050 0x7f0178074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0178101f40 0x7f01780745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 --2- 172.21.15.62:0/2373341239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0178101580 0x7f0178075fa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 -- 172.21.15.62:0/2373341239 >> 172.21.15.62:0/2373341239 conn(0x7f01780fd0d0 msgr2=0x7f0178105f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 -- 172.21.15.62:0/2373341239 shutdown_connections 2024-09-12T01:59:10.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.383+0000 7f0177e00640 1 -- 172.21.15.62:0/2373341239 wait complete. 2024-09-12T01:59:10.400 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T01:59:10.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.562+0000 7fa96fe00640 1 -- 172.21.15.62:0/3789921898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa968103d60 msgr2=0x7fa968104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.562+0000 7fa96fe00640 1 --2- 172.21.15.62:0/3789921898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa968103d60 0x7fa968104160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009900 tx=0x7fa95c02a410 comp rx=0 tx=0).stop 2024-09-12T01:59:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.562+0000 7fa96fe00640 1 -- 172.21.15.62:0/3789921898 shutdown_connections 2024-09-12T01:59:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.562+0000 7fa96fe00640 1 --2- 172.21.15.62:0/3789921898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa968105910 0x7fa96810c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.562+0000 7fa96fe00640 1 --2- 172.21.15.62:0/3789921898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa968104f50 0x7fa9681053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.562+0000 7fa96fe00640 1 --2- 172.21.15.62:0/3789921898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa968103d60 0x7fa968104160 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.562+0000 7fa96fe00640 1 -- 172.21.15.62:0/3789921898 >> 172.21.15.62:0/3789921898 conn(0x7fa9680ff4e0 msgr2=0x7fa968101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.562+0000 7fa96fe00640 1 -- 172.21.15.62:0/3789921898 shutdown_connections 2024-09-12T01:59:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.562+0000 7fa96fe00640 1 -- 172.21.15.62:0/3789921898 wait complete. 2024-09-12T01:59:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.563+0000 7fa96fe00640 1 Processor -- start 2024-09-12T01:59:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.563+0000 7fa96fe00640 1 -- start start 2024-09-12T01:59:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.563+0000 7fa96fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa968103d60 0x7fa968199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.563+0000 7fa96fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa968104f50 0x7fa96819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.563+0000 7fa96fe00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa968105910 0x7fa9681a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.563+0000 7fa96fe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa96810fa30 con 0x7fa968103d60 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.563+0000 7fa96fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa96810f8b0 con 0x7fa968104f50 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.563+0000 7fa96fe00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa96810fbb0 con 0x7fa968105910 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.563+0000 7fa96d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa968103d60 0x7fa968199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.563+0000 7fa96de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa968105910 0x7fa9681a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa96d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa968103d60 0x7fa968199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34510/0 (socket says 172.21.15.62:34510) 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa96d400640 1 -- 172.21.15.62:0/1214371706 learned_addr learned my addr 172.21.15.62:0/1214371706 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa96ca00640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa968104f50 0x7fa96819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa96de00640 1 -- 172.21.15.62:0/1214371706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa968104f50 msgr2=0x7fa96819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa96de00640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa968104f50 0x7fa96819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa96de00640 1 -- 172.21.15.62:0/1214371706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa968103d60 msgr2=0x7fa968199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa96de00640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa968103d60 0x7fa968199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa96de00640 1 -- 172.21.15.62:0/1214371706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9681a1bf0 con 0x7fa968105910 2024-09-12T01:59:10.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa96d400640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa968103d60 0x7fa968199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa96de00640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa968105910 0x7fa9681a1580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa960009fd0 tx=0x7fa96000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa966000640 1 -- 172.21.15.62:0/1214371706 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96000ce20 con 0x7fa968105910 2024-09-12T01:59:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.564+0000 7fa966000640 1 -- 172.21.15.62:0/1214371706 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa960005020 con 0x7fa968105910 2024-09-12T01:59:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.565+0000 7fa96fe00640 1 -- 172.21.15.62:0/1214371706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9681a1ee0 con 0x7fa968105910 2024-09-12T01:59:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.565+0000 7fa966000640 1 -- 172.21.15.62:0/1214371706 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960010720 con 0x7fa968105910 2024-09-12T01:59:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.565+0000 7fa96fe00640 1 -- 172.21.15.62:0/1214371706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9681a23f0 con 0x7fa968105910 2024-09-12T01:59:10.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.566+0000 7fa96fe00640 1 -- 172.21.15.62:0/1214371706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa96810b020 con 0x7fa968105910 2024-09-12T01:59:10.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.569+0000 7fa966000640 1 -- 172.21.15.62:0/1214371706 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7fa960005540 con 0x7fa968105910 2024-09-12T01:59:10.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.570+0000 7fa966000640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa9500a2ac0 0x7fa9500a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.570+0000 7fa966000640 1 -- 172.21.15.62:0/1214371706 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9437+0+0 (secure 0 0 0) 0x7fa9600cf610 con 0x7fa968105910 2024-09-12T01:59:10.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.570+0000 7fa96d400640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa9500a2ac0 0x7fa9500a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.571+0000 7fa96d400640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa9500a2ac0 0x7fa9500a4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa95c000c00 tx=0x7fa95c0315b0 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:10.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.574+0000 7fa966000640 1 -- 172.21.15.62:0/1214371706 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa96009c3b0 con 0x7fa968105910 2024-09-12T01:59:10.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.774+0000 7fa966000640 1 -- 172.21.15.62:0/1214371706 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 23) ==== 137953+0+0 (secure 0 0 0) 0x7fa960098320 con 0x7fa968105910 2024-09-12T01:59:10.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.793+0000 7fa96fe00640 1 -- 172.21.15.62:0/1214371706 --> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fa968062630 con 0x7fa9500a2ac0 2024-09-12T01:59:10.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.800+0000 7fa966000640 1 -- 172.21.15.62:0/1214371706 <== mgr.25070 v2:172.21.15.62:6800/2226410445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fa968062630 con 0x7fa9500a2ac0 2024-09-12T01:59:10.800 INFO:teuthology.orchestra.run.smithi062.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T01:59:09", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-12T01:59:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.802+0000 7fa96fe00640 1 -- 172.21.15.62:0/1214371706 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa9500a2ac0 msgr2=0x7fa9500a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.802+0000 7fa96fe00640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa9500a2ac0 0x7fa9500a4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa95c000c00 tx=0x7fa95c0315b0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.802+0000 7fa96fe00640 1 -- 172.21.15.62:0/1214371706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa968105910 msgr2=0x7fa9681a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.802+0000 7fa96fe00640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa968105910 0x7fa9681a1580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa960009fd0 tx=0x7fa96000ef10 comp rx=0 tx=0).stop 2024-09-12T01:59:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.802+0000 7fa96fe00640 1 -- 172.21.15.62:0/1214371706 shutdown_connections 2024-09-12T01:59:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.802+0000 7fa96fe00640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa9500a2ac0 0x7fa9500a4f80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.802+0000 7fa96fe00640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa968105910 0x7fa9681a1580 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.802+0000 7fa96fe00640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa968104f50 0x7fa96819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.802+0000 7fa96fe00640 1 --2- 172.21.15.62:0/1214371706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa968103d60 0x7fa968199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.803+0000 7fa96fe00640 1 -- 172.21.15.62:0/1214371706 >> 172.21.15.62:0/1214371706 conn(0x7fa9680ff4e0 msgr2=0x7fa9681081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:10.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.803+0000 7fa96fe00640 1 -- 172.21.15.62:0/1214371706 shutdown_connections 2024-09-12T01:59:10.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.803+0000 7fa96fe00640 1 -- 172.21.15.62:0/1214371706 wait complete. 2024-09-12T01:59:10.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T01:59:10.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:10 smithi077 ceph-mon[35095]: mgrmap e22: x(active, since 1.01924s), standbys: y, z 2024-09-12T01:59:10.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:10 smithi077 ceph-mon[35095]: from='client.25118 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:10.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:10 smithi077 ceph-mon[35095]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:59:10.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:10 smithi077 ceph-mon[35095]: from='client.25130 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:10.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.996+0000 7f666a400640 1 -- 172.21.15.62:0/4114737687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6664103710 msgr2=0x7f6664109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.996+0000 7f666a400640 1 --2- 172.21.15.62:0/4114737687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6664103710 0x7f6664109fa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f665c009be0 tx=0x7f665c02a6c0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.996+0000 7f666a400640 1 -- 172.21.15.62:0/4114737687 shutdown_connections 2024-09-12T01:59:10.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.996+0000 7f666a400640 1 --2- 172.21.15.62:0/4114737687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6664103710 0x7f6664109fa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.996+0000 7f666a400640 1 --2- 172.21.15.62:0/4114737687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6664102d50 0x7f66641031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.996+0000 7f666a400640 1 --2- 172.21.15.62:0/4114737687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6664101b60 0x7f6664101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.996+0000 7f666a400640 1 -- 172.21.15.62:0/4114737687 >> 172.21.15.62:0/4114737687 conn(0x7f66640fd2e0 msgr2=0x7f66640ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:10.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.996+0000 7f666a400640 1 -- 172.21.15.62:0/4114737687 shutdown_connections 2024-09-12T01:59:10.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.996+0000 7f666a400640 1 -- 172.21.15.62:0/4114737687 wait complete. 2024-09-12T01:59:10.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.997+0000 7f666a400640 1 Processor -- start 2024-09-12T01:59:10.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.997+0000 7f666a400640 1 -- start start 2024-09-12T01:59:10.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f666a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6664101b60 0x7f666419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f666a400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6664102d50 0x7f666419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f666a400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6664103710 0x7f66641a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:10.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f666a400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f666410d7c0 con 0x7f6664102d50 2024-09-12T01:59:10.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f666a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f666410d640 con 0x7f6664101b60 2024-09-12T01:59:10.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f666a400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f666410d940 con 0x7f6664103710 2024-09-12T01:59:10.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f6663400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6664101b60 0x7f666419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f6663400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6664101b60 0x7f666419a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:39960/0 (socket says 172.21.15.62:39960) 2024-09-12T01:59:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f6663400640 1 -- 172.21.15.62:0/3674901786 learned_addr learned my addr 172.21.15.62:0/3674901786 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T01:59:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f6663e00640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6664103710 0x7f66641a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f6662a00640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6664102d50 0x7f666419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f6663400640 1 -- 172.21.15.62:0/3674901786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6664103710 msgr2=0x7f66641a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f6663400640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6664103710 0x7f66641a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f6663400640 1 -- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6664102d50 msgr2=0x7f666419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.998+0000 7f6663400640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6664102d50 0x7f666419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.999+0000 7f6663400640 1 -- 172.21.15.62:0/3674901786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66641a1c20 con 0x7f6664101b60 2024-09-12T01:59:10.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.999+0000 7f6662a00640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6664102d50 0x7f666419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:11.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.999+0000 7f6663400640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6664101b60 0x7f666419a000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f665400e9c0 tx=0x7f665400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:11.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.999+0000 7f665be00640 1 -- 172.21.15.62:0/3674901786 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665400cd00 con 0x7f6664101b60 2024-09-12T01:59:11.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.999+0000 7f665be00640 1 -- 172.21.15.62:0/3674901786 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66540035f0 con 0x7f6664101b60 2024-09-12T01:59:11.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.999+0000 7f666a400640 1 -- 172.21.15.62:0/3674901786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66641a1f10 con 0x7f6664101b60 2024-09-12T01:59:11.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.999+0000 7f665be00640 1 -- 172.21.15.62:0/3674901786 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654010690 con 0x7f6664101b60 2024-09-12T01:59:11.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:10.999+0000 7f666a400640 1 -- 172.21.15.62:0/3674901786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66641a23d0 con 0x7f6664101b60 2024-09-12T01:59:11.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.001+0000 7f666a400640 1 -- 172.21.15.62:0/3674901786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66641a2690 con 0x7f6664101b60 2024-09-12T01:59:11.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.002+0000 7f665be00640 1 -- 172.21.15.62:0/3674901786 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 23) ==== 137953+0+0 (secure 0 0 0) 0x7f6654004020 con 0x7f6664101b60 2024-09-12T01:59:11.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.004+0000 7f665be00640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f66480a2e70 0x7f66480a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:11.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.004+0000 7f665be00640 1 -- 172.21.15.62:0/3674901786 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9437+0+0 (secure 0 0 0) 0x7f66540cfb90 con 0x7f6664101b60 2024-09-12T01:59:11.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.004+0000 7f6662a00640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f66480a2e70 0x7f66480a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:11.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.005+0000 7f6662a00640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f66480a2e70 0x7f66480a5330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f666419b510 tx=0x7f6650009260 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:11.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.007+0000 7f665be00640 1 -- 172.21.15.62:0/3674901786 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f665409c3c0 con 0x7f6664101b60 2024-09-12T01:59:11.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:10 smithi062 ceph-mon[30666]: mgrmap e22: x(active, since 1.01924s), standbys: y, z 2024-09-12T01:59:11.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:10 smithi062 ceph-mon[30666]: from='client.25118 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:11.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:10 smithi062 ceph-mon[30666]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:59:11.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:10 smithi062 ceph-mon[30666]: from='client.25130 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:11.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:10 smithi107 ceph-mon[35463]: mgrmap e22: x(active, since 1.01924s), standbys: y, z 2024-09-12T01:59:11.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:10 smithi107 ceph-mon[35463]: from='client.25118 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:11.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:10 smithi107 ceph-mon[35463]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:59:11.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:10 smithi107 ceph-mon[35463]: from='client.25130 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:11.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.245+0000 7f666a400640 1 -- 172.21.15.62:0/3674901786 --> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f66641a2860 con 0x7f66480a2e70 2024-09-12T01:59:11.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.253+0000 7f665be00640 1 -- 172.21.15.62:0/3674901786 <== mgr.25070 v2:172.21.15.62:6800/2226410445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f66641a2860 con 0x7f66480a2e70 2024-09-12T01:59:11.253 INFO:teuthology.orchestra.run.smithi062.stdout:/ 1m 6m3h 2024-09-12T01:59:11.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 -- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f66480a2e70 msgr2=0x7f66480a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f66480a2e70 0x7f66480a5330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f666419b510 tx=0x7f6650009260 comp rx=0 tx=0).stop 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 -- 172.21.15.62:0/3674901786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6664101b60 msgr2=0x7f666419a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6664101b60 0x7f666419a000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f665400e9c0 tx=0x7f665400ee80 comp rx=0 tx=0).stop 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 -- 172.21.15.62:0/3674901786 shutdown_connections 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f66480a2e70 0x7f66480a5330 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6664103710 0x7f66641a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6664102d50 0x7f666419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 --2- 172.21.15.62:0/3674901786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6664101b60 0x7f666419a000 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 -- 172.21.15.62:0/3674901786 >> 172.21.15.62:0/3674901786 conn(0x7f66640fd2e0 msgr2=0x7f6664074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 -- 172.21.15.62:0/3674901786 shutdown_connections 2024-09-12T01:59:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:59:11.256+0000 7f666a400640 1 -- 172.21.15.62:0/3674901786 wait complete. 2024-09-12T01:59:11.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-12T01:59:11.343 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-12T01:59:11.353 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:59:11.366 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:59:11.367 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:59:11.367 INFO:tasks.workunit:timeout=3h 2024-09-12T01:59:11.367 INFO:tasks.workunit:cleanup=True 2024-09-12T01:59:11.367 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:59:11.404 INFO:teuthology.orchestra.run.smithi062.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T01:59:11.405 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T01:59:11.405 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6ch/108d Inode: 1099511628283 Links: 2 2024-09-12T01:59:11.405 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:59:11.405 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T01:59:11.405 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 01:57:33.635676281 +0000 2024-09-12T01:59:11.405 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 01:57:33.635676281 +0000 2024-09-12T01:59:11.405 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 01:59:07.049108375 +0000 2024-09-12T01:59:11.405 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 01:57:33.635676281 +0000 2024-09-12T01:59:11.405 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:59:11.405 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T01:59:11.514 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:59:11.554 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:59:11.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:11.334+0000 7f2b04600640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:59:11] ENGINE Error in HTTPServer.serve 2024-09-12T01:59:11.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: Traceback (most recent call last): 2024-09-12T01:59:11.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:59:11.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self._connections.run(self.expiration_interval) 2024-09-12T01:59:11.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:59:11.592 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self._run(expiration_interval) 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: s = self.context.wrap_socket( 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: return self.sslsocket_class._create( 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self.do_handshake() 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: self._sslobj.do_handshake() 2024-09-12T01:59:11.593 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:59:11.594 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: [12/Sep/2024:01:59:11] ENGINE Bus STARTING 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: [12/Sep/2024:01:59:11] ENGINE Serving on http://172.21.15.62:8765 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:12.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: [12/Sep/2024:01:59:11] ENGINE Serving on https://172.21.15.62:7150 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: [12/Sep/2024:01:59:11] ENGINE Bus STARTED 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: [12/Sep/2024:01:59:11] ENGINE Error in HTTPServer.serve 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout: Traceback (most recent call last): 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout: self._run(expiration_interval) 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:59:12.094 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout: s = self.context.wrap_socket( 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout: return self.sslsocket_class._create( 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout: self.do_handshake() 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout: self._sslobj.do_handshake() 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.095 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.097 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.097 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.097 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.097 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:11 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-12T01:59:12.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: [12/Sep/2024:01:59:11] ENGINE Bus STARTING 2024-09-12T01:59:12.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: [12/Sep/2024:01:59:11] ENGINE Serving on http://172.21.15.62:8765 2024-09-12T01:59:12.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:12.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: [12/Sep/2024:01:59:11] ENGINE Serving on https://172.21.15.62:7150 2024-09-12T01:59:12.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: [12/Sep/2024:01:59:11] ENGINE Bus STARTED 2024-09-12T01:59:12.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: [12/Sep/2024:01:59:11] ENGINE Error in HTTPServer.serve 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: Traceback (most recent call last): 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: self._run(expiration_interval) 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: s = self.context.wrap_socket( 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:59:12.205 INFO:journalctl@ceph.mon.c.smithi107.stdout: return self.sslsocket_class._create( 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout: self.do_handshake() 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout: self._sslobj.do_handshake() 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.207 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:11 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-12T01:59:12.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: [12/Sep/2024:01:59:11] ENGINE Bus STARTING 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: [12/Sep/2024:01:59:11] ENGINE Serving on http://172.21.15.62:8765 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='client.25148 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: [12/Sep/2024:01:59:11] ENGINE Serving on https://172.21.15.62:7150 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: [12/Sep/2024:01:59:11] ENGINE Bus STARTED 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: [12/Sep/2024:01:59:11] ENGINE Error in HTTPServer.serve 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout: Traceback (most recent call last): 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:59:12.215 INFO:journalctl@ceph.mon.b.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: self._run(expiration_interval) 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: s = self.context.wrap_socket( 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: return self.sslsocket_class._create( 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: self.do_handshake() 2024-09-12T01:59:12.216 INFO:journalctl@ceph.mon.b.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout: self._sslobj.do_handshake() 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.217 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:12.218 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:11 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:13.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:12 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi107 to 175.9M 2024-09-12T01:59:13.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:12 smithi062 ceph-mon[30666]: Unable to set osd_memory_target on smithi107 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-09-12T01:59:13.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:12 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi077 to 176.0M 2024-09-12T01:59:13.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:12 smithi062 ceph-mon[30666]: Unable to set osd_memory_target on smithi077 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-12T01:59:13.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:12 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi107 to 175.9M 2024-09-12T01:59:13.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:12 smithi107 ceph-mon[35463]: Unable to set osd_memory_target on smithi107 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-09-12T01:59:13.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:12 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi077 to 176.0M 2024-09-12T01:59:13.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:12 smithi107 ceph-mon[35463]: Unable to set osd_memory_target on smithi077 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-12T01:59:13.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:12 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi107 to 175.9M 2024-09-12T01:59:13.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:12 smithi077 ceph-mon[35095]: Unable to set osd_memory_target on smithi107 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-09-12T01:59:13.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:12 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi077 to 176.0M 2024-09-12T01:59:13.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:12 smithi077 ceph-mon[35095]: Unable to set osd_memory_target on smithi077 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-12T01:59:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:59:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-12T01:59:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi062 to 176.4M 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: Unable to set osd_memory_target on smithi062 to 185045504: error parsing value: Value '185045504' is below minimum 939524096 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:14.093 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:14.094 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:14.094 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:13 smithi062 ceph-mon[30666]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:14.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi062 to 176.4M 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: Unable to set osd_memory_target on smithi062 to 185045504: error parsing value: Value '185045504' is below minimum 939524096 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:14.205 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:13 smithi107 ceph-mon[35463]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:14.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:59:14.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-12T01:59:14.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi062 to 176.4M 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: Unable to set osd_memory_target on smithi062 to 185045504: error parsing value: Value '185045504' is below minimum 939524096 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:14.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:14.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: Updating smithi062:/etc/ceph/ceph.conf 2024-09-12T01:59:14.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-12T01:59:14.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: Updating smithi107:/etc/ceph/ceph.conf 2024-09-12T01:59:14.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:14.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:14.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:14.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:14.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:13 smithi077 ceph-mon[35095]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:59:15.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:14 smithi062 ceph-mon[30666]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:59:15.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:14 smithi062 ceph-mon[30666]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:59:15.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:14 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:14 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:14 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:14 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:14 smithi062 ceph-mon[30666]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:15.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:14 smithi062 ceph-mon[30666]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:59:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:14 smithi107 ceph-mon[35463]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:59:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:14 smithi107 ceph-mon[35463]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:59:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:14 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:14 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:14 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:14 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:14 smithi107 ceph-mon[35463]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:15.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:14 smithi107 ceph-mon[35463]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:59:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:14 smithi077 ceph-mon[35095]: Updating smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:59:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:14 smithi077 ceph-mon[35095]: Updating smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:59:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:14 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:14 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:14 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:14 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:15.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:14 smithi077 ceph-mon[35095]: Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:59:15.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:14 smithi077 ceph-mon[35095]: Updating smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:59:16.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:15 smithi107 ceph-mon[35463]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:59:16.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:15 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:15 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:15 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:15 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:16.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:15 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:15 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:15 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:16.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:15 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:16.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:15 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:15 smithi077 ceph-mon[35095]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:59:16.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:15 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:15 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:15 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:15 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:16.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:15 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:15 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:15 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:16.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:15 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:16.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:15 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:15 smithi062 ceph-mon[30666]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:59:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:15 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:15 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:15 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:15 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:15 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:15 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:15 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:15 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:15 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T01:59:18.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:17 smithi107 ceph-mon[35463]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-09-12T01:59:18.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:17 smithi077 ceph-mon[35095]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-09-12T01:59:18.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:17 smithi062 ceph-mon[30666]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-09-12T01:59:20.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:19 smithi107 ceph-mon[35463]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 103 KiB/s wr, 57 op/s 2024-09-12T01:59:20.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:19 smithi077 ceph-mon[35095]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 103 KiB/s wr, 57 op/s 2024-09-12T01:59:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:19 smithi062 ceph-mon[30666]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 103 KiB/s wr, 57 op/s 2024-09-12T01:59:22.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:21 smithi107 ceph-mon[35463]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-09-12T01:59:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:21 smithi077 ceph-mon[35095]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-09-12T01:59:22.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:21 smithi062 ceph-mon[30666]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-09-12T01:59:24.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:23 smithi107 ceph-mon[35463]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-12T01:59:24.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:23 smithi077 ceph-mon[35095]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-12T01:59:24.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:23 smithi062 ceph-mon[30666]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-12T01:59:26.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:25 smithi107 ceph-mon[35463]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-12T01:59:26.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:25 smithi077 ceph-mon[35095]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-12T01:59:26.344 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:25 smithi062 ceph-mon[30666]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-12T01:59:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:27 smithi107 ceph-mon[35463]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-12T01:59:28.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:27 smithi077 ceph-mon[35095]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-12T01:59:28.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:27 smithi062 ceph-mon[30666]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-12T01:59:30.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:29 smithi077 ceph-mon[35095]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:30.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:29 smithi062 ceph-mon[30666]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:29 smithi107 ceph-mon[35463]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:32.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:31 smithi077 ceph-mon[35095]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:59:32.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:31 smithi062 ceph-mon[30666]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:59:32.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:31 smithi107 ceph-mon[35463]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:59:34.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:33 smithi077 ceph-mon[35095]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:34.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:33 smithi062 ceph-mon[30666]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:34.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:33 smithi107 ceph-mon[35463]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:36.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:35 smithi062 ceph-mon[30666]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:36.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:35 smithi107 ceph-mon[35463]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:36.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:35 smithi077 ceph-mon[35095]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:38.256 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:37 smithi107 ceph-mon[35463]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:59:38.266 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:37 smithi077 ceph-mon[35095]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:59:38.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:37 smithi062 ceph-mon[30666]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:59:40.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:39 smithi062 ceph-mon[30666]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:40.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:39 smithi107 ceph-mon[35463]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:40.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:39 smithi077 ceph-mon[35095]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:42.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:41 smithi062 ceph-mon[30666]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:59:42.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:41 smithi107 ceph-mon[35463]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:59:42.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:41 smithi077 ceph-mon[35095]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T01:59:44.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:43 smithi062 ceph-mon[30666]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:43 smithi107 ceph-mon[35463]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:43 smithi077 ceph-mon[35095]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:46.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:45 smithi062 ceph-mon[30666]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:46.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:45 smithi107 ceph-mon[35463]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:46.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:45 smithi077 ceph-mon[35095]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T01:59:48.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:47 smithi062 ceph-mon[30666]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-12T01:59:48.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:47 smithi107 ceph-mon[35463]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-12T01:59:48.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:47 smithi077 ceph-mon[35095]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-12T01:59:50.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:49 smithi062 ceph-mon[30666]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-12T01:59:50.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:49 smithi107 ceph-mon[35463]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-12T01:59:50.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:49 smithi077 ceph-mon[35095]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-12T01:59:52.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:51 smithi062 ceph-mon[30666]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:52.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:51 smithi107 ceph-mon[35463]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:52.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:51 smithi077 ceph-mon[35095]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:54.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:53 smithi062 ceph-mon[30666]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:54.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:53 smithi107 ceph-mon[35463]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:54.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:53 smithi077 ceph-mon[35095]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:55 smithi062 ceph-mon[30666]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:56.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:55 smithi107 ceph-mon[35463]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:56.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:55 smithi077 ceph-mon[35095]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:58.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 01:59:58 smithi062 ceph-mon[30666]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 01:59:58 smithi107 ceph-mon[35463]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T01:59:58.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 01:59:58 smithi077 ceph-mon[35095]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-12T02:00:00.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:00 smithi062 ceph-mon[30666]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:00:00.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:00 smithi062 ceph-mon[30666]: overall HEALTH_OK 2024-09-12T02:00:00.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:00 smithi107 ceph-mon[35463]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:00:00.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:00 smithi107 ceph-mon[35463]: overall HEALTH_OK 2024-09-12T02:00:00.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:00 smithi077 ceph-mon[35095]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:00:00.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:00 smithi077 ceph-mon[35095]: overall HEALTH_OK 2024-09-12T02:00:00.842 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:00:00 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T02:00:00.394+0000 7f2b10400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:00:00.842 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:00:00 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T02:00:00.394+0000 7f2b10400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:00:00.842 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:00:00 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T02:00:00.394+0000 7f2b10400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:00:00.842 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:00:00 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T02:00:00.394+0000 7f2b10400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:00:00.842 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:00:00 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T02:00:00.394+0000 7f2b10400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:00:02.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:02 smithi062 ceph-mon[30666]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:00:02.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:02 smithi062 ceph-mon[30666]: mgrmap e25: x(active, since 52s), standbys: y, z 2024-09-12T02:00:02.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:02 smithi107 ceph-mon[35463]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:00:02.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:02 smithi107 ceph-mon[35463]: mgrmap e25: x(active, since 52s), standbys: y, z 2024-09-12T02:00:02.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:02 smithi077 ceph-mon[35095]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:00:02.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:02 smithi077 ceph-mon[35095]: mgrmap e25: x(active, since 52s), standbys: y, z 2024-09-12T02:00:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:04 smithi062 ceph-mon[30666]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:00:04.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:04 smithi107 ceph-mon[35463]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:00:04.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:04 smithi077 ceph-mon[35095]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:00:06.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:06 smithi062 ceph-mon[30666]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:00:06.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:06 smithi107 ceph-mon[35463]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:00:06.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:06 smithi077 ceph-mon[35095]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:00:08.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:08 smithi062 ceph-mon[30666]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:00:08.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:08 smithi107 ceph-mon[35463]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:00:08.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:08 smithi077 ceph-mon[35095]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:00:10.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:10 smithi062 ceph-mon[30666]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:00:10.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:10 smithi107 ceph-mon[35463]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:00:10.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:10 smithi077 ceph-mon[35095]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:00:12.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:12 smithi062 ceph-mon[30666]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:00:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:12 smithi107 ceph-mon[35463]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:00:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:12 smithi077 ceph-mon[35095]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:00:14.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:14 smithi062 ceph-mon[30666]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:00:14.344 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:14 smithi077 ceph-mon[35095]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:00:14.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:14 smithi107 ceph-mon[35463]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:00:16.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:16 smithi062 ceph-mon[30666]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:00:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:16 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:16 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:16 smithi107 ceph-mon[35463]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:00:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:16 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:16 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:16 smithi077 ceph-mon[35095]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:00:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:16 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:16 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:17 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:17 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:17 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:17 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:17.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:17 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:17.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:17 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.423 INFO:tasks.workunit.client.0.smithi062.stderr:Updating files: 60% (7754/12903) Updating files: 61% (7871/12903) Updating files: 62% (8000/12903) Updating files: 63% (8129/12903) Updating files: 64% (8258/12903) Updating files: 65% (8387/12903) Updating files: 66% (8516/12903) Updating files: 67% (8646/12903) Updating files: 68% (8775/12903) Updating files: 69% (8904/12903) Updating files: 70% (9033/12903) Updating files: 71% (9162/12903) Updating files: 72% (9291/12903) Updating files: 73% (9420/12903) Updating files: 74% (9549/12903) Updating files: 75% (9678/12903) Updating files: 76% (9807/12903) Updating files: 77% (9936/12903) Updating files: 78% (10065/12903) Updating files: 79% (10194/12903) Updating files: 80% (10323/12903) Updating files: 81% (10452/12903) Updating files: 82% (10581/12903) Updating files: 83% (10710/12903) Updating files: 84% (10839/12903) Updating files: 85% (10968/12903) Updating files: 86% (11097/12903) Updating files: 87% (11226/12903) Updating files: 88% (11355/12903) Updating files: 89% (11484/12903) Updating files: 90% (11613/12903) Updating files: 91% (11742/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 94% (12209/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T02:00:17.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:17 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:17 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:17 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:17 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:17.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:17 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:17.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:17 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:17 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:17 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:17 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:17.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:17 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:17.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:17 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:17.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:17 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:00:18.356 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:00:18.356 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T02:00:18.356 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:00:18.357 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T02:00:18.358 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:00:18.369 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:00:18.457 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:00:18.461 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:00:18.461 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:00:18.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:18 smithi062 ceph-mon[30666]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:00:18.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:18 smithi107 ceph-mon[35463]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:00:18.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:18 smithi077 ceph-mon[35095]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:00:19.154 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:00:19.245 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:00:19.311 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:00:19.314 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:00:19.315 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:00:19.380 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:00:19.387 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:00:19.387 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:00:19.422 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-12T02:00:19.424 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-12T02:00:19.424 DEBUG:teuthology.orchestra.run.smithi062:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-12T02:00:19.511 INFO:tasks.workunit.client.0.smithi062.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-12T02:00:19.563 INFO:tasks.workunit.client.0.smithi062.stderr:--2024-09-12 02:00:19-- http://download.ceph.com/qa/fsync-tester.c 2024-09-12T02:00:19.564 INFO:tasks.workunit.client.0.smithi062.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-12T02:00:19.585 INFO:tasks.workunit.client.0.smithi062.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-12T02:00:19.606 INFO:tasks.workunit.client.0.smithi062.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T02:00:19.606 INFO:tasks.workunit.client.0.smithi062.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-12T02:00:19.608 INFO:tasks.workunit.client.0.smithi062.stderr:Saving to: ‘fsync-tester.c’ 2024-09-12T02:00:19.613 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T02:00:19.613 INFO:tasks.workunit.client.0.smithi062.stderr: 0K .. 100% 230M=0s 2024-09-12T02:00:19.613 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T02:00:19.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12 02:00:19 (230 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-12T02:00:19.613 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T02:00:19.614 INFO:tasks.workunit.client.0.smithi062.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-12T02:00:19.711 INFO:tasks.workunit.client.0.smithi062.stderr:+ ./fsync-tester 2024-09-12T02:00:20.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:20 smithi062 ceph-mon[30666]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:00:20.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:20 smithi107 ceph-mon[35463]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:00:20.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:20 smithi077 ceph-mon[35095]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:00:22.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:22 smithi062 ceph-mon[30666]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-09-12T02:00:22.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:22 smithi107 ceph-mon[35463]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-09-12T02:00:22.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:22 smithi077 ceph-mon[35095]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-09-12T02:00:24.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:24 smithi062 ceph-mon[30666]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-12T02:00:24.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:24 smithi107 ceph-mon[35463]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-12T02:00:24.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:24 smithi077 ceph-mon[35095]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-12T02:00:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:26 smithi062 ceph-mon[30666]: pgmap v41: 129 pgs: 129 active+clean; 2.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 435 KiB/s wr, 5 op/s 2024-09-12T02:00:26.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:26 smithi107 ceph-mon[35463]: pgmap v41: 129 pgs: 129 active+clean; 2.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 435 KiB/s wr, 5 op/s 2024-09-12T02:00:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:26 smithi077 ceph-mon[35095]: pgmap v41: 129 pgs: 129 active+clean; 2.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 435 KiB/s wr, 5 op/s 2024-09-12T02:00:28.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:27 smithi062 ceph-mon[30666]: pgmap v42: 129 pgs: 129 active+clean; 2.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 435 KiB/s wr, 4 op/s 2024-09-12T02:00:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:27 smithi107 ceph-mon[35463]: pgmap v42: 129 pgs: 129 active+clean; 2.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 435 KiB/s wr, 4 op/s 2024-09-12T02:00:28.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:27 smithi077 ceph-mon[35095]: pgmap v42: 129 pgs: 129 active+clean; 2.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 435 KiB/s wr, 4 op/s 2024-09-12T02:00:30.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:29 smithi107 ceph-mon[35463]: pgmap v43: 129 pgs: 129 active+clean; 2.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 435 KiB/s wr, 4 op/s 2024-09-12T02:00:30.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:29 smithi077 ceph-mon[35095]: pgmap v43: 129 pgs: 129 active+clean; 2.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 435 KiB/s wr, 4 op/s 2024-09-12T02:00:30.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:29 smithi062 ceph-mon[30666]: pgmap v43: 129 pgs: 129 active+clean; 2.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 435 KiB/s wr, 4 op/s 2024-09-12T02:00:32.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:31 smithi107 ceph-mon[35463]: pgmap v44: 129 pgs: 129 active+clean; 38 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.8 MiB/s wr, 7 op/s 2024-09-12T02:00:32.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:31 smithi077 ceph-mon[35095]: pgmap v44: 129 pgs: 129 active+clean; 38 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.8 MiB/s wr, 7 op/s 2024-09-12T02:00:32.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:31 smithi062 ceph-mon[30666]: pgmap v44: 129 pgs: 129 active+clean; 38 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.8 MiB/s wr, 7 op/s 2024-09-12T02:00:34.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:33 smithi107 ceph-mon[35463]: pgmap v45: 129 pgs: 129 active+clean; 38 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.8 MiB/s wr, 6 op/s 2024-09-12T02:00:34.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:33 smithi077 ceph-mon[35095]: pgmap v45: 129 pgs: 129 active+clean; 38 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.8 MiB/s wr, 6 op/s 2024-09-12T02:00:34.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:33 smithi062 ceph-mon[30666]: pgmap v45: 129 pgs: 129 active+clean; 38 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.8 MiB/s wr, 6 op/s 2024-09-12T02:00:36.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:35 smithi107 ceph-mon[35463]: pgmap v46: 129 pgs: 129 active+clean; 55 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.6 MiB/s wr, 8 op/s 2024-09-12T02:00:36.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:35 smithi077 ceph-mon[35095]: pgmap v46: 129 pgs: 129 active+clean; 55 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.6 MiB/s wr, 8 op/s 2024-09-12T02:00:36.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:35 smithi062 ceph-mon[30666]: pgmap v46: 129 pgs: 129 active+clean; 55 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.6 MiB/s wr, 8 op/s 2024-09-12T02:00:38.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:37 smithi107 ceph-mon[35463]: pgmap v47: 129 pgs: 129 active+clean; 55 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 MiB/s wr, 5 op/s 2024-09-12T02:00:38.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:37 smithi077 ceph-mon[35095]: pgmap v47: 129 pgs: 129 active+clean; 55 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 MiB/s wr, 5 op/s 2024-09-12T02:00:38.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:37 smithi062 ceph-mon[30666]: pgmap v47: 129 pgs: 129 active+clean; 55 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 MiB/s wr, 5 op/s 2024-09-12T02:00:40.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:39 smithi107 ceph-mon[35463]: pgmap v48: 129 pgs: 129 active+clean; 55 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 MiB/s wr, 5 op/s 2024-09-12T02:00:40.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:39 smithi077 ceph-mon[35095]: pgmap v48: 129 pgs: 129 active+clean; 55 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 MiB/s wr, 5 op/s 2024-09-12T02:00:40.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:39 smithi062 ceph-mon[30666]: pgmap v48: 129 pgs: 129 active+clean; 55 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 MiB/s wr, 5 op/s 2024-09-12T02:00:42.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:41 smithi107 ceph-mon[35463]: pgmap v49: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 8 op/s 2024-09-12T02:00:42.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:41 smithi107 ceph-mon[35463]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-12T02:00:42.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:41 smithi077 ceph-mon[35095]: pgmap v49: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 8 op/s 2024-09-12T02:00:42.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:41 smithi077 ceph-mon[35095]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-12T02:00:42.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:41 smithi062 ceph-mon[30666]: pgmap v49: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 8 op/s 2024-09-12T02:00:42.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:41 smithi062 ceph-mon[30666]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-12T02:00:44.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:43 smithi107 ceph-mon[35463]: pgmap v50: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-09-12T02:00:44.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:43 smithi077 ceph-mon[35095]: pgmap v50: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-09-12T02:00:44.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:43 smithi062 ceph-mon[30666]: pgmap v50: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.2 MiB/s wr, 5 op/s 2024-09-12T02:00:46.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:45 smithi107 ceph-mon[35463]: pgmap v51: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 7 op/s 2024-09-12T02:00:46.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:45 smithi077 ceph-mon[35095]: pgmap v51: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 7 op/s 2024-09-12T02:00:46.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:45 smithi062 ceph-mon[30666]: pgmap v51: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 7 op/s 2024-09-12T02:00:48.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:47 smithi107 ceph-mon[35463]: pgmap v52: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 862 KiB/s wr, 4 op/s 2024-09-12T02:00:48.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:47 smithi077 ceph-mon[35095]: pgmap v52: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 862 KiB/s wr, 4 op/s 2024-09-12T02:00:48.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:47 smithi062 ceph-mon[30666]: pgmap v52: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 862 KiB/s wr, 4 op/s 2024-09-12T02:00:50.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:49 smithi107 ceph-mon[35463]: pgmap v53: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 862 KiB/s wr, 4 op/s 2024-09-12T02:00:50.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:49 smithi077 ceph-mon[35095]: pgmap v53: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 862 KiB/s wr, 4 op/s 2024-09-12T02:00:50.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:49 smithi062 ceph-mon[30666]: pgmap v53: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 862 KiB/s wr, 4 op/s 2024-09-12T02:00:52.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:51 smithi107 ceph-mon[35463]: pgmap v54: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-09-12T02:00:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:51 smithi077 ceph-mon[35095]: pgmap v54: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-09-12T02:00:52.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:51 smithi062 ceph-mon[30666]: pgmap v54: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 7 op/s 2024-09-12T02:00:54.144 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:53 smithi062 ceph-mon[30666]: pgmap v55: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 862 KiB/s wr, 4 op/s 2024-09-12T02:00:54.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:53 smithi107 ceph-mon[35463]: pgmap v55: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 862 KiB/s wr, 4 op/s 2024-09-12T02:00:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:53 smithi077 ceph-mon[35095]: pgmap v55: 129 pgs: 129 active+clean; 55 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 862 KiB/s wr, 4 op/s 2024-09-12T02:00:56.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:55 smithi107 ceph-mon[35463]: pgmap v56: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 15 op/s 2024-09-12T02:00:56.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:55 smithi077 ceph-mon[35095]: pgmap v56: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 15 op/s 2024-09-12T02:00:56.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:55 smithi062 ceph-mon[30666]: pgmap v56: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 15 op/s 2024-09-12T02:00:58.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:57 smithi107 ceph-mon[35463]: pgmap v57: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 12 op/s 2024-09-12T02:00:58.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:57 smithi077 ceph-mon[35095]: pgmap v57: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 12 op/s 2024-09-12T02:00:58.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:57 smithi062 ceph-mon[30666]: pgmap v57: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 12 op/s 2024-09-12T02:01:00.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:00:59 smithi107 ceph-mon[35463]: pgmap v58: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 12 op/s 2024-09-12T02:01:00.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:00:59 smithi077 ceph-mon[35095]: pgmap v58: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 12 op/s 2024-09-12T02:01:00.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:00:59 smithi062 ceph-mon[30666]: pgmap v58: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 12 op/s 2024-09-12T02:01:02.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:01 smithi107 ceph-mon[35463]: pgmap v59: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 15 op/s 2024-09-12T02:01:02.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:01 smithi077 ceph-mon[35095]: pgmap v59: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 15 op/s 2024-09-12T02:01:02.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:01 smithi062 ceph-mon[30666]: pgmap v59: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 15 op/s 2024-09-12T02:01:04.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:03 smithi107 ceph-mon[35463]: pgmap v60: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 MiB/s wr, 12 op/s 2024-09-12T02:01:04.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:03 smithi077 ceph-mon[35095]: pgmap v60: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 MiB/s wr, 12 op/s 2024-09-12T02:01:04.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:03 smithi062 ceph-mon[30666]: pgmap v60: 129 pgs: 129 active+clean; 259 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 MiB/s wr, 12 op/s 2024-09-12T02:01:06.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:05 smithi107 ceph-mon[35463]: pgmap v61: 129 pgs: 129 active+clean; 260 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 178 op/s 2024-09-12T02:01:06.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:05 smithi077 ceph-mon[35095]: pgmap v61: 129 pgs: 129 active+clean; 260 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 178 op/s 2024-09-12T02:01:06.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:05 smithi062 ceph-mon[30666]: pgmap v61: 129 pgs: 129 active+clean; 260 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 178 op/s 2024-09-12T02:01:08.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:07 smithi107 ceph-mon[35463]: pgmap v62: 129 pgs: 129 active+clean; 260 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-09-12T02:01:08.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:07 smithi077 ceph-mon[35095]: pgmap v62: 129 pgs: 129 active+clean; 260 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-09-12T02:01:08.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:07 smithi062 ceph-mon[30666]: pgmap v62: 129 pgs: 129 active+clean; 260 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-09-12T02:01:10.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:09 smithi107 ceph-mon[35463]: pgmap v63: 129 pgs: 129 active+clean; 260 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-09-12T02:01:10.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:09 smithi077 ceph-mon[35095]: pgmap v63: 129 pgs: 129 active+clean; 260 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-09-12T02:01:10.343 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:09 smithi062 ceph-mon[30666]: pgmap v63: 129 pgs: 129 active+clean; 260 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-09-12T02:01:12.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:11 smithi107 ceph-mon[35463]: pgmap v64: 129 pgs: 129 active+clean; 260 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.5 MiB/s wr, 342 op/s 2024-09-12T02:01:12.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:11 smithi077 ceph-mon[35095]: pgmap v64: 129 pgs: 129 active+clean; 260 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.5 MiB/s wr, 342 op/s 2024-09-12T02:01:12.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:11 smithi062 ceph-mon[30666]: pgmap v64: 129 pgs: 129 active+clean; 260 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.5 MiB/s wr, 342 op/s 2024-09-12T02:01:14.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:13 smithi107 ceph-mon[35463]: pgmap v65: 129 pgs: 129 active+clean; 260 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 340 op/s 2024-09-12T02:01:14.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:13 smithi077 ceph-mon[35095]: pgmap v65: 129 pgs: 129 active+clean; 260 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 340 op/s 2024-09-12T02:01:14.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:13 smithi062 ceph-mon[30666]: pgmap v65: 129 pgs: 129 active+clean; 260 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 340 op/s 2024-09-12T02:01:16.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:15 smithi107 ceph-mon[35463]: pgmap v66: 129 pgs: 129 active+clean; 260 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.1 MiB/s wr, 511 op/s 2024-09-12T02:01:16.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:15 smithi077 ceph-mon[35095]: pgmap v66: 129 pgs: 129 active+clean; 260 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.1 MiB/s wr, 511 op/s 2024-09-12T02:01:16.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:15 smithi062 ceph-mon[30666]: pgmap v66: 129 pgs: 129 active+clean; 260 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.1 MiB/s wr, 511 op/s 2024-09-12T02:01:17.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:16 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:17.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:16 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:17.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:16 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:18.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:17 smithi107 ceph-mon[35463]: pgmap v67: 129 pgs: 129 active+clean; 260 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 345 op/s 2024-09-12T02:01:18.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:17 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:18.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:17 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:18.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:17 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:01:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:17 smithi077 ceph-mon[35095]: pgmap v67: 129 pgs: 129 active+clean; 260 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 345 op/s 2024-09-12T02:01:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:17 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:17 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:17 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:01:18.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:17 smithi062 ceph-mon[30666]: pgmap v67: 129 pgs: 129 active+clean; 260 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 345 op/s 2024-09-12T02:01:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:17 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:17 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:17 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:01:20.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:19 smithi107 ceph-mon[35463]: pgmap v68: 129 pgs: 129 active+clean; 260 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 345 op/s 2024-09-12T02:01:20.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:19 smithi077 ceph-mon[35095]: pgmap v68: 129 pgs: 129 active+clean; 260 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 345 op/s 2024-09-12T02:01:20.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:19 smithi062 ceph-mon[30666]: pgmap v68: 129 pgs: 129 active+clean; 260 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 345 op/s 2024-09-12T02:01:20.913 INFO:tasks.workunit.client.0.smithi062.stdout:setting up random write file 2024-09-12T02:01:20.913 INFO:tasks.workunit.client.0.smithi062.stdout:done setting up random write file 2024-09-12T02:01:20.914 INFO:tasks.workunit.client.0.smithi062.stdout:starting fsync run 2024-09-12T02:01:20.914 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0009s fsync time: 0.0195s 2024-09-12T02:01:20.914 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0156s 2024-09-12T02:01:20.914 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0148s 2024-09-12T02:01:20.914 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0165s 2024-09-12T02:01:20.914 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0087s 2024-09-12T02:01:20.915 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0101s 2024-09-12T02:01:20.915 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0143s 2024-09-12T02:01:20.915 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0141s 2024-09-12T02:01:20.915 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0093s 2024-09-12T02:01:20.915 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0076s 2024-09-12T02:01:20.916 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0080s 2024-09-12T02:01:20.916 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0083s 2024-09-12T02:01:20.916 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0007s fsync time: 0.0166s 2024-09-12T02:01:20.916 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0061s 2024-09-12T02:01:20.916 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0004s fsync time: 0.0078s 2024-09-12T02:01:20.916 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0086s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0074s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0085s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0004s fsync time: 0.0085s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0139s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0067s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0007s fsync time: 0.0165s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0138s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0089s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0088s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0064s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0087s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0066s 2024-09-12T02:01:20.917 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0142s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0078s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0092s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0004s fsync time: 0.0141s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0097s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0074s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0092s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0136s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0069s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0094s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0076s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0095s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0004s fsync time: 0.0100s 2024-09-12T02:01:20.918 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0091s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0134s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0090s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0004s fsync time: 0.0123s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0007s fsync time: 0.0091s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0007s fsync time: 0.0091s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0099s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0004s fsync time: 0.0117s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0098s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0007s fsync time: 0.0095s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0007s fsync time: 0.0093s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0089s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0007s fsync time: 0.0085s 2024-09-12T02:01:20.919 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0127s 2024-09-12T02:01:20.920 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0006s fsync time: 0.0122s 2024-09-12T02:01:20.920 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0006s fsync time: 0.0132s 2024-09-12T02:01:20.920 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0005s fsync time: 0.0113s 2024-09-12T02:01:20.920 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0006s fsync time: 0.0102s 2024-09-12T02:01:20.920 INFO:tasks.workunit.client.0.smithi062.stdout:write time: 0.0006s fsync time: 0.0087s 2024-09-12T02:01:20.920 INFO:tasks.workunit.client.0.smithi062.stdout:run done 61 fsyncs total, killing random writer 2024-09-12T02:01:20.921 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T02:01:20.921 INFO:tasks.workunit.client.0.smithi062.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T02:01:20.921 INFO:tasks.workunit.client.0.smithi062.stderr:+ whereis lsof 2024-09-12T02:01:20.949 INFO:tasks.workunit.client.0.smithi062.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-12T02:01:20.950 INFO:tasks.workunit.client.0.smithi062.stderr:+ lsof 2024-09-12T02:01:20.971 INFO:tasks.workunit.client.0.smithi062.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/ce6ff69f9e2b9cc38825bff1d8372079f52fe04440fe5d468b7233a5666d4ec7/merged 2024-09-12T02:01:20.971 INFO:tasks.workunit.client.0.smithi062.stderr: Output information may be incomplete. 2024-09-12T02:01:20.971 INFO:tasks.workunit.client.0.smithi062.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/032ebc818b3a51461b92e7bb8cace27ba1e0b3f12ea5f4eb83229b84253ca8ad/merged 2024-09-12T02:01:20.971 INFO:tasks.workunit.client.0.smithi062.stderr: Output information may be incomplete. 2024-09-12T02:01:20.972 INFO:tasks.workunit.client.0.smithi062.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d64cd37c81ec3a349125856438bebfe53e178852926c5d845ac7c9d56ea7be31/merged 2024-09-12T02:01:20.972 INFO:tasks.workunit.client.0.smithi062.stderr: Output information may be incomplete. 2024-09-12T02:01:20.979 INFO:tasks.workunit.client.0.smithi062.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/ffb92293146db37a3bafd88d0df5f2f98ea817ea73f3a9039f10f8363f7f73d4/merged 2024-09-12T02:01:20.979 INFO:tasks.workunit.client.0.smithi062.stderr: Output information may be incomplete. 2024-09-12T02:01:20.979 INFO:tasks.workunit.client.0.smithi062.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/954b96235497f5c0d7a71dc829b1afb10a1a2d6b3638b868cbc68e885a3ed890/merged 2024-09-12T02:01:20.980 INFO:tasks.workunit.client.0.smithi062.stderr: Output information may be incomplete. 2024-09-12T02:01:20.980 INFO:tasks.workunit.client.0.smithi062.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/dfbf5515463ef747c9b044e1a101b491ffb3c8c5aadb6ec16130fdb8947cadaf/merged 2024-09-12T02:01:20.980 INFO:tasks.workunit.client.0.smithi062.stderr: Output information may be incomplete. 2024-09-12T02:01:20.980 INFO:tasks.workunit.client.0.smithi062.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/cfced5dfbe75e298b0ffbb2090be4741ee8b8888249942d8d50ac1ff1fc23edf/merged 2024-09-12T02:01:20.980 INFO:tasks.workunit.client.0.smithi062.stderr: Output information may be incomplete. 2024-09-12T02:01:20.981 INFO:tasks.workunit.client.0.smithi062.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/c232a18243a6e51b1265af0d22ae50b072cbfa6fceb4bc00f06f61ffe409915a/merged 2024-09-12T02:01:20.981 INFO:tasks.workunit.client.0.smithi062.stderr: Output information may be incomplete. 2024-09-12T02:01:20.981 INFO:tasks.workunit.client.0.smithi062.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/57e3666b3ce81a88d8b2e5f4fb7e749e31ffeb57a222c390ee61320fdd5c2d68/merged 2024-09-12T02:01:20.981 INFO:tasks.workunit.client.0.smithi062.stderr: Output information may be incomplete. 2024-09-12T02:01:20.981 INFO:tasks.workunit.client.0.smithi062.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/90a6717368221dc9488bf38cf5d692b5f39e0cfdc15b44797fa3d68721de45a6/merged 2024-09-12T02:01:20.981 INFO:tasks.workunit.client.0.smithi062.stderr: Output information may be incomplete. 2024-09-12T02:01:21.108 INFO:tasks.workunit.client.0.smithi062.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-12T02:01:21.109 INFO:tasks.workunit.client.0.smithi062.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-12T02:01:21.110 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-09-12T02:01:21.111 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-12T02:01:21.112 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-12T02:01:21.113 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_preem 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_preem 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_preem 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_preem 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_exp_p 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_exp_p 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_exp_p 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_exp_p 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_exp_g 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_exp_g 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_exp_g 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:rcu_exp_g 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-12T02:01:21.114 INFO:tasks.workunit.client.0.smithi062.stdout:migration 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:migration 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:migration 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:migration 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/0 21 root cwd unknown /proc/21/cwd (readlink: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/0 21 root rtd unknown /proc/21/root (readlink: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/0 21 root txt unknown /proc/21/exe (readlink: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/0 21 root NOFD /proc/21/fd (opendir: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/1 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/1 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/1 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/1 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-12T02:01:21.115 INFO:tasks.workunit.client.0.smithi062.stdout:migration 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:migration 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:migration 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:migration 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-12T02:01:21.116 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/2 27 root cwd unknown /proc/27/cwd (readlink: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/2 27 root rtd unknown /proc/27/root (readlink: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/2 27 root txt unknown /proc/27/exe (readlink: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/2 27 root NOFD /proc/27/fd (opendir: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:migration 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:migration 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:migration 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:migration 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-12T02:01:21.117 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/3 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/3 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/3 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/3 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:migration 33 root cwd unknown /proc/33/cwd (readlink: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:migration 33 root rtd unknown /proc/33/root (readlink: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:migration 33 root txt unknown /proc/33/exe (readlink: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:migration 33 root NOFD /proc/33/fd (opendir: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-12T02:01:21.118 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/4 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/4 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/4 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/4 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:migration 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:migration 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-12T02:01:21.119 INFO:tasks.workunit.client.0.smithi062.stdout:migration 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:migration 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 39 root cwd unknown /proc/39/cwd (readlink: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 39 root rtd unknown /proc/39/root (readlink: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 39 root txt unknown /proc/39/exe (readlink: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 39 root NOFD /proc/39/fd (opendir: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/5 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/5 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/5 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-12T02:01:21.120 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/5 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-12T02:01:21.121 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/6 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/6 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/6 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/6 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:migration 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:migration 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:migration 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:migration 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 51 root cwd unknown /proc/51/cwd (readlink: Permission denied) 2024-09-12T02:01:21.122 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 51 root rtd unknown /proc/51/root (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 51 root txt unknown /proc/51/exe (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 51 root NOFD /proc/51/fd (opendir: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/7 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/7 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/7 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:cpuhp/7 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:migration 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:migration 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:migration 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:migration 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-12T02:01:21.123 INFO:tasks.workunit.client.0.smithi062.stdout:ksoftirqd 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kdevtmpfs 57 root cwd unknown /proc/57/cwd (readlink: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kdevtmpfs 57 root rtd unknown /proc/57/root (readlink: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kdevtmpfs 57 root txt unknown /proc/57/exe (readlink: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kdevtmpfs 57 root NOFD /proc/57/fd (opendir: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-12T02:01:21.124 INFO:tasks.workunit.client.0.smithi062.stdout:kauditd 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:kauditd 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:kauditd 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:kauditd 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:khungtask 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:khungtask 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:khungtask 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:khungtask 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:oom_reape 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:oom_reape 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:oom_reape 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:oom_reape 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-09-12T02:01:21.125 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 63 root cwd unknown /proc/63/cwd (readlink: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 63 root rtd unknown /proc/63/root (readlink: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 63 root txt unknown /proc/63/exe (readlink: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 63 root NOFD /proc/63/fd (opendir: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:kcompactd 65 root cwd unknown /proc/65/cwd (readlink: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:kcompactd 65 root rtd unknown /proc/65/root (readlink: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:kcompactd 65 root txt unknown /proc/65/exe (readlink: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:kcompactd 65 root NOFD /proc/65/fd (opendir: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:ksmd 66 root cwd unknown /proc/66/cwd (readlink: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:ksmd 66 root rtd unknown /proc/66/root (readlink: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:ksmd 66 root txt unknown /proc/66/exe (readlink: Permission denied) 2024-09-12T02:01:21.126 INFO:tasks.workunit.client.0.smithi062.stdout:ksmd 66 root NOFD /proc/66/fd (opendir: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:khugepage 67 root cwd unknown /proc/67/cwd (readlink: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:khugepage 67 root rtd unknown /proc/67/root (readlink: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:khugepage 67 root txt unknown /proc/67/exe (readlink: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:khugepage 67 root NOFD /proc/67/fd (opendir: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 68 root NOFD /proc/68/fd (opendir: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-09-12T02:01:21.127 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 71 root cwd unknown /proc/71/cwd (readlink: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 71 root rtd unknown /proc/71/root (readlink: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 71 root txt unknown /proc/71/exe (readlink: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 71 root NOFD /proc/71/fd (opendir: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-09-12T02:01:21.128 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 75 root cwd unknown /proc/75/cwd (readlink: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 75 root rtd unknown /proc/75/root (readlink: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 75 root txt unknown /proc/75/exe (readlink: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 75 root NOFD /proc/75/fd (opendir: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:irq/9-acp 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:irq/9-acp 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:irq/9-acp 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:irq/9-acp 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-12T02:01:21.129 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-12T02:01:21.130 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:watchdogd 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:watchdogd 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:watchdogd 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:watchdogd 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 86 root cwd unknown /proc/86/cwd (readlink: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 86 root rtd unknown /proc/86/root (readlink: Permission denied) 2024-09-12T02:01:21.131 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 86 root txt unknown /proc/86/exe (readlink: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 86 root NOFD /proc/86/fd (opendir: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kswapd0 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kswapd0 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kswapd0 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kswapd0 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-09-12T02:01:21.132 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_0 93 root cwd unknown /proc/93/cwd (readlink: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_0 93 root rtd unknown /proc/93/root (readlink: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_0 93 root txt unknown /proc/93/exe (readlink: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_0 93 root NOFD /proc/93/fd (opendir: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 94 root cwd unknown /proc/94/cwd (readlink: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 94 root rtd unknown /proc/94/root (readlink: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 94 root txt unknown /proc/94/exe (readlink: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 94 root NOFD /proc/94/fd (opendir: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_1 95 root cwd unknown /proc/95/cwd (readlink: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_1 95 root rtd unknown /proc/95/root (readlink: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_1 95 root txt unknown /proc/95/exe (readlink: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_1 95 root NOFD /proc/95/fd (opendir: Permission denied) 2024-09-12T02:01:21.133 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 96 root cwd unknown /proc/96/cwd (readlink: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 96 root rtd unknown /proc/96/root (readlink: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 96 root txt unknown /proc/96/exe (readlink: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 96 root NOFD /proc/96/fd (opendir: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_2 97 root cwd unknown /proc/97/cwd (readlink: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_2 97 root rtd unknown /proc/97/root (readlink: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_2 97 root txt unknown /proc/97/exe (readlink: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_2 97 root NOFD /proc/97/fd (opendir: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 98 root cwd unknown /proc/98/cwd (readlink: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 98 root rtd unknown /proc/98/root (readlink: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 98 root txt unknown /proc/98/exe (readlink: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 98 root NOFD /proc/98/fd (opendir: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_3 99 root cwd unknown /proc/99/cwd (readlink: Permission denied) 2024-09-12T02:01:21.134 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_3 99 root rtd unknown /proc/99/root (readlink: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_3 99 root txt unknown /proc/99/exe (readlink: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_3 99 root NOFD /proc/99/fd (opendir: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 100 root cwd unknown /proc/100/cwd (readlink: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 100 root rtd unknown /proc/100/root (readlink: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 100 root txt unknown /proc/100/exe (readlink: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 100 root NOFD /proc/100/fd (opendir: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 102 root cwd unknown /proc/102/cwd (readlink: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 102 root rtd unknown /proc/102/root (readlink: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 102 root txt unknown /proc/102/exe (readlink: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 102 root NOFD /proc/102/fd (opendir: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_4 104 root cwd unknown /proc/104/cwd (readlink: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_4 104 root rtd unknown /proc/104/root (readlink: Permission denied) 2024-09-12T02:01:21.135 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_4 104 root txt unknown /proc/104/exe (readlink: Permission denied) 2024-09-12T02:01:21.136 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_4 104 root NOFD /proc/104/fd (opendir: Permission denied) 2024-09-12T02:01:21.136 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 105 root cwd unknown /proc/105/cwd (readlink: Permission denied) 2024-09-12T02:01:21.136 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 105 root rtd unknown /proc/105/root (readlink: Permission denied) 2024-09-12T02:01:21.136 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 105 root txt unknown /proc/105/exe (readlink: Permission denied) 2024-09-12T02:01:21.136 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 105 root NOFD /proc/105/fd (opendir: Permission denied) 2024-09-12T02:01:21.136 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_5 106 root cwd unknown /proc/106/cwd (readlink: Permission denied) 2024-09-12T02:01:21.136 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_5 106 root rtd unknown /proc/106/root (readlink: Permission denied) 2024-09-12T02:01:21.136 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_5 106 root txt unknown /proc/106/exe (readlink: Permission denied) 2024-09-12T02:01:21.136 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_5 106 root NOFD /proc/106/fd (opendir: Permission denied) 2024-09-12T02:01:21.137 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 107 root cwd unknown /proc/107/cwd (readlink: Permission denied) 2024-09-12T02:01:21.137 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 107 root rtd unknown /proc/107/root (readlink: Permission denied) 2024-09-12T02:01:21.137 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 107 root txt unknown /proc/107/exe (readlink: Permission denied) 2024-09-12T02:01:21.137 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 107 root NOFD /proc/107/fd (opendir: Permission denied) 2024-09-12T02:01:21.137 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_6 108 root cwd unknown /proc/108/cwd (readlink: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_6 108 root rtd unknown /proc/108/root (readlink: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_6 108 root txt unknown /proc/108/exe (readlink: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_6 108 root NOFD /proc/108/fd (opendir: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 109 root cwd unknown /proc/109/cwd (readlink: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 109 root rtd unknown /proc/109/root (readlink: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 109 root txt unknown /proc/109/exe (readlink: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 109 root NOFD /proc/109/fd (opendir: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_7 110 root cwd unknown /proc/110/cwd (readlink: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_7 110 root rtd unknown /proc/110/root (readlink: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_7 110 root txt unknown /proc/110/exe (readlink: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_7 110 root NOFD /proc/110/fd (opendir: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-09-12T02:01:21.138 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_8 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_8 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_8 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_8 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_9 114 root cwd unknown /proc/114/cwd (readlink: Permission denied) 2024-09-12T02:01:21.139 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_9 114 root rtd unknown /proc/114/root (readlink: Permission denied) 2024-09-12T02:01:21.140 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_9 114 root txt unknown /proc/114/exe (readlink: Permission denied) 2024-09-12T02:01:21.140 INFO:tasks.workunit.client.0.smithi062.stdout:scsi_eh_9 114 root NOFD /proc/114/fd (opendir: Permission denied) 2024-09-12T02:01:21.140 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 115 root cwd unknown /proc/115/cwd (readlink: Permission denied) 2024-09-12T02:01:21.140 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 115 root rtd unknown /proc/115/root (readlink: Permission denied) 2024-09-12T02:01:21.140 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 115 root txt unknown /proc/115/exe (readlink: Permission denied) 2024-09-12T02:01:21.140 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 115 root NOFD /proc/115/fd (opendir: Permission denied) 2024-09-12T02:01:21.140 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 116 root cwd unknown /proc/116/cwd (readlink: Permission denied) 2024-09-12T02:01:21.140 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 116 root rtd unknown /proc/116/root (readlink: Permission denied) 2024-09-12T02:01:21.140 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 116 root txt unknown /proc/116/exe (readlink: Permission denied) 2024-09-12T02:01:21.140 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 116 root NOFD /proc/116/fd (opendir: Permission denied) 2024-09-12T02:01:21.141 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 118 root cwd unknown /proc/118/cwd (readlink: Permission denied) 2024-09-12T02:01:21.141 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 118 root rtd unknown /proc/118/root (readlink: Permission denied) 2024-09-12T02:01:21.141 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 118 root txt unknown /proc/118/exe (readlink: Permission denied) 2024-09-12T02:01:21.141 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 118 root NOFD /proc/118/fd (opendir: Permission denied) 2024-09-12T02:01:21.141 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 119 root cwd unknown /proc/119/cwd (readlink: Permission denied) 2024-09-12T02:01:21.141 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 119 root rtd unknown /proc/119/root (readlink: Permission denied) 2024-09-12T02:01:21.141 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 119 root txt unknown /proc/119/exe (readlink: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 119 root NOFD /proc/119/fd (opendir: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 128 root cwd unknown /proc/128/cwd (readlink: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 128 root rtd unknown /proc/128/root (readlink: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 128 root txt unknown /proc/128/exe (readlink: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 128 root NOFD /proc/128/fd (opendir: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 130 root cwd unknown /proc/130/cwd (readlink: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 130 root rtd unknown /proc/130/root (readlink: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 130 root txt unknown /proc/130/exe (readlink: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 130 root NOFD /proc/130/fd (opendir: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 131 root cwd unknown /proc/131/cwd (readlink: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 131 root rtd unknown /proc/131/root (readlink: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 131 root txt unknown /proc/131/exe (readlink: Permission denied) 2024-09-12T02:01:21.142 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 131 root NOFD /proc/131/fd (opendir: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 138 root cwd unknown /proc/138/cwd (readlink: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 138 root rtd unknown /proc/138/root (readlink: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 138 root txt unknown /proc/138/exe (readlink: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 138 root NOFD /proc/138/fd (opendir: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 220 root cwd unknown /proc/220/cwd (readlink: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 220 root rtd unknown /proc/220/root (readlink: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 220 root txt unknown /proc/220/exe (readlink: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 220 root NOFD /proc/220/fd (opendir: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 222 root cwd unknown /proc/222/cwd (readlink: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 222 root rtd unknown /proc/222/root (readlink: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 222 root txt unknown /proc/222/exe (readlink: Permission denied) 2024-09-12T02:01:21.143 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 222 root NOFD /proc/222/fd (opendir: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 260 root cwd unknown /proc/260/cwd (readlink: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 260 root rtd unknown /proc/260/root (readlink: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 260 root txt unknown /proc/260/exe (readlink: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 260 root NOFD /proc/260/fd (opendir: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 264 root cwd unknown /proc/264/cwd (readlink: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 264 root rtd unknown /proc/264/root (readlink: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 264 root txt unknown /proc/264/exe (readlink: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 264 root NOFD /proc/264/fd (opendir: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 265 root cwd unknown /proc/265/cwd (readlink: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 265 root rtd unknown /proc/265/root (readlink: Permission denied) 2024-09-12T02:01:21.144 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 265 root txt unknown /proc/265/exe (readlink: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 265 root NOFD /proc/265/fd (opendir: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 273 root cwd unknown /proc/273/cwd (readlink: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 273 root rtd unknown /proc/273/root (readlink: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 273 root txt unknown /proc/273/exe (readlink: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 273 root NOFD /proc/273/fd (opendir: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 282 root cwd unknown /proc/282/cwd (readlink: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 282 root rtd unknown /proc/282/root (readlink: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 282 root txt unknown /proc/282/exe (readlink: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 282 root NOFD /proc/282/fd (opendir: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 418 root cwd unknown /proc/418/cwd (readlink: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 418 root rtd unknown /proc/418/root (readlink: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 418 root txt unknown /proc/418/exe (readlink: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 418 root NOFD /proc/418/fd (opendir: Permission denied) 2024-09-12T02:01:21.145 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 419 root cwd unknown /proc/419/cwd (readlink: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 419 root rtd unknown /proc/419/root (readlink: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 419 root txt unknown /proc/419/exe (readlink: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 419 root NOFD /proc/419/fd (opendir: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 427 root cwd unknown /proc/427/cwd (readlink: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 427 root rtd unknown /proc/427/root (readlink: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 427 root txt unknown /proc/427/exe (readlink: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 427 root NOFD /proc/427/fd (opendir: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 434 root cwd unknown /proc/434/cwd (readlink: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 434 root rtd unknown /proc/434/root (readlink: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 434 root txt unknown /proc/434/exe (readlink: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 434 root NOFD /proc/434/fd (opendir: Permission denied) 2024-09-12T02:01:21.146 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 449 root cwd unknown /proc/449/cwd (readlink: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 449 root rtd unknown /proc/449/root (readlink: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 449 root txt unknown /proc/449/exe (readlink: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 449 root NOFD /proc/449/fd (opendir: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:jbd2/sda1 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:jbd2/sda1 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:jbd2/sda1 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:jbd2/sda1 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-09-12T02:01:21.147 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-j 537 root cwd unknown /proc/537/cwd (readlink: Permission denied) 2024-09-12T02:01:21.148 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-j 537 root rtd unknown /proc/537/root (readlink: Permission denied) 2024-09-12T02:01:21.148 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-j 537 root txt unknown /proc/537/exe (readlink: Permission denied) 2024-09-12T02:01:21.148 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-j 537 root NOFD /proc/537/fd (opendir: Permission denied) 2024-09-12T02:01:21.148 INFO:tasks.workunit.client.0.smithi062.stdout:ext4lazyi 543 root cwd unknown /proc/543/cwd (readlink: Permission denied) 2024-09-12T02:01:21.148 INFO:tasks.workunit.client.0.smithi062.stdout:ext4lazyi 543 root rtd unknown /proc/543/root (readlink: Permission denied) 2024-09-12T02:01:21.148 INFO:tasks.workunit.client.0.smithi062.stdout:ext4lazyi 543 root txt unknown /proc/543/exe (readlink: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:ext4lazyi 543 root NOFD /proc/543/fd (opendir: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-u 553 root cwd unknown /proc/553/cwd (readlink: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-u 553 root rtd unknown /proc/553/root (readlink: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-u 553 root txt unknown /proc/553/exe (readlink: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-u 553 root NOFD /proc/553/fd (opendir: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 596 root cwd unknown /proc/596/cwd (readlink: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 596 root rtd unknown /proc/596/root (readlink: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 596 root txt unknown /proc/596/exe (readlink: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 596 root NOFD /proc/596/fd (opendir: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:kipmi0 610 root cwd unknown /proc/610/cwd (readlink: Permission denied) 2024-09-12T02:01:21.149 INFO:tasks.workunit.client.0.smithi062.stdout:kipmi0 610 root rtd unknown /proc/610/root (readlink: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:kipmi0 610 root txt unknown /proc/610/exe (readlink: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:kipmi0 610 root NOFD /proc/610/fd (opendir: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:rpcbind 626 rpc cwd unknown /proc/626/cwd (readlink: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:rpcbind 626 rpc rtd unknown /proc/626/root (readlink: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:rpcbind 626 rpc txt unknown /proc/626/exe (readlink: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:rpcbind 626 rpc NOFD /proc/626/fd (opendir: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 root cwd unknown /proc/643/cwd (readlink: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 root rtd unknown /proc/643/root (readlink: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 root txt unknown /proc/643/exe (readlink: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 root NOFD /proc/643/fd (opendir: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 644 auditd root cwd unknown /proc/643/task/644/cwd (readlink: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 644 auditd root rtd unknown /proc/643/task/644/root (readlink: Permission denied) 2024-09-12T02:01:21.150 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 644 auditd root txt unknown /proc/643/task/644/exe (readlink: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 644 auditd root NOFD /proc/643/task/644/fd (opendir: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 646 auditd root cwd unknown /proc/643/task/646/cwd (readlink: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 646 auditd root rtd unknown /proc/643/task/646/root (readlink: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 646 auditd root txt unknown /proc/643/task/646/exe (readlink: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:auditd 643 646 auditd root NOFD /proc/643/task/646/fd (opendir: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:sedispatc 645 root cwd unknown /proc/645/cwd (readlink: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:sedispatc 645 root rtd unknown /proc/645/root (readlink: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:sedispatc 645 root txt unknown /proc/645/exe (readlink: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:sedispatc 645 root NOFD /proc/645/fd (opendir: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 656 root cwd unknown /proc/656/cwd (readlink: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 656 root rtd unknown /proc/656/root (readlink: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 656 root txt unknown /proc/656/exe (readlink: Permission denied) 2024-09-12T02:01:21.151 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 656 root NOFD /proc/656/fd (opendir: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 657 root cwd unknown /proc/657/cwd (readlink: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 657 root rtd unknown /proc/657/root (readlink: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 657 root txt unknown /proc/657/exe (readlink: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 657 root NOFD /proc/657/fd (opendir: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:dbus-brok 673 dbus cwd unknown /proc/673/cwd (readlink: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:dbus-brok 673 dbus rtd unknown /proc/673/root (readlink: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:dbus-brok 673 dbus txt unknown /proc/673/exe (readlink: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:dbus-brok 673 dbus NOFD /proc/673/fd (opendir: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:dbus-brok 674 dbus cwd unknown /proc/674/cwd (readlink: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:dbus-brok 674 dbus rtd unknown /proc/674/root (readlink: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:dbus-brok 674 dbus txt unknown /proc/674/exe (readlink: Permission denied) 2024-09-12T02:01:21.152 INFO:tasks.workunit.client.0.smithi062.stdout:dbus-brok 674 dbus NOFD /proc/674/fd (opendir: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 root cwd unknown /proc/675/cwd (readlink: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 root rtd unknown /proc/675/root (readlink: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 root txt unknown /proc/675/exe (readlink: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 root NOFD /proc/675/fd (opendir: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 691 gmain root cwd unknown /proc/675/task/691/cwd (readlink: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 691 gmain root rtd unknown /proc/675/task/691/root (readlink: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 691 gmain root txt unknown /proc/675/task/691/exe (readlink: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 691 gmain root NOFD /proc/675/task/691/fd (opendir: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 692 gdbus root cwd unknown /proc/675/task/692/cwd (readlink: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 692 gdbus root rtd unknown /proc/675/task/692/root (readlink: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 692 gdbus root txt unknown /proc/675/task/692/exe (readlink: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:NetworkMa 675 692 gdbus root NOFD /proc/675/task/692/fd (opendir: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:irqbalanc 678 root cwd unknown /proc/678/cwd (readlink: Permission denied) 2024-09-12T02:01:21.153 INFO:tasks.workunit.client.0.smithi062.stdout:irqbalanc 678 root rtd unknown /proc/678/root (readlink: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:irqbalanc 678 root txt unknown /proc/678/exe (readlink: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:irqbalanc 678 root NOFD /proc/678/fd (opendir: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:irqbalanc 678 682 gmain root cwd unknown /proc/678/task/682/cwd (readlink: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:irqbalanc 678 682 gmain root rtd unknown /proc/678/task/682/root (readlink: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:irqbalanc 678 682 gmain root txt unknown /proc/678/task/682/exe (readlink: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:irqbalanc 678 682 gmain root NOFD /proc/678/task/682/fd (opendir: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:lsmd 679 libstoragemgmt cwd unknown /proc/679/cwd (readlink: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:lsmd 679 libstoragemgmt rtd unknown /proc/679/root (readlink: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:lsmd 679 libstoragemgmt txt unknown /proc/679/exe (readlink: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:lsmd 679 libstoragemgmt NOFD /proc/679/fd (opendir: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:smartd 680 root cwd unknown /proc/680/cwd (readlink: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:smartd 680 root rtd unknown /proc/680/root (readlink: Permission denied) 2024-09-12T02:01:21.154 INFO:tasks.workunit.client.0.smithi062.stdout:smartd 680 root txt unknown /proc/680/exe (readlink: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:smartd 680 root NOFD /proc/680/fd (opendir: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-l 684 root cwd unknown /proc/684/cwd (readlink: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-l 684 root rtd unknown /proc/684/root (readlink: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-l 684 root txt unknown /proc/684/exe (readlink: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:systemd-l 684 root NOFD /proc/684/fd (opendir: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 750 root cwd unknown /proc/750/cwd (readlink: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 750 root rtd unknown /proc/750/root (readlink: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 750 root txt unknown /proc/750/exe (readlink: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 750 root NOFD /proc/750/fd (opendir: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 root cwd unknown /proc/754/cwd (readlink: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 root rtd unknown /proc/754/root (readlink: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 root txt unknown /proc/754/exe (readlink: Permission denied) 2024-09-12T02:01:21.155 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 root NOFD /proc/754/fd (opendir: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 755 gssproxy root cwd unknown /proc/754/task/755/cwd (readlink: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 755 gssproxy root rtd unknown /proc/754/task/755/root (readlink: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 755 gssproxy root txt unknown /proc/754/task/755/exe (readlink: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 755 gssproxy root NOFD /proc/754/task/755/fd (opendir: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 756 gssproxy root cwd unknown /proc/754/task/756/cwd (readlink: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 756 gssproxy root rtd unknown /proc/754/task/756/root (readlink: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 756 gssproxy root txt unknown /proc/754/task/756/exe (readlink: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 756 gssproxy root NOFD /proc/754/task/756/fd (opendir: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 757 gssproxy root cwd unknown /proc/754/task/757/cwd (readlink: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 757 gssproxy root rtd unknown /proc/754/task/757/root (readlink: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 757 gssproxy root txt unknown /proc/754/task/757/exe (readlink: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 757 gssproxy root NOFD /proc/754/task/757/fd (opendir: Permission denied) 2024-09-12T02:01:21.156 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 758 gssproxy root cwd unknown /proc/754/task/758/cwd (readlink: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 758 gssproxy root rtd unknown /proc/754/task/758/root (readlink: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 758 gssproxy root txt unknown /proc/754/task/758/exe (readlink: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 758 gssproxy root NOFD /proc/754/task/758/fd (opendir: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 759 gssproxy root cwd unknown /proc/754/task/759/cwd (readlink: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 759 gssproxy root rtd unknown /proc/754/task/759/root (readlink: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 759 gssproxy root txt unknown /proc/754/task/759/exe (readlink: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:gssproxy 754 759 gssproxy root NOFD /proc/754/task/759/fd (opendir: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:atd 761 root cwd unknown /proc/761/cwd (readlink: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:atd 761 root rtd unknown /proc/761/root (readlink: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:atd 761 root txt unknown /proc/761/exe (readlink: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:atd 761 root NOFD /proc/761/fd (opendir: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:crond 762 root cwd unknown /proc/762/cwd (readlink: Permission denied) 2024-09-12T02:01:21.157 INFO:tasks.workunit.client.0.smithi062.stdout:crond 762 root rtd unknown /proc/762/root (readlink: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:crond 762 root txt unknown /proc/762/exe (readlink: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:crond 762 root NOFD /proc/762/fd (opendir: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 791 root cwd unknown /proc/791/cwd (readlink: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 791 root rtd unknown /proc/791/root (readlink: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 791 root txt unknown /proc/791/exe (readlink: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 791 root NOFD /proc/791/fd (opendir: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:nrpe 792 nrpe cwd unknown /proc/792/cwd (readlink: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:nrpe 792 nrpe rtd unknown /proc/792/root (readlink: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:nrpe 792 nrpe txt unknown /proc/792/exe (readlink: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:nrpe 792 nrpe NOFD /proc/792/fd (opendir: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:agetty 1117 root cwd unknown /proc/1117/cwd (readlink: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:agetty 1117 root rtd unknown /proc/1117/root (readlink: Permission denied) 2024-09-12T02:01:21.158 INFO:tasks.workunit.client.0.smithi062.stdout:agetty 1117 root txt unknown /proc/1117/exe (readlink: Permission denied) 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:agetty 1117 root NOFD /proc/1117/fd (opendir: Permission denied) 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:agetty 1120 root cwd unknown /proc/1120/cwd (readlink: Permission denied) 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:agetty 1120 root rtd unknown /proc/1120/root (readlink: Permission denied) 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:agetty 1120 root txt unknown /proc/1120/exe (readlink: Permission denied) 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:agetty 1120 root NOFD /proc/1120/fd (opendir: Permission denied) 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu cwd DIR 8,1 4096 2 / 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu DEL REG 8,1 2229 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T02:01:21.159 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu DEL REG 8,1 2232 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-12T02:01:21.160 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-12T02:01:21.161 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 0,20 0 19 /sys/fs/selinux/status 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 1u unix 0x0000000000000000 0t0 5556 type=STREAM (CONNECTED) 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 2u unix 0x0000000000000000 0t0 5556 type=STREAM (CONNECTED) 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 3u unix 0x0000000000000000 0t0 9389 type=DGRAM (CONNECTED) 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 4u a_inode 0,15 0 50 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 5u a_inode 0,15 0 50 [signalfd] 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 6r a_inode 0,15 0 50 inotify 2024-09-12T02:01:21.162 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 7r DIR 0,26 0 3557 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 8u a_inode 0,15 0 50 [timerfd] 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 9u a_inode 0,15 0 50 [eventpoll:10,13] 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 10r REG 0,21 0 5573 /proc/1480/mountinfo 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 11r a_inode 0,15 0 50 inotify 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 12u unix 0x0000000000000000 0t0 10298 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 13r a_inode 0,15 0 50 inotify 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 14r REG 0,21 0 4026532070 /proc/swaps 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 15u netlink 0t0 10280 KOBJECT_UEVENT 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 16u unix 0x0000000000000000 0t0 10285 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 17u unix 0x0000000000000000 0t0 10286 type=DGRAM (CONNECTED) 2024-09-12T02:01:21.163 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 18u unix 0x0000000000000000 0t0 10287 type=DGRAM (CONNECTED) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 19u unix 0x0000000000000000 0t0 10288 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 20u unix 0x0000000000000000 0t0 10290 type=STREAM (CONNECTED) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 1480 ubuntu 21u a_inode 0,15 0 50 [timerfd] 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:(sd-pam) 1485 ubuntu cwd unknown /proc/1485/cwd (readlink: Permission denied) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:(sd-pam) 1485 ubuntu rtd unknown /proc/1485/root (readlink: Permission denied) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:(sd-pam) 1485 ubuntu txt unknown /proc/1485/exe (readlink: Permission denied) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:(sd-pam) 1485 ubuntu NOFD /proc/1485/fd (opendir: Permission denied) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 root cwd unknown /proc/2692/cwd (readlink: Permission denied) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 root rtd unknown /proc/2692/root (readlink: Permission denied) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 root txt unknown /proc/2692/exe (readlink: Permission denied) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 root NOFD /proc/2692/fd (opendir: Permission denied) 2024-09-12T02:01:21.164 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 2701 in:imjour root cwd unknown /proc/2692/task/2701/cwd (readlink: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 2701 in:imjour root rtd unknown /proc/2692/task/2701/root (readlink: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 2701 in:imjour root txt unknown /proc/2692/task/2701/exe (readlink: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 2701 in:imjour root NOFD /proc/2692/task/2701/fd (opendir: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 2702 rs:main root cwd unknown /proc/2692/task/2702/cwd (readlink: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 2702 rs:main root rtd unknown /proc/2692/task/2702/root (readlink: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 2702 rs:main root txt unknown /proc/2692/task/2702/exe (readlink: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:rsyslogd 2692 2702 rs:main root NOFD /proc/2692/task/2702/fd (opendir: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 polkitd cwd unknown /proc/18654/cwd (readlink: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 polkitd rtd unknown /proc/18654/root (readlink: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 polkitd txt unknown /proc/18654/exe (readlink: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 polkitd NOFD /proc/18654/fd (opendir: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18656 gmain polkitd cwd unknown /proc/18654/task/18656/cwd (readlink: Permission denied) 2024-09-12T02:01:21.165 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18656 gmain polkitd rtd unknown /proc/18654/task/18656/root (readlink: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18656 gmain polkitd txt unknown /proc/18654/task/18656/exe (readlink: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18656 gmain polkitd NOFD /proc/18654/task/18656/fd (opendir: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18657 gdbus polkitd cwd unknown /proc/18654/task/18657/cwd (readlink: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18657 gdbus polkitd rtd unknown /proc/18654/task/18657/root (readlink: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18657 gdbus polkitd txt unknown /proc/18654/task/18657/exe (readlink: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18657 gdbus polkitd NOFD /proc/18654/task/18657/fd (opendir: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18658 JS\x20Hel polkitd cwd unknown /proc/18654/task/18658/cwd (readlink: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18658 JS\x20Hel polkitd rtd unknown /proc/18654/task/18658/root (readlink: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18658 JS\x20Hel polkitd txt unknown /proc/18654/task/18658/exe (readlink: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18658 JS\x20Hel polkitd NOFD /proc/18654/task/18658/fd (opendir: Permission denied) 2024-09-12T02:01:21.166 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18659 JS\x20Hel polkitd cwd unknown /proc/18654/task/18659/cwd (readlink: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18659 JS\x20Hel polkitd rtd unknown /proc/18654/task/18659/root (readlink: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18659 JS\x20Hel polkitd txt unknown /proc/18654/task/18659/exe (readlink: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18659 JS\x20Hel polkitd NOFD /proc/18654/task/18659/fd (opendir: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18660 JS\x20Hel polkitd cwd unknown /proc/18654/task/18660/cwd (readlink: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18660 JS\x20Hel polkitd rtd unknown /proc/18654/task/18660/root (readlink: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18660 JS\x20Hel polkitd txt unknown /proc/18654/task/18660/exe (readlink: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18660 JS\x20Hel polkitd NOFD /proc/18654/task/18660/fd (opendir: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18661 JS\x20Hel polkitd cwd unknown /proc/18654/task/18661/cwd (readlink: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18661 JS\x20Hel polkitd rtd unknown /proc/18654/task/18661/root (readlink: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18661 JS\x20Hel polkitd txt unknown /proc/18654/task/18661/exe (readlink: Permission denied) 2024-09-12T02:01:21.167 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18661 JS\x20Hel polkitd NOFD /proc/18654/task/18661/fd (opendir: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18662 JS\x20Hel polkitd cwd unknown /proc/18654/task/18662/cwd (readlink: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18662 JS\x20Hel polkitd rtd unknown /proc/18654/task/18662/root (readlink: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18662 JS\x20Hel polkitd txt unknown /proc/18654/task/18662/exe (readlink: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18662 JS\x20Hel polkitd NOFD /proc/18654/task/18662/fd (opendir: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18663 JS\x20Hel polkitd cwd unknown /proc/18654/task/18663/cwd (readlink: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18663 JS\x20Hel polkitd rtd unknown /proc/18654/task/18663/root (readlink: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18663 JS\x20Hel polkitd txt unknown /proc/18654/task/18663/exe (readlink: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18663 JS\x20Hel polkitd NOFD /proc/18654/task/18663/fd (opendir: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18664 JS\x20Hel polkitd cwd unknown /proc/18654/task/18664/cwd (readlink: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18664 JS\x20Hel polkitd rtd unknown /proc/18654/task/18664/root (readlink: Permission denied) 2024-09-12T02:01:21.168 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18664 JS\x20Hel polkitd txt unknown /proc/18654/task/18664/exe (readlink: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18664 JS\x20Hel polkitd NOFD /proc/18654/task/18664/fd (opendir: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18665 JS\x20Hel polkitd cwd unknown /proc/18654/task/18665/cwd (readlink: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18665 JS\x20Hel polkitd rtd unknown /proc/18654/task/18665/root (readlink: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18665 JS\x20Hel polkitd txt unknown /proc/18654/task/18665/exe (readlink: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18665 JS\x20Hel polkitd NOFD /proc/18654/task/18665/fd (opendir: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18666 polkitd polkitd cwd unknown /proc/18654/task/18666/cwd (readlink: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18666 polkitd polkitd rtd unknown /proc/18654/task/18666/root (readlink: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18666 polkitd polkitd txt unknown /proc/18654/task/18666/exe (readlink: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:polkitd 18654 18666 polkitd polkitd NOFD /proc/18654/task/18666/fd (opendir: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20560 root cwd unknown /proc/20560/cwd (readlink: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20560 root rtd unknown /proc/20560/root (readlink: Permission denied) 2024-09-12T02:01:21.169 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20560 root txt unknown /proc/20560/exe (readlink: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20560 root NOFD /proc/20560/fd (opendir: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20590 root cwd unknown /proc/20590/cwd (readlink: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20590 root rtd unknown /proc/20590/root (readlink: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20590 root txt unknown /proc/20590/exe (readlink: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20590 root NOFD /proc/20590/fd (opendir: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20619 root cwd unknown /proc/20619/cwd (readlink: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20619 root rtd unknown /proc/20619/root (readlink: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20619 root txt unknown /proc/20619/exe (readlink: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20619 root NOFD /proc/20619/fd (opendir: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20648 root cwd unknown /proc/20648/cwd (readlink: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20648 root rtd unknown /proc/20648/root (readlink: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20648 root txt unknown /proc/20648/exe (readlink: Permission denied) 2024-09-12T02:01:21.170 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20648 root NOFD /proc/20648/fd (opendir: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20677 root cwd unknown /proc/20677/cwd (readlink: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20677 root rtd unknown /proc/20677/root (readlink: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20677 root txt unknown /proc/20677/exe (readlink: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20677 root NOFD /proc/20677/fd (opendir: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20841 root cwd unknown /proc/20841/cwd (readlink: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20841 root rtd unknown /proc/20841/root (readlink: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20841 root txt unknown /proc/20841/exe (readlink: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20841 root NOFD /proc/20841/fd (opendir: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20842 root cwd unknown /proc/20842/cwd (readlink: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20842 root rtd unknown /proc/20842/root (readlink: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20842 root txt unknown /proc/20842/exe (readlink: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20842 root NOFD /proc/20842/fd (opendir: Permission denied) 2024-09-12T02:01:21.171 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20843 root cwd unknown /proc/20843/cwd (readlink: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20843 root rtd unknown /proc/20843/root (readlink: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20843 root txt unknown /proc/20843/exe (readlink: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20843 root NOFD /proc/20843/fd (opendir: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20844 root cwd unknown /proc/20844/cwd (readlink: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20844 root rtd unknown /proc/20844/root (readlink: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20844 root txt unknown /proc/20844/exe (readlink: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20844 root NOFD /proc/20844/fd (opendir: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20845 root cwd unknown /proc/20845/cwd (readlink: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20845 root rtd unknown /proc/20845/root (readlink: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20845 root txt unknown /proc/20845/exe (readlink: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20845 root NOFD /proc/20845/fd (opendir: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20846 root cwd unknown /proc/20846/cwd (readlink: Permission denied) 2024-09-12T02:01:21.172 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20846 root rtd unknown /proc/20846/root (readlink: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20846 root txt unknown /proc/20846/exe (readlink: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20846 root NOFD /proc/20846/fd (opendir: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20847 root cwd unknown /proc/20847/cwd (readlink: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20847 root rtd unknown /proc/20847/root (readlink: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20847 root txt unknown /proc/20847/exe (readlink: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20847 root NOFD /proc/20847/fd (opendir: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20848 root cwd unknown /proc/20848/cwd (readlink: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20848 root rtd unknown /proc/20848/root (readlink: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20848 root txt unknown /proc/20848/exe (readlink: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20848 root NOFD /proc/20848/fd (opendir: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20849 root cwd unknown /proc/20849/cwd (readlink: Permission denied) 2024-09-12T02:01:21.173 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20849 root rtd unknown /proc/20849/root (readlink: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20849 root txt unknown /proc/20849/exe (readlink: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 20849 root NOFD /proc/20849/fd (opendir: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:xfsaild/d 20850 root cwd unknown /proc/20850/cwd (readlink: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:xfsaild/d 20850 root rtd unknown /proc/20850/root (readlink: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:xfsaild/d 20850 root txt unknown /proc/20850/exe (readlink: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:xfsaild/d 20850 root NOFD /proc/20850/fd (opendir: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 21785 root cwd unknown /proc/21785/cwd (readlink: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 21785 root rtd unknown /proc/21785/root (readlink: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 21785 root txt unknown /proc/21785/exe (readlink: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 21785 root NOFD /proc/21785/fd (opendir: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 21788 ubuntu cwd unknown /proc/21788/cwd (readlink: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 21788 ubuntu rtd unknown /proc/21788/root (readlink: Permission denied) 2024-09-12T02:01:21.174 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 21788 ubuntu txt unknown /proc/21788/exe (readlink: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 21788 ubuntu NOFD /proc/21788/fd (opendir: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:chronyd 21848 chrony cwd unknown /proc/21848/cwd (readlink: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:chronyd 21848 chrony rtd unknown /proc/21848/root (readlink: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:chronyd 21848 chrony txt unknown /proc/21848/exe (readlink: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:chronyd 21848 chrony NOFD /proc/21848/fd (opendir: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 22177 root cwd unknown /proc/22177/cwd (readlink: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 22177 root rtd unknown /proc/22177/root (readlink: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 22177 root txt unknown /proc/22177/exe (readlink: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 22177 root NOFD /proc/22177/fd (opendir: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-cras 22201 ceph cwd unknown /proc/22201/cwd (readlink: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-cras 22201 ceph rtd unknown /proc/22201/root (readlink: Permission denied) 2024-09-12T02:01:21.175 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-cras 22201 ceph txt unknown /proc/22201/exe (readlink: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-cras 22201 ceph NOFD /proc/22201/fd (opendir: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 22209 root cwd unknown /proc/22209/cwd (readlink: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 22209 root rtd unknown /proc/22209/root (readlink: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 22209 root txt unknown /proc/22209/exe (readlink: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 22209 root NOFD /proc/22209/fd (opendir: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 23070 root cwd unknown /proc/23070/cwd (readlink: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 23070 root rtd unknown /proc/23070/root (readlink: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 23070 root txt unknown /proc/23070/exe (readlink: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 23070 root NOFD /proc/23070/fd (opendir: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23388 root cwd unknown /proc/23388/cwd (readlink: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23388 root rtd unknown /proc/23388/root (readlink: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23388 root txt unknown /proc/23388/exe (readlink: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23388 root NOFD /proc/23388/fd (opendir: Permission denied) 2024-09-12T02:01:21.176 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23407 root cwd unknown /proc/23407/cwd (readlink: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23407 root rtd unknown /proc/23407/root (readlink: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23407 root txt unknown /proc/23407/exe (readlink: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23407 root NOFD /proc/23407/fd (opendir: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23409 root cwd unknown /proc/23409/cwd (readlink: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23409 root rtd unknown /proc/23409/root (readlink: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23409 root txt unknown /proc/23409/exe (readlink: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 23409 root NOFD /proc/23409/fd (opendir: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 29452 root cwd unknown /proc/29452/cwd (readlink: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 29452 root rtd unknown /proc/29452/root (readlink: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 29452 root txt unknown /proc/29452/exe (readlink: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 29452 root NOFD /proc/29452/fd (opendir: Permission denied) 2024-09-12T02:01:21.177 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 29670 root cwd unknown /proc/29670/cwd (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 29670 root rtd unknown /proc/29670/root (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 29670 root txt unknown /proc/29670/exe (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 29670 root NOFD /proc/29670/fd (opendir: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 29687 root cwd unknown /proc/29687/cwd (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 29687 root rtd unknown /proc/29687/root (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 29687 root txt unknown /proc/29687/exe (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 29687 root NOFD /proc/29687/fd (opendir: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 29688 root cwd unknown /proc/29688/cwd (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 29688 root rtd unknown /proc/29688/root (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 29688 root txt unknown /proc/29688/exe (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 29688 root NOFD /proc/29688/fd (opendir: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 29706 root cwd unknown /proc/29706/cwd (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 29706 root rtd unknown /proc/29706/root (readlink: Permission denied) 2024-09-12T02:01:21.178 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 29706 root txt unknown /proc/29706/exe (readlink: Permission denied) 2024-09-12T02:01:21.179 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 29706 root NOFD /proc/29706/fd (opendir: Permission denied) 2024-09-12T02:01:21.179 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 30626 root cwd unknown /proc/30626/cwd (readlink: Permission denied) 2024-09-12T02:01:21.179 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 30626 root rtd unknown /proc/30626/root (readlink: Permission denied) 2024-09-12T02:01:21.179 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 30626 root txt unknown /proc/30626/exe (readlink: Permission denied) 2024-09-12T02:01:21.179 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 30626 root NOFD /proc/30626/fd (opendir: Permission denied) 2024-09-12T02:01:21.179 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 30662 root cwd unknown /proc/30662/cwd (readlink: Permission denied) 2024-09-12T02:01:21.179 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 30662 root rtd unknown /proc/30662/root (readlink: Permission denied) 2024-09-12T02:01:21.179 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 30662 root txt unknown /proc/30662/exe (readlink: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 30662 root NOFD /proc/30662/fd (opendir: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 30664 root cwd unknown /proc/30664/cwd (readlink: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 30664 root rtd unknown /proc/30664/root (readlink: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 30664 root txt unknown /proc/30664/exe (readlink: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 30664 root NOFD /proc/30664/fd (opendir: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 ceph cwd unknown /proc/30666/cwd (readlink: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 ceph rtd unknown /proc/30666/root (readlink: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 ceph txt unknown /proc/30666/exe (readlink: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 ceph NOFD /proc/30666/fd (opendir: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30667 log ceph cwd unknown /proc/30666/task/30667/cwd (readlink: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30667 log ceph rtd unknown /proc/30666/task/30667/root (readlink: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30667 log ceph txt unknown /proc/30666/task/30667/exe (readlink: Permission denied) 2024-09-12T02:01:21.180 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30667 log ceph NOFD /proc/30666/task/30667/fd (opendir: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30668 service ceph cwd unknown /proc/30666/task/30668/cwd (readlink: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30668 service ceph rtd unknown /proc/30666/task/30668/root (readlink: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30668 service ceph txt unknown /proc/30666/task/30668/exe (readlink: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30668 service ceph NOFD /proc/30666/task/30668/fd (opendir: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30669 admin_soc ceph cwd unknown /proc/30666/task/30669/cwd (readlink: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30669 admin_soc ceph rtd unknown /proc/30666/task/30669/root (readlink: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30669 admin_soc ceph txt unknown /proc/30666/task/30669/exe (readlink: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30669 admin_soc ceph NOFD /proc/30666/task/30669/fd (opendir: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30670 signal_ha ceph cwd unknown /proc/30666/task/30670/cwd (readlink: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30670 signal_ha ceph rtd unknown /proc/30666/task/30670/root (readlink: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30670 signal_ha ceph txt unknown /proc/30666/task/30670/exe (readlink: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30670 signal_ha ceph NOFD /proc/30666/task/30670/fd (opendir: Permission denied) 2024-09-12T02:01:21.181 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30671 rocksdb:l ceph cwd unknown /proc/30666/task/30671/cwd (readlink: Permission denied) 2024-09-12T02:01:21.182 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30671 rocksdb:l ceph rtd unknown /proc/30666/task/30671/root (readlink: Permission denied) 2024-09-12T02:01:21.182 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30671 rocksdb:l ceph txt unknown /proc/30666/task/30671/exe (readlink: Permission denied) 2024-09-12T02:01:21.182 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30671 rocksdb:l ceph NOFD /proc/30666/task/30671/fd (opendir: Permission denied) 2024-09-12T02:01:21.182 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30672 rocksdb:h ceph cwd unknown /proc/30666/task/30672/cwd (readlink: Permission denied) 2024-09-12T02:01:21.182 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30672 rocksdb:h ceph rtd unknown /proc/30666/task/30672/root (readlink: Permission denied) 2024-09-12T02:01:21.182 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30672 rocksdb:h ceph txt unknown /proc/30666/task/30672/exe (readlink: Permission denied) 2024-09-12T02:01:21.182 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30672 rocksdb:h ceph NOFD /proc/30666/task/30672/fd (opendir: Permission denied) 2024-09-12T02:01:21.182 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30688 ceph-mon ceph cwd unknown /proc/30666/task/30688/cwd (readlink: Permission denied) 2024-09-12T02:01:21.182 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30688 ceph-mon ceph rtd unknown /proc/30666/task/30688/root (readlink: Permission denied) 2024-09-12T02:01:21.182 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30688 ceph-mon ceph txt unknown /proc/30666/task/30688/exe (readlink: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30688 ceph-mon ceph NOFD /proc/30666/task/30688/fd (opendir: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30689 fn_monsto ceph cwd unknown /proc/30666/task/30689/cwd (readlink: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30689 fn_monsto ceph rtd unknown /proc/30666/task/30689/root (readlink: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30689 fn_monsto ceph txt unknown /proc/30666/task/30689/exe (readlink: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30689 fn_monsto ceph NOFD /proc/30666/task/30689/fd (opendir: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30690 msgr-work ceph cwd unknown /proc/30666/task/30690/cwd (readlink: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30690 msgr-work ceph rtd unknown /proc/30666/task/30690/root (readlink: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30690 msgr-work ceph txt unknown /proc/30666/task/30690/exe (readlink: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30690 msgr-work ceph NOFD /proc/30666/task/30690/fd (opendir: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30691 msgr-work ceph cwd unknown /proc/30666/task/30691/cwd (readlink: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30691 msgr-work ceph rtd unknown /proc/30666/task/30691/root (readlink: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30691 msgr-work ceph txt unknown /proc/30666/task/30691/exe (readlink: Permission denied) 2024-09-12T02:01:21.183 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30691 msgr-work ceph NOFD /proc/30666/task/30691/fd (opendir: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30692 msgr-work ceph cwd unknown /proc/30666/task/30692/cwd (readlink: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30692 msgr-work ceph rtd unknown /proc/30666/task/30692/root (readlink: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30692 msgr-work ceph txt unknown /proc/30666/task/30692/exe (readlink: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30692 msgr-work ceph NOFD /proc/30666/task/30692/fd (opendir: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30693 OpHistory ceph cwd unknown /proc/30666/task/30693/cwd (readlink: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30693 OpHistory ceph rtd unknown /proc/30666/task/30693/root (readlink: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30693 OpHistory ceph txt unknown /proc/30666/task/30693/exe (readlink: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30693 OpHistory ceph NOFD /proc/30666/task/30693/fd (opendir: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30694 fin ceph cwd unknown /proc/30666/task/30694/cwd (readlink: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30694 fin ceph rtd unknown /proc/30666/task/30694/root (readlink: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30694 fin ceph txt unknown /proc/30666/task/30694/exe (readlink: Permission denied) 2024-09-12T02:01:21.184 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30694 fin ceph NOFD /proc/30666/task/30694/fd (opendir: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30695 safe_time ceph cwd unknown /proc/30666/task/30695/cwd (readlink: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30695 safe_time ceph rtd unknown /proc/30666/task/30695/root (readlink: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30695 safe_time ceph txt unknown /proc/30666/task/30695/exe (readlink: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30695 safe_time ceph NOFD /proc/30666/task/30695/fd (opendir: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30696 cpu_tp ceph cwd unknown /proc/30666/task/30696/cwd (readlink: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30696 cpu_tp ceph rtd unknown /proc/30666/task/30696/root (readlink: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30696 cpu_tp ceph txt unknown /proc/30666/task/30696/exe (readlink: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30696 cpu_tp ceph NOFD /proc/30666/task/30696/fd (opendir: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30697 cpu_tp ceph cwd unknown /proc/30666/task/30697/cwd (readlink: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30697 cpu_tp ceph rtd unknown /proc/30666/task/30697/root (readlink: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30697 cpu_tp ceph txt unknown /proc/30666/task/30697/exe (readlink: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30697 cpu_tp ceph NOFD /proc/30666/task/30697/fd (opendir: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30698 cpu_tp ceph cwd unknown /proc/30666/task/30698/cwd (readlink: Permission denied) 2024-09-12T02:01:21.185 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30698 cpu_tp ceph rtd unknown /proc/30666/task/30698/root (readlink: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30698 cpu_tp ceph txt unknown /proc/30666/task/30698/exe (readlink: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30698 cpu_tp ceph NOFD /proc/30666/task/30698/fd (opendir: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30699 cpu_tp ceph cwd unknown /proc/30666/task/30699/cwd (readlink: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30699 cpu_tp ceph rtd unknown /proc/30666/task/30699/root (readlink: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30699 cpu_tp ceph txt unknown /proc/30666/task/30699/exe (readlink: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30699 cpu_tp ceph NOFD /proc/30666/task/30699/fd (opendir: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30700 ms_dispat ceph cwd unknown /proc/30666/task/30700/cwd (readlink: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30700 ms_dispat ceph rtd unknown /proc/30666/task/30700/root (readlink: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30700 ms_dispat ceph txt unknown /proc/30666/task/30700/exe (readlink: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30700 ms_dispat ceph NOFD /proc/30666/task/30700/fd (opendir: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30701 ms_local ceph cwd unknown /proc/30666/task/30701/cwd (readlink: Permission denied) 2024-09-12T02:01:21.186 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30701 ms_local ceph rtd unknown /proc/30666/task/30701/root (readlink: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30701 ms_local ceph txt unknown /proc/30666/task/30701/exe (readlink: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30701 ms_local ceph NOFD /proc/30666/task/30701/fd (opendir: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30702 safe_time ceph cwd unknown /proc/30666/task/30702/cwd (readlink: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30702 safe_time ceph rtd unknown /proc/30666/task/30702/root (readlink: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30702 safe_time ceph txt unknown /proc/30666/task/30702/exe (readlink: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30702 safe_time ceph NOFD /proc/30666/task/30702/fd (opendir: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30703 ms_dispat ceph cwd unknown /proc/30666/task/30703/cwd (readlink: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30703 ms_dispat ceph rtd unknown /proc/30666/task/30703/root (readlink: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30703 ms_dispat ceph txt unknown /proc/30666/task/30703/exe (readlink: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30703 ms_dispat ceph NOFD /proc/30666/task/30703/fd (opendir: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30704 ms_local ceph cwd unknown /proc/30666/task/30704/cwd (readlink: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30704 ms_local ceph rtd unknown /proc/30666/task/30704/root (readlink: Permission denied) 2024-09-12T02:01:21.187 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30704 ms_local ceph txt unknown /proc/30666/task/30704/exe (readlink: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 30704 ms_local ceph NOFD /proc/30666/task/30704/fd (opendir: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 69397 rstore_co ceph cwd unknown /proc/30666/task/69397/cwd (readlink: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 69397 rstore_co ceph rtd unknown /proc/30666/task/69397/root (readlink: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 69397 rstore_co ceph txt unknown /proc/30666/task/69397/exe (readlink: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mon 30666 69397 rstore_co ceph NOFD /proc/30666/task/69397/fd (opendir: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 30889 root cwd unknown /proc/30889/cwd (readlink: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 30889 root rtd unknown /proc/30889/root (readlink: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 30889 root txt unknown /proc/30889/exe (readlink: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 30889 root NOFD /proc/30889/fd (opendir: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 30891 root cwd unknown /proc/30891/cwd (readlink: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 30891 root rtd unknown /proc/30891/root (readlink: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 30891 root txt unknown /proc/30891/exe (readlink: Permission denied) 2024-09-12T02:01:21.188 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 30891 root NOFD /proc/30891/fd (opendir: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 ceph cwd unknown /proc/30893/cwd (readlink: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 ceph rtd unknown /proc/30893/root (readlink: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 ceph txt unknown /proc/30893/exe (readlink: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 ceph NOFD /proc/30893/fd (opendir: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83662 log ceph cwd unknown /proc/30893/task/83662/cwd (readlink: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83662 log ceph rtd unknown /proc/30893/task/83662/root (readlink: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83662 log ceph txt unknown /proc/30893/task/83662/exe (readlink: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83662 log ceph NOFD /proc/30893/task/83662/fd (opendir: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83664 msgr-work ceph cwd unknown /proc/30893/task/83664/cwd (readlink: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83664 msgr-work ceph rtd unknown /proc/30893/task/83664/root (readlink: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83664 msgr-work ceph txt unknown /proc/30893/task/83664/exe (readlink: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83664 msgr-work ceph NOFD /proc/30893/task/83664/fd (opendir: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83665 msgr-work ceph cwd unknown /proc/30893/task/83665/cwd (readlink: Permission denied) 2024-09-12T02:01:21.189 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83665 msgr-work ceph rtd unknown /proc/30893/task/83665/root (readlink: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83665 msgr-work ceph txt unknown /proc/30893/task/83665/exe (readlink: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83665 msgr-work ceph NOFD /proc/30893/task/83665/fd (opendir: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83666 msgr-work ceph cwd unknown /proc/30893/task/83666/cwd (readlink: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83666 msgr-work ceph rtd unknown /proc/30893/task/83666/root (readlink: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83666 msgr-work ceph txt unknown /proc/30893/task/83666/exe (readlink: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83666 msgr-work ceph NOFD /proc/30893/task/83666/fd (opendir: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83672 service ceph cwd unknown /proc/30893/task/83672/cwd (readlink: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83672 service ceph rtd unknown /proc/30893/task/83672/root (readlink: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83672 service ceph txt unknown /proc/30893/task/83672/exe (readlink: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83672 service ceph NOFD /proc/30893/task/83672/fd (opendir: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83673 admin_soc ceph cwd unknown /proc/30893/task/83673/cwd (readlink: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83673 admin_soc ceph rtd unknown /proc/30893/task/83673/root (readlink: Permission denied) 2024-09-12T02:01:21.190 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83673 admin_soc ceph txt unknown /proc/30893/task/83673/exe (readlink: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83673 admin_soc ceph NOFD /proc/30893/task/83673/fd (opendir: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83674 ceph_time ceph cwd unknown /proc/30893/task/83674/cwd (readlink: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83674 ceph_time ceph rtd unknown /proc/30893/task/83674/root (readlink: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83674 ceph_time ceph txt unknown /proc/30893/task/83674/exe (readlink: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83674 ceph_time ceph NOFD /proc/30893/task/83674/fd (opendir: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83675 fn_anonym ceph cwd unknown /proc/30893/task/83675/cwd (readlink: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83675 fn_anonym ceph rtd unknown /proc/30893/task/83675/root (readlink: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83675 fn_anonym ceph txt unknown /proc/30893/task/83675/exe (readlink: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83675 fn_anonym ceph NOFD /proc/30893/task/83675/fd (opendir: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83677 signal_ha ceph cwd unknown /proc/30893/task/83677/cwd (readlink: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83677 signal_ha ceph rtd unknown /proc/30893/task/83677/root (readlink: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83677 signal_ha ceph txt unknown /proc/30893/task/83677/exe (readlink: Permission denied) 2024-09-12T02:01:21.191 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83677 signal_ha ceph NOFD /proc/30893/task/83677/fd (opendir: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83678 mgrsb-fin ceph cwd unknown /proc/30893/task/83678/cwd (readlink: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83678 mgrsb-fin ceph rtd unknown /proc/30893/task/83678/root (readlink: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83678 mgrsb-fin ceph txt unknown /proc/30893/task/83678/exe (readlink: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83678 mgrsb-fin ceph NOFD /proc/30893/task/83678/fd (opendir: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83679 ms_dispat ceph cwd unknown /proc/30893/task/83679/cwd (readlink: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83679 ms_dispat ceph rtd unknown /proc/30893/task/83679/root (readlink: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83679 ms_dispat ceph txt unknown /proc/30893/task/83679/exe (readlink: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83679 ms_dispat ceph NOFD /proc/30893/task/83679/fd (opendir: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83680 ms_local ceph cwd unknown /proc/30893/task/83680/cwd (readlink: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83680 ms_local ceph rtd unknown /proc/30893/task/83680/root (readlink: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83680 ms_local ceph txt unknown /proc/30893/task/83680/exe (readlink: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83680 ms_local ceph NOFD /proc/30893/task/83680/fd (opendir: Permission denied) 2024-09-12T02:01:21.192 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83681 io_contex ceph cwd unknown /proc/30893/task/83681/cwd (readlink: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83681 io_contex ceph rtd unknown /proc/30893/task/83681/root (readlink: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83681 io_contex ceph txt unknown /proc/30893/task/83681/exe (readlink: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83681 io_contex ceph NOFD /proc/30893/task/83681/fd (opendir: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83682 io_contex ceph cwd unknown /proc/30893/task/83682/cwd (readlink: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83682 io_contex ceph rtd unknown /proc/30893/task/83682/root (readlink: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83682 io_contex ceph txt unknown /proc/30893/task/83682/exe (readlink: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83682 io_contex ceph NOFD /proc/30893/task/83682/fd (opendir: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83683 safe_time ceph cwd unknown /proc/30893/task/83683/cwd (readlink: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83683 safe_time ceph rtd unknown /proc/30893/task/83683/root (readlink: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83683 safe_time ceph txt unknown /proc/30893/task/83683/exe (readlink: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83683 safe_time ceph NOFD /proc/30893/task/83683/fd (opendir: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83684 safe_time ceph cwd unknown /proc/30893/task/83684/cwd (readlink: Permission denied) 2024-09-12T02:01:21.193 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83684 safe_time ceph rtd unknown /proc/30893/task/83684/root (readlink: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83684 safe_time ceph txt unknown /proc/30893/task/83684/exe (readlink: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83684 safe_time ceph NOFD /proc/30893/task/83684/fd (opendir: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83686 safe_time ceph cwd unknown /proc/30893/task/83686/cwd (readlink: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83686 safe_time ceph rtd unknown /proc/30893/task/83686/root (readlink: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83686 safe_time ceph txt unknown /proc/30893/task/83686/exe (readlink: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83686 safe_time ceph NOFD /proc/30893/task/83686/fd (opendir: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83687 fn_anonym ceph cwd unknown /proc/30893/task/83687/cwd (readlink: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83687 fn_anonym ceph rtd unknown /proc/30893/task/83687/root (readlink: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83687 fn_anonym ceph txt unknown /proc/30893/task/83687/exe (readlink: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83687 fn_anonym ceph NOFD /proc/30893/task/83687/fd (opendir: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83688 flusher ceph cwd unknown /proc/30893/task/83688/cwd (readlink: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83688 flusher ceph rtd unknown /proc/30893/task/83688/root (readlink: Permission denied) 2024-09-12T02:01:21.194 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83688 flusher ceph txt unknown /proc/30893/task/83688/exe (readlink: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83688 flusher ceph NOFD /proc/30893/task/83688/fd (opendir: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83689 safe_time ceph cwd unknown /proc/30893/task/83689/cwd (readlink: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83689 safe_time ceph rtd unknown /proc/30893/task/83689/root (readlink: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83689 safe_time ceph txt unknown /proc/30893/task/83689/exe (readlink: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 83689 safe_time ceph NOFD /proc/30893/task/83689/fd (opendir: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84402 OpHistory ceph cwd unknown /proc/30893/task/84402/cwd (readlink: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84402 OpHistory ceph rtd unknown /proc/30893/task/84402/root (readlink: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84402 OpHistory ceph txt unknown /proc/30893/task/84402/exe (readlink: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84402 OpHistory ceph NOFD /proc/30893/task/84402/fd (opendir: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84403 mgr-fin ceph cwd unknown /proc/30893/task/84403/cwd (readlink: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84403 mgr-fin ceph rtd unknown /proc/30893/task/84403/root (readlink: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84403 mgr-fin ceph txt unknown /proc/30893/task/84403/exe (readlink: Permission denied) 2024-09-12T02:01:21.195 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84403 mgr-fin ceph NOFD /proc/30893/task/84403/fd (opendir: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84404 ms_dispat ceph cwd unknown /proc/30893/task/84404/cwd (readlink: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84404 ms_dispat ceph rtd unknown /proc/30893/task/84404/root (readlink: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84404 ms_dispat ceph txt unknown /proc/30893/task/84404/exe (readlink: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84404 ms_dispat ceph NOFD /proc/30893/task/84404/fd (opendir: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84405 ms_local ceph cwd unknown /proc/30893/task/84405/cwd (readlink: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84405 ms_local ceph rtd unknown /proc/30893/task/84405/root (readlink: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84405 ms_local ceph txt unknown /proc/30893/task/84405/exe (readlink: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84405 ms_local ceph NOFD /proc/30893/task/84405/fd (opendir: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84406 safe_time ceph cwd unknown /proc/30893/task/84406/cwd (readlink: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84406 safe_time ceph rtd unknown /proc/30893/task/84406/root (readlink: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84406 safe_time ceph txt unknown /proc/30893/task/84406/exe (readlink: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84406 safe_time ceph NOFD /proc/30893/task/84406/fd (opendir: Permission denied) 2024-09-12T02:01:21.196 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84408 cmdfin ceph cwd unknown /proc/30893/task/84408/cwd (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84408 cmdfin ceph rtd unknown /proc/30893/task/84408/root (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84408 cmdfin ceph txt unknown /proc/30893/task/84408/exe (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84408 cmdfin ceph NOFD /proc/30893/task/84408/fd (opendir: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84414 io_contex ceph cwd unknown /proc/30893/task/84414/cwd (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84414 io_contex ceph rtd unknown /proc/30893/task/84414/root (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84414 io_contex ceph txt unknown /proc/30893/task/84414/exe (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84414 io_contex ceph NOFD /proc/30893/task/84414/fd (opendir: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84415 io_contex ceph cwd unknown /proc/30893/task/84415/cwd (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84415 io_contex ceph rtd unknown /proc/30893/task/84415/root (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84415 io_contex ceph txt unknown /proc/30893/task/84415/exe (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84415 io_contex ceph NOFD /proc/30893/task/84415/fd (opendir: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84416 ceph_time ceph cwd unknown /proc/30893/task/84416/cwd (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84416 ceph_time ceph rtd unknown /proc/30893/task/84416/root (readlink: Permission denied) 2024-09-12T02:01:21.197 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84416 ceph_time ceph txt unknown /proc/30893/task/84416/exe (readlink: Permission denied) 2024-09-12T02:01:21.198 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84416 ceph_time ceph NOFD /proc/30893/task/84416/fd (opendir: Permission denied) 2024-09-12T02:01:21.198 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84417 ms_dispat ceph cwd unknown /proc/30893/task/84417/cwd (readlink: Permission denied) 2024-09-12T02:01:21.198 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84417 ms_dispat ceph rtd unknown /proc/30893/task/84417/root (readlink: Permission denied) 2024-09-12T02:01:21.198 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84417 ms_dispat ceph txt unknown /proc/30893/task/84417/exe (readlink: Permission denied) 2024-09-12T02:01:21.198 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84417 ms_dispat ceph NOFD /proc/30893/task/84417/fd (opendir: Permission denied) 2024-09-12T02:01:21.198 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84418 ms_local ceph cwd unknown /proc/30893/task/84418/cwd (readlink: Permission denied) 2024-09-12T02:01:21.198 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84418 ms_local ceph rtd unknown /proc/30893/task/84418/root (readlink: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84418 ms_local ceph txt unknown /proc/30893/task/84418/exe (readlink: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84418 ms_local ceph NOFD /proc/30893/task/84418/fd (opendir: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84419 safe_time ceph cwd unknown /proc/30893/task/84419/cwd (readlink: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84419 safe_time ceph rtd unknown /proc/30893/task/84419/root (readlink: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84419 safe_time ceph txt unknown /proc/30893/task/84419/exe (readlink: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84419 safe_time ceph NOFD /proc/30893/task/84419/fd (opendir: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84421 safe_time ceph cwd unknown /proc/30893/task/84421/cwd (readlink: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84421 safe_time ceph rtd unknown /proc/30893/task/84421/root (readlink: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84421 safe_time ceph txt unknown /proc/30893/task/84421/exe (readlink: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84421 safe_time ceph NOFD /proc/30893/task/84421/fd (opendir: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84422 balancer ceph cwd unknown /proc/30893/task/84422/cwd (readlink: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84422 balancer ceph rtd unknown /proc/30893/task/84422/root (readlink: Permission denied) 2024-09-12T02:01:21.199 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84422 balancer ceph txt unknown /proc/30893/task/84422/exe (readlink: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84422 balancer ceph NOFD /proc/30893/task/84422/fd (opendir: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84424 m-fin-bal ceph cwd unknown /proc/30893/task/84424/cwd (readlink: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84424 m-fin-bal ceph rtd unknown /proc/30893/task/84424/root (readlink: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84424 m-fin-bal ceph txt unknown /proc/30893/task/84424/exe (readlink: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84424 m-fin-bal ceph NOFD /proc/30893/task/84424/fd (opendir: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84436 mgr-fin ceph cwd unknown /proc/30893/task/84436/cwd (readlink: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84436 mgr-fin ceph rtd unknown /proc/30893/task/84436/root (readlink: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84436 mgr-fin ceph txt unknown /proc/30893/task/84436/exe (readlink: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84436 mgr-fin ceph NOFD /proc/30893/task/84436/fd (opendir: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84437 mgr-fin ceph cwd unknown /proc/30893/task/84437/cwd (readlink: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84437 mgr-fin ceph rtd unknown /proc/30893/task/84437/root (readlink: Permission denied) 2024-09-12T02:01:21.200 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84437 mgr-fin ceph txt unknown /proc/30893/task/84437/exe (readlink: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84437 mgr-fin ceph NOFD /proc/30893/task/84437/fd (opendir: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84438 mgr-fin ceph cwd unknown /proc/30893/task/84438/cwd (readlink: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84438 mgr-fin ceph rtd unknown /proc/30893/task/84438/root (readlink: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84438 mgr-fin ceph txt unknown /proc/30893/task/84438/exe (readlink: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84438 mgr-fin ceph NOFD /proc/30893/task/84438/fd (opendir: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84439 mgr-fin ceph cwd unknown /proc/30893/task/84439/cwd (readlink: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84439 mgr-fin ceph rtd unknown /proc/30893/task/84439/root (readlink: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84439 mgr-fin ceph txt unknown /proc/30893/task/84439/exe (readlink: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84439 mgr-fin ceph NOFD /proc/30893/task/84439/fd (opendir: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84440 mgr-fin ceph cwd unknown /proc/30893/task/84440/cwd (readlink: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84440 mgr-fin ceph rtd unknown /proc/30893/task/84440/root (readlink: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84440 mgr-fin ceph txt unknown /proc/30893/task/84440/exe (readlink: Permission denied) 2024-09-12T02:01:21.201 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84440 mgr-fin ceph NOFD /proc/30893/task/84440/fd (opendir: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84441 mgr-fin ceph cwd unknown /proc/30893/task/84441/cwd (readlink: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84441 mgr-fin ceph rtd unknown /proc/30893/task/84441/root (readlink: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84441 mgr-fin ceph txt unknown /proc/30893/task/84441/exe (readlink: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84441 mgr-fin ceph NOFD /proc/30893/task/84441/fd (opendir: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84442 mgr-fin ceph cwd unknown /proc/30893/task/84442/cwd (readlink: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84442 mgr-fin ceph rtd unknown /proc/30893/task/84442/root (readlink: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84442 mgr-fin ceph txt unknown /proc/30893/task/84442/exe (readlink: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84442 mgr-fin ceph NOFD /proc/30893/task/84442/fd (opendir: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84443 mgr-fin ceph cwd unknown /proc/30893/task/84443/cwd (readlink: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84443 mgr-fin ceph rtd unknown /proc/30893/task/84443/root (readlink: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84443 mgr-fin ceph txt unknown /proc/30893/task/84443/exe (readlink: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84443 mgr-fin ceph NOFD /proc/30893/task/84443/fd (opendir: Permission denied) 2024-09-12T02:01:21.202 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84444 mgr-fin ceph cwd unknown /proc/30893/task/84444/cwd (readlink: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84444 mgr-fin ceph rtd unknown /proc/30893/task/84444/root (readlink: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84444 mgr-fin ceph txt unknown /proc/30893/task/84444/exe (readlink: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84444 mgr-fin ceph NOFD /proc/30893/task/84444/fd (opendir: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84445 mgr-fin ceph cwd unknown /proc/30893/task/84445/cwd (readlink: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84445 mgr-fin ceph rtd unknown /proc/30893/task/84445/root (readlink: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84445 mgr-fin ceph txt unknown /proc/30893/task/84445/exe (readlink: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84445 mgr-fin ceph NOFD /proc/30893/task/84445/fd (opendir: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84446 mgr-fin ceph cwd unknown /proc/30893/task/84446/cwd (readlink: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84446 mgr-fin ceph rtd unknown /proc/30893/task/84446/root (readlink: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84446 mgr-fin ceph txt unknown /proc/30893/task/84446/exe (readlink: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84446 mgr-fin ceph NOFD /proc/30893/task/84446/fd (opendir: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84447 mgr-fin ceph cwd unknown /proc/30893/task/84447/cwd (readlink: Permission denied) 2024-09-12T02:01:21.203 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84447 mgr-fin ceph rtd unknown /proc/30893/task/84447/root (readlink: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84447 mgr-fin ceph txt unknown /proc/30893/task/84447/exe (readlink: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84447 mgr-fin ceph NOFD /proc/30893/task/84447/fd (opendir: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84448 mgr-fin ceph cwd unknown /proc/30893/task/84448/cwd (readlink: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84448 mgr-fin ceph rtd unknown /proc/30893/task/84448/root (readlink: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84448 mgr-fin ceph txt unknown /proc/30893/task/84448/exe (readlink: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84448 mgr-fin ceph NOFD /proc/30893/task/84448/fd (opendir: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84450 mgr-fin ceph cwd unknown /proc/30893/task/84450/cwd (readlink: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84450 mgr-fin ceph rtd unknown /proc/30893/task/84450/root (readlink: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84450 mgr-fin ceph txt unknown /proc/30893/task/84450/exe (readlink: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84450 mgr-fin ceph NOFD /proc/30893/task/84450/fd (opendir: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84451 mgr-fin ceph cwd unknown /proc/30893/task/84451/cwd (readlink: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84451 mgr-fin ceph rtd unknown /proc/30893/task/84451/root (readlink: Permission denied) 2024-09-12T02:01:21.204 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84451 mgr-fin ceph txt unknown /proc/30893/task/84451/exe (readlink: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84451 mgr-fin ceph NOFD /proc/30893/task/84451/fd (opendir: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84452 cephadm ceph cwd unknown /proc/30893/task/84452/cwd (readlink: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84452 cephadm ceph rtd unknown /proc/30893/task/84452/root (readlink: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84452 cephadm ceph txt unknown /proc/30893/task/84452/exe (readlink: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84452 cephadm ceph NOFD /proc/30893/task/84452/fd (opendir: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84453 m-fin-cep ceph cwd unknown /proc/30893/task/84453/cwd (readlink: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84453 m-fin-cep ceph rtd unknown /proc/30893/task/84453/root (readlink: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84453 m-fin-cep ceph txt unknown /proc/30893/task/84453/exe (readlink: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84453 m-fin-cep ceph NOFD /proc/30893/task/84453/fd (opendir: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84454 mgr-fin ceph cwd unknown /proc/30893/task/84454/cwd (readlink: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84454 mgr-fin ceph rtd unknown /proc/30893/task/84454/root (readlink: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84454 mgr-fin ceph txt unknown /proc/30893/task/84454/exe (readlink: Permission denied) 2024-09-12T02:01:21.205 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84454 mgr-fin ceph NOFD /proc/30893/task/84454/fd (opendir: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84456 crash ceph cwd unknown /proc/30893/task/84456/cwd (readlink: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84456 crash ceph rtd unknown /proc/30893/task/84456/root (readlink: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84456 crash ceph txt unknown /proc/30893/task/84456/exe (readlink: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84456 crash ceph NOFD /proc/30893/task/84456/fd (opendir: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84457 mgr-fin ceph cwd unknown /proc/30893/task/84457/cwd (readlink: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84457 mgr-fin ceph rtd unknown /proc/30893/task/84457/root (readlink: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84457 mgr-fin ceph txt unknown /proc/30893/task/84457/exe (readlink: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84457 mgr-fin ceph NOFD /proc/30893/task/84457/fd (opendir: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84458 m-fin-cra ceph cwd unknown /proc/30893/task/84458/cwd (readlink: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84458 m-fin-cra ceph rtd unknown /proc/30893/task/84458/root (readlink: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84458 m-fin-cra ceph txt unknown /proc/30893/task/84458/exe (readlink: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84458 m-fin-cra ceph NOFD /proc/30893/task/84458/fd (opendir: Permission denied) 2024-09-12T02:01:21.206 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84459 dashboard ceph cwd unknown /proc/30893/task/84459/cwd (readlink: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84459 dashboard ceph rtd unknown /proc/30893/task/84459/root (readlink: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84459 dashboard ceph txt unknown /proc/30893/task/84459/exe (readlink: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84459 dashboard ceph NOFD /proc/30893/task/84459/fd (opendir: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84460 mgr-fin ceph cwd unknown /proc/30893/task/84460/cwd (readlink: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84460 mgr-fin ceph rtd unknown /proc/30893/task/84460/root (readlink: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84460 mgr-fin ceph txt unknown /proc/30893/task/84460/exe (readlink: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84460 mgr-fin ceph NOFD /proc/30893/task/84460/fd (opendir: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84461 m-fin-das ceph cwd unknown /proc/30893/task/84461/cwd (readlink: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84461 m-fin-das ceph rtd unknown /proc/30893/task/84461/root (readlink: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84461 m-fin-das ceph txt unknown /proc/30893/task/84461/exe (readlink: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84461 m-fin-das ceph NOFD /proc/30893/task/84461/fd (opendir: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84462 cephadm ceph cwd unknown /proc/30893/task/84462/cwd (readlink: Permission denied) 2024-09-12T02:01:21.207 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84462 cephadm ceph rtd unknown /proc/30893/task/84462/root (readlink: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84462 cephadm ceph txt unknown /proc/30893/task/84462/exe (readlink: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84462 cephadm ceph NOFD /proc/30893/task/84462/fd (opendir: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84463 mgr-fin ceph cwd unknown /proc/30893/task/84463/cwd (readlink: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84463 mgr-fin ceph rtd unknown /proc/30893/task/84463/root (readlink: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84463 mgr-fin ceph txt unknown /proc/30893/task/84463/exe (readlink: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84463 mgr-fin ceph NOFD /proc/30893/task/84463/fd (opendir: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84464 devicehea ceph cwd unknown /proc/30893/task/84464/cwd (readlink: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84464 devicehea ceph rtd unknown /proc/30893/task/84464/root (readlink: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84464 devicehea ceph txt unknown /proc/30893/task/84464/exe (readlink: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84464 devicehea ceph NOFD /proc/30893/task/84464/fd (opendir: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84465 m-fin-dev ceph cwd unknown /proc/30893/task/84465/cwd (readlink: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84465 m-fin-dev ceph rtd unknown /proc/30893/task/84465/root (readlink: Permission denied) 2024-09-12T02:01:21.208 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84465 m-fin-dev ceph txt unknown /proc/30893/task/84465/exe (readlink: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84465 m-fin-dev ceph NOFD /proc/30893/task/84465/fd (opendir: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84467 mgr-fin ceph cwd unknown /proc/30893/task/84467/cwd (readlink: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84467 mgr-fin ceph rtd unknown /proc/30893/task/84467/root (readlink: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84467 mgr-fin ceph txt unknown /proc/30893/task/84467/exe (readlink: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84467 mgr-fin ceph NOFD /proc/30893/task/84467/fd (opendir: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84468 m-fin-ios ceph cwd unknown /proc/30893/task/84468/cwd (readlink: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84468 m-fin-ios ceph rtd unknown /proc/30893/task/84468/root (readlink: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84468 m-fin-ios ceph txt unknown /proc/30893/task/84468/exe (readlink: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84468 m-fin-ios ceph NOFD /proc/30893/task/84468/fd (opendir: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84470 m-fin-nfs ceph cwd unknown /proc/30893/task/84470/cwd (readlink: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84470 m-fin-nfs ceph rtd unknown /proc/30893/task/84470/root (readlink: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84470 m-fin-nfs ceph txt unknown /proc/30893/task/84470/exe (readlink: Permission denied) 2024-09-12T02:01:21.209 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84470 m-fin-nfs ceph NOFD /proc/30893/task/84470/fd (opendir: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84471 mgr-fin ceph cwd unknown /proc/30893/task/84471/cwd (readlink: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84471 mgr-fin ceph rtd unknown /proc/30893/task/84471/root (readlink: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84471 mgr-fin ceph txt unknown /proc/30893/task/84471/exe (readlink: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84471 mgr-fin ceph NOFD /proc/30893/task/84471/fd (opendir: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84473 m-fin-orc ceph cwd unknown /proc/30893/task/84473/cwd (readlink: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84473 m-fin-orc ceph rtd unknown /proc/30893/task/84473/root (readlink: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84473 m-fin-orc ceph txt unknown /proc/30893/task/84473/exe (readlink: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84473 m-fin-orc ceph NOFD /proc/30893/task/84473/fd (opendir: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84474 mgr-fin ceph cwd unknown /proc/30893/task/84474/cwd (readlink: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84474 mgr-fin ceph rtd unknown /proc/30893/task/84474/root (readlink: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84474 mgr-fin ceph txt unknown /proc/30893/task/84474/exe (readlink: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84474 mgr-fin ceph NOFD /proc/30893/task/84474/fd (opendir: Permission denied) 2024-09-12T02:01:21.210 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84475 pg_autosc ceph cwd unknown /proc/30893/task/84475/cwd (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84475 pg_autosc ceph rtd unknown /proc/30893/task/84475/root (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84475 pg_autosc ceph txt unknown /proc/30893/task/84475/exe (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84475 pg_autosc ceph NOFD /proc/30893/task/84475/fd (opendir: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84476 m-fin-pg_ ceph cwd unknown /proc/30893/task/84476/cwd (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84476 m-fin-pg_ ceph rtd unknown /proc/30893/task/84476/root (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84476 m-fin-pg_ ceph txt unknown /proc/30893/task/84476/exe (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84476 m-fin-pg_ ceph NOFD /proc/30893/task/84476/fd (opendir: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84477 mgr-fin ceph cwd unknown /proc/30893/task/84477/cwd (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84477 mgr-fin ceph rtd unknown /proc/30893/task/84477/root (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84477 mgr-fin ceph txt unknown /proc/30893/task/84477/exe (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84477 mgr-fin ceph NOFD /proc/30893/task/84477/fd (opendir: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84478 progress ceph cwd unknown /proc/30893/task/84478/cwd (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84478 progress ceph rtd unknown /proc/30893/task/84478/root (readlink: Permission denied) 2024-09-12T02:01:21.211 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84478 progress ceph txt unknown /proc/30893/task/84478/exe (readlink: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84478 progress ceph NOFD /proc/30893/task/84478/fd (opendir: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84479 mgr-fin ceph cwd unknown /proc/30893/task/84479/cwd (readlink: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84479 mgr-fin ceph rtd unknown /proc/30893/task/84479/root (readlink: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84479 mgr-fin ceph txt unknown /proc/30893/task/84479/exe (readlink: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84479 mgr-fin ceph NOFD /proc/30893/task/84479/fd (opendir: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84480 m-fin-pro ceph cwd unknown /proc/30893/task/84480/cwd (readlink: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84480 m-fin-pro ceph rtd unknown /proc/30893/task/84480/root (readlink: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84480 m-fin-pro ceph txt unknown /proc/30893/task/84480/exe (readlink: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84480 m-fin-pro ceph NOFD /proc/30893/task/84480/fd (opendir: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84481 mgr-fin ceph cwd unknown /proc/30893/task/84481/cwd (readlink: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84481 mgr-fin ceph rtd unknown /proc/30893/task/84481/root (readlink: Permission denied) 2024-09-12T02:01:21.212 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84481 mgr-fin ceph txt unknown /proc/30893/task/84481/exe (readlink: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84481 mgr-fin ceph NOFD /proc/30893/task/84481/fd (opendir: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84482 mgr-fin ceph cwd unknown /proc/30893/task/84482/cwd (readlink: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84482 mgr-fin ceph rtd unknown /proc/30893/task/84482/root (readlink: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84482 mgr-fin ceph txt unknown /proc/30893/task/84482/exe (readlink: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84482 mgr-fin ceph NOFD /proc/30893/task/84482/fd (opendir: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84483 cephadm ceph cwd unknown /proc/30893/task/84483/cwd (readlink: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84483 cephadm ceph rtd unknown /proc/30893/task/84483/root (readlink: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84483 cephadm ceph txt unknown /proc/30893/task/84483/exe (readlink: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84483 cephadm ceph NOFD /proc/30893/task/84483/fd (opendir: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84484 mgr-fin ceph cwd unknown /proc/30893/task/84484/cwd (readlink: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84484 mgr-fin ceph rtd unknown /proc/30893/task/84484/root (readlink: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84484 mgr-fin ceph txt unknown /proc/30893/task/84484/exe (readlink: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84484 mgr-fin ceph NOFD /proc/30893/task/84484/fd (opendir: Permission denied) 2024-09-12T02:01:21.213 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84485 mgr-fin ceph cwd unknown /proc/30893/task/84485/cwd (readlink: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84485 mgr-fin ceph rtd unknown /proc/30893/task/84485/root (readlink: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84485 mgr-fin ceph txt unknown /proc/30893/task/84485/exe (readlink: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84485 mgr-fin ceph NOFD /proc/30893/task/84485/fd (opendir: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84489 cephadm ceph cwd unknown /proc/30893/task/84489/cwd (readlink: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84489 cephadm ceph rtd unknown /proc/30893/task/84489/root (readlink: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84489 cephadm ceph txt unknown /proc/30893/task/84489/exe (readlink: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84489 cephadm ceph NOFD /proc/30893/task/84489/fd (opendir: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84490 io_contex ceph cwd unknown /proc/30893/task/84490/cwd (readlink: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84490 io_contex ceph rtd unknown /proc/30893/task/84490/root (readlink: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84490 io_contex ceph txt unknown /proc/30893/task/84490/exe (readlink: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84490 io_contex ceph NOFD /proc/30893/task/84490/fd (opendir: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84491 io_contex ceph cwd unknown /proc/30893/task/84491/cwd (readlink: Permission denied) 2024-09-12T02:01:21.214 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84491 io_contex ceph rtd unknown /proc/30893/task/84491/root (readlink: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84491 io_contex ceph txt unknown /proc/30893/task/84491/exe (readlink: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84491 io_contex ceph NOFD /proc/30893/task/84491/fd (opendir: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84492 ceph_time ceph cwd unknown /proc/30893/task/84492/cwd (readlink: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84492 ceph_time ceph rtd unknown /proc/30893/task/84492/root (readlink: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84492 ceph_time ceph txt unknown /proc/30893/task/84492/exe (readlink: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84492 ceph_time ceph NOFD /proc/30893/task/84492/fd (opendir: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84493 ms_dispat ceph cwd unknown /proc/30893/task/84493/cwd (readlink: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84493 ms_dispat ceph rtd unknown /proc/30893/task/84493/root (readlink: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84493 ms_dispat ceph txt unknown /proc/30893/task/84493/exe (readlink: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84493 ms_dispat ceph NOFD /proc/30893/task/84493/fd (opendir: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84494 ms_local ceph cwd unknown /proc/30893/task/84494/cwd (readlink: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84494 ms_local ceph rtd unknown /proc/30893/task/84494/root (readlink: Permission denied) 2024-09-12T02:01:21.215 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84494 ms_local ceph txt unknown /proc/30893/task/84494/exe (readlink: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84494 ms_local ceph NOFD /proc/30893/task/84494/fd (opendir: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84495 cephadm ceph cwd unknown /proc/30893/task/84495/cwd (readlink: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84495 cephadm ceph rtd unknown /proc/30893/task/84495/root (readlink: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84495 cephadm ceph txt unknown /proc/30893/task/84495/exe (readlink: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84495 cephadm ceph NOFD /proc/30893/task/84495/fd (opendir: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84496 safe_time ceph cwd unknown /proc/30893/task/84496/cwd (readlink: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84496 safe_time ceph rtd unknown /proc/30893/task/84496/root (readlink: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84496 safe_time ceph txt unknown /proc/30893/task/84496/exe (readlink: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84496 safe_time ceph NOFD /proc/30893/task/84496/fd (opendir: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84497 safe_time ceph cwd unknown /proc/30893/task/84497/cwd (readlink: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84497 safe_time ceph rtd unknown /proc/30893/task/84497/root (readlink: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84497 safe_time ceph txt unknown /proc/30893/task/84497/exe (readlink: Permission denied) 2024-09-12T02:01:21.216 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84497 safe_time ceph NOFD /proc/30893/task/84497/fd (opendir: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84498 mgr-fin ceph cwd unknown /proc/30893/task/84498/cwd (readlink: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84498 mgr-fin ceph rtd unknown /proc/30893/task/84498/root (readlink: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84498 mgr-fin ceph txt unknown /proc/30893/task/84498/exe (readlink: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84498 mgr-fin ceph NOFD /proc/30893/task/84498/fd (opendir: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84500 m-fin-rbd ceph cwd unknown /proc/30893/task/84500/cwd (readlink: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84500 m-fin-rbd ceph rtd unknown /proc/30893/task/84500/root (readlink: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84500 m-fin-rbd ceph txt unknown /proc/30893/task/84500/exe (readlink: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84500 m-fin-rbd ceph NOFD /proc/30893/task/84500/fd (opendir: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84501 restful ceph cwd unknown /proc/30893/task/84501/cwd (readlink: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84501 restful ceph rtd unknown /proc/30893/task/84501/root (readlink: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84501 restful ceph txt unknown /proc/30893/task/84501/exe (readlink: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84501 restful ceph NOFD /proc/30893/task/84501/fd (opendir: Permission denied) 2024-09-12T02:01:21.217 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84502 m-fin-res ceph cwd unknown /proc/30893/task/84502/cwd (readlink: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84502 m-fin-res ceph rtd unknown /proc/30893/task/84502/root (readlink: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84502 m-fin-res ceph txt unknown /proc/30893/task/84502/exe (readlink: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84502 m-fin-res ceph NOFD /proc/30893/task/84502/fd (opendir: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84503 mgr-fin ceph cwd unknown /proc/30893/task/84503/cwd (readlink: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84503 mgr-fin ceph rtd unknown /proc/30893/task/84503/root (readlink: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84503 mgr-fin ceph txt unknown /proc/30893/task/84503/exe (readlink: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84503 mgr-fin ceph NOFD /proc/30893/task/84503/fd (opendir: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84504 mgr-fin ceph cwd unknown /proc/30893/task/84504/cwd (readlink: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84504 mgr-fin ceph rtd unknown /proc/30893/task/84504/root (readlink: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84504 mgr-fin ceph txt unknown /proc/30893/task/84504/exe (readlink: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84504 mgr-fin ceph NOFD /proc/30893/task/84504/fd (opendir: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84505 mgr-fin ceph cwd unknown /proc/30893/task/84505/cwd (readlink: Permission denied) 2024-09-12T02:01:21.218 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84505 mgr-fin ceph rtd unknown /proc/30893/task/84505/root (readlink: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84505 mgr-fin ceph txt unknown /proc/30893/task/84505/exe (readlink: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84505 mgr-fin ceph NOFD /proc/30893/task/84505/fd (opendir: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84506 mgr-fin ceph cwd unknown /proc/30893/task/84506/cwd (readlink: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84506 mgr-fin ceph rtd unknown /proc/30893/task/84506/root (readlink: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84506 mgr-fin ceph txt unknown /proc/30893/task/84506/exe (readlink: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84506 mgr-fin ceph NOFD /proc/30893/task/84506/fd (opendir: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84507 mgr-fin ceph cwd unknown /proc/30893/task/84507/cwd (readlink: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84507 mgr-fin ceph rtd unknown /proc/30893/task/84507/root (readlink: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84507 mgr-fin ceph txt unknown /proc/30893/task/84507/exe (readlink: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84507 mgr-fin ceph NOFD /proc/30893/task/84507/fd (opendir: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84508 mgr-fin ceph cwd unknown /proc/30893/task/84508/cwd (readlink: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84508 mgr-fin ceph rtd unknown /proc/30893/task/84508/root (readlink: Permission denied) 2024-09-12T02:01:21.219 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84508 mgr-fin ceph txt unknown /proc/30893/task/84508/exe (readlink: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84508 mgr-fin ceph NOFD /proc/30893/task/84508/fd (opendir: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84512 io_contex ceph cwd unknown /proc/30893/task/84512/cwd (readlink: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84512 io_contex ceph rtd unknown /proc/30893/task/84512/root (readlink: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84512 io_contex ceph txt unknown /proc/30893/task/84512/exe (readlink: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84512 io_contex ceph NOFD /proc/30893/task/84512/fd (opendir: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84513 io_contex ceph cwd unknown /proc/30893/task/84513/cwd (readlink: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84513 io_contex ceph rtd unknown /proc/30893/task/84513/root (readlink: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84513 io_contex ceph txt unknown /proc/30893/task/84513/exe (readlink: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84513 io_contex ceph NOFD /proc/30893/task/84513/fd (opendir: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84514 ceph_time ceph cwd unknown /proc/30893/task/84514/cwd (readlink: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84514 ceph_time ceph rtd unknown /proc/30893/task/84514/root (readlink: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84514 ceph_time ceph txt unknown /proc/30893/task/84514/exe (readlink: Permission denied) 2024-09-12T02:01:21.220 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84514 ceph_time ceph NOFD /proc/30893/task/84514/fd (opendir: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84515 ms_dispat ceph cwd unknown /proc/30893/task/84515/cwd (readlink: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84515 ms_dispat ceph rtd unknown /proc/30893/task/84515/root (readlink: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84515 ms_dispat ceph txt unknown /proc/30893/task/84515/exe (readlink: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84515 ms_dispat ceph NOFD /proc/30893/task/84515/fd (opendir: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84516 ms_local ceph cwd unknown /proc/30893/task/84516/cwd (readlink: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84516 ms_local ceph rtd unknown /proc/30893/task/84516/root (readlink: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84516 ms_local ceph txt unknown /proc/30893/task/84516/exe (readlink: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84516 ms_local ceph NOFD /proc/30893/task/84516/fd (opendir: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84517 safe_time ceph cwd unknown /proc/30893/task/84517/cwd (readlink: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84517 safe_time ceph rtd unknown /proc/30893/task/84517/root (readlink: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84517 safe_time ceph txt unknown /proc/30893/task/84517/exe (readlink: Permission denied) 2024-09-12T02:01:21.221 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84517 safe_time ceph NOFD /proc/30893/task/84517/fd (opendir: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84518 safe_time ceph cwd unknown /proc/30893/task/84518/cwd (readlink: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84518 safe_time ceph rtd unknown /proc/30893/task/84518/root (readlink: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84518 safe_time ceph txt unknown /proc/30893/task/84518/exe (readlink: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84518 safe_time ceph NOFD /proc/30893/task/84518/fd (opendir: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84539 m-fin-sna ceph cwd unknown /proc/30893/task/84539/cwd (readlink: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84539 m-fin-sna ceph rtd unknown /proc/30893/task/84539/root (readlink: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84539 m-fin-sna ceph txt unknown /proc/30893/task/84539/exe (readlink: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84539 m-fin-sna ceph NOFD /proc/30893/task/84539/fd (opendir: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84541 m-fin-sta ceph cwd unknown /proc/30893/task/84541/cwd (readlink: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84541 m-fin-sta ceph rtd unknown /proc/30893/task/84541/root (readlink: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84541 m-fin-sta ceph txt unknown /proc/30893/task/84541/exe (readlink: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84541 m-fin-sta ceph NOFD /proc/30893/task/84541/fd (opendir: Permission denied) 2024-09-12T02:01:21.222 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84542 telemetry ceph cwd unknown /proc/30893/task/84542/cwd (readlink: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84542 telemetry ceph rtd unknown /proc/30893/task/84542/root (readlink: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84542 telemetry ceph txt unknown /proc/30893/task/84542/exe (readlink: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84542 telemetry ceph NOFD /proc/30893/task/84542/fd (opendir: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84543 m-fin-tel ceph cwd unknown /proc/30893/task/84543/cwd (readlink: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84543 m-fin-tel ceph rtd unknown /proc/30893/task/84543/root (readlink: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84543 m-fin-tel ceph txt unknown /proc/30893/task/84543/exe (readlink: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84543 m-fin-tel ceph NOFD /proc/30893/task/84543/fd (opendir: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84544 mgr-fin ceph cwd unknown /proc/30893/task/84544/cwd (readlink: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84544 mgr-fin ceph rtd unknown /proc/30893/task/84544/root (readlink: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84544 mgr-fin ceph txt unknown /proc/30893/task/84544/exe (readlink: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84544 mgr-fin ceph NOFD /proc/30893/task/84544/fd (opendir: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84548 io_contex ceph cwd unknown /proc/30893/task/84548/cwd (readlink: Permission denied) 2024-09-12T02:01:21.223 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84548 io_contex ceph rtd unknown /proc/30893/task/84548/root (readlink: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84548 io_contex ceph txt unknown /proc/30893/task/84548/exe (readlink: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84548 io_contex ceph NOFD /proc/30893/task/84548/fd (opendir: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84549 io_contex ceph cwd unknown /proc/30893/task/84549/cwd (readlink: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84549 io_contex ceph rtd unknown /proc/30893/task/84549/root (readlink: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84549 io_contex ceph txt unknown /proc/30893/task/84549/exe (readlink: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84549 io_contex ceph NOFD /proc/30893/task/84549/fd (opendir: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84550 ceph_time ceph cwd unknown /proc/30893/task/84550/cwd (readlink: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84550 ceph_time ceph rtd unknown /proc/30893/task/84550/root (readlink: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84550 ceph_time ceph txt unknown /proc/30893/task/84550/exe (readlink: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84550 ceph_time ceph NOFD /proc/30893/task/84550/fd (opendir: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84551 ms_dispat ceph cwd unknown /proc/30893/task/84551/cwd (readlink: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84551 ms_dispat ceph rtd unknown /proc/30893/task/84551/root (readlink: Permission denied) 2024-09-12T02:01:21.224 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84551 ms_dispat ceph txt unknown /proc/30893/task/84551/exe (readlink: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84551 ms_dispat ceph NOFD /proc/30893/task/84551/fd (opendir: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84552 ms_local ceph cwd unknown /proc/30893/task/84552/cwd (readlink: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84552 ms_local ceph rtd unknown /proc/30893/task/84552/root (readlink: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84552 ms_local ceph txt unknown /proc/30893/task/84552/exe (readlink: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84552 ms_local ceph NOFD /proc/30893/task/84552/fd (opendir: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84553 safe_time ceph cwd unknown /proc/30893/task/84553/cwd (readlink: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84553 safe_time ceph rtd unknown /proc/30893/task/84553/root (readlink: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84553 safe_time ceph txt unknown /proc/30893/task/84553/exe (readlink: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84553 safe_time ceph NOFD /proc/30893/task/84553/fd (opendir: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84554 safe_time ceph cwd unknown /proc/30893/task/84554/cwd (readlink: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84554 safe_time ceph rtd unknown /proc/30893/task/84554/root (readlink: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84554 safe_time ceph txt unknown /proc/30893/task/84554/exe (readlink: Permission denied) 2024-09-12T02:01:21.225 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84554 safe_time ceph NOFD /proc/30893/task/84554/fd (opendir: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84555 mgr-fin ceph cwd unknown /proc/30893/task/84555/cwd (readlink: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84555 mgr-fin ceph rtd unknown /proc/30893/task/84555/root (readlink: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84555 mgr-fin ceph txt unknown /proc/30893/task/84555/exe (readlink: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84555 mgr-fin ceph NOFD /proc/30893/task/84555/fd (opendir: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84556 mgr-fin ceph cwd unknown /proc/30893/task/84556/cwd (readlink: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84556 mgr-fin ceph rtd unknown /proc/30893/task/84556/root (readlink: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84556 mgr-fin ceph txt unknown /proc/30893/task/84556/exe (readlink: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84556 mgr-fin ceph NOFD /proc/30893/task/84556/fd (opendir: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84557 mgr-fin ceph cwd unknown /proc/30893/task/84557/cwd (readlink: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84557 mgr-fin ceph rtd unknown /proc/30893/task/84557/root (readlink: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84557 mgr-fin ceph txt unknown /proc/30893/task/84557/exe (readlink: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84557 mgr-fin ceph NOFD /proc/30893/task/84557/fd (opendir: Permission denied) 2024-09-12T02:01:21.226 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84558 mgr-fin ceph cwd unknown /proc/30893/task/84558/cwd (readlink: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84558 mgr-fin ceph rtd unknown /proc/30893/task/84558/root (readlink: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84558 mgr-fin ceph txt unknown /proc/30893/task/84558/exe (readlink: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84558 mgr-fin ceph NOFD /proc/30893/task/84558/fd (opendir: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84559 mgr-fin ceph cwd unknown /proc/30893/task/84559/cwd (readlink: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84559 mgr-fin ceph rtd unknown /proc/30893/task/84559/root (readlink: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84559 mgr-fin ceph txt unknown /proc/30893/task/84559/exe (readlink: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84559 mgr-fin ceph NOFD /proc/30893/task/84559/fd (opendir: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84560 mgr-fin ceph cwd unknown /proc/30893/task/84560/cwd (readlink: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84560 mgr-fin ceph rtd unknown /proc/30893/task/84560/root (readlink: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84560 mgr-fin ceph txt unknown /proc/30893/task/84560/exe (readlink: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84560 mgr-fin ceph NOFD /proc/30893/task/84560/fd (opendir: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84561 mgr-fin ceph cwd unknown /proc/30893/task/84561/cwd (readlink: Permission denied) 2024-09-12T02:01:21.227 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84561 mgr-fin ceph rtd unknown /proc/30893/task/84561/root (readlink: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84561 mgr-fin ceph txt unknown /proc/30893/task/84561/exe (readlink: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84561 mgr-fin ceph NOFD /proc/30893/task/84561/fd (opendir: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84562 mgr-fin ceph cwd unknown /proc/30893/task/84562/cwd (readlink: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84562 mgr-fin ceph rtd unknown /proc/30893/task/84562/root (readlink: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84562 mgr-fin ceph txt unknown /proc/30893/task/84562/exe (readlink: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84562 mgr-fin ceph NOFD /proc/30893/task/84562/fd (opendir: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84563 mgr-fin ceph cwd unknown /proc/30893/task/84563/cwd (readlink: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84563 mgr-fin ceph rtd unknown /proc/30893/task/84563/root (readlink: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84563 mgr-fin ceph txt unknown /proc/30893/task/84563/exe (readlink: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84563 mgr-fin ceph NOFD /proc/30893/task/84563/fd (opendir: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84564 mgr-fin ceph cwd unknown /proc/30893/task/84564/cwd (readlink: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84564 mgr-fin ceph rtd unknown /proc/30893/task/84564/root (readlink: Permission denied) 2024-09-12T02:01:21.228 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84564 mgr-fin ceph txt unknown /proc/30893/task/84564/exe (readlink: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84564 mgr-fin ceph NOFD /proc/30893/task/84564/fd (opendir: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84565 mgr-fin ceph cwd unknown /proc/30893/task/84565/cwd (readlink: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84565 mgr-fin ceph rtd unknown /proc/30893/task/84565/root (readlink: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84565 mgr-fin ceph txt unknown /proc/30893/task/84565/exe (readlink: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84565 mgr-fin ceph NOFD /proc/30893/task/84565/fd (opendir: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84566 mgr-fin ceph cwd unknown /proc/30893/task/84566/cwd (readlink: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84566 mgr-fin ceph rtd unknown /proc/30893/task/84566/root (readlink: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84566 mgr-fin ceph txt unknown /proc/30893/task/84566/exe (readlink: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84566 mgr-fin ceph NOFD /proc/30893/task/84566/fd (opendir: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84568 m-fin-vol ceph cwd unknown /proc/30893/task/84568/cwd (readlink: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84568 m-fin-vol ceph rtd unknown /proc/30893/task/84568/root (readlink: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84568 m-fin-vol ceph txt unknown /proc/30893/task/84568/exe (readlink: Permission denied) 2024-09-12T02:01:21.229 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84568 m-fin-vol ceph NOFD /proc/30893/task/84568/fd (opendir: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84569 io_contex ceph cwd unknown /proc/30893/task/84569/cwd (readlink: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84569 io_contex ceph rtd unknown /proc/30893/task/84569/root (readlink: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84569 io_contex ceph txt unknown /proc/30893/task/84569/exe (readlink: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84569 io_contex ceph NOFD /proc/30893/task/84569/fd (opendir: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84570 io_contex ceph cwd unknown /proc/30893/task/84570/cwd (readlink: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84570 io_contex ceph rtd unknown /proc/30893/task/84570/root (readlink: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84570 io_contex ceph txt unknown /proc/30893/task/84570/exe (readlink: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84570 io_contex ceph NOFD /proc/30893/task/84570/fd (opendir: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84599 dashboard ceph cwd unknown /proc/30893/task/84599/cwd (readlink: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84599 dashboard ceph rtd unknown /proc/30893/task/84599/root (readlink: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84599 dashboard ceph txt unknown /proc/30893/task/84599/exe (readlink: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84599 dashboard ceph NOFD /proc/30893/task/84599/fd (opendir: Permission denied) 2024-09-12T02:01:21.230 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84600 dashboard ceph cwd unknown /proc/30893/task/84600/cwd (readlink: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84600 dashboard ceph rtd unknown /proc/30893/task/84600/root (readlink: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84600 dashboard ceph txt unknown /proc/30893/task/84600/exe (readlink: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84600 dashboard ceph NOFD /proc/30893/task/84600/fd (opendir: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84601 dashboard ceph cwd unknown /proc/30893/task/84601/cwd (readlink: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84601 dashboard ceph rtd unknown /proc/30893/task/84601/root (readlink: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84601 dashboard ceph txt unknown /proc/30893/task/84601/exe (readlink: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84601 dashboard ceph NOFD /proc/30893/task/84601/fd (opendir: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84602 dashboard ceph cwd unknown /proc/30893/task/84602/cwd (readlink: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84602 dashboard ceph rtd unknown /proc/30893/task/84602/root (readlink: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84602 dashboard ceph txt unknown /proc/30893/task/84602/exe (readlink: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84602 dashboard ceph NOFD /proc/30893/task/84602/fd (opendir: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84603 dashboard ceph cwd unknown /proc/30893/task/84603/cwd (readlink: Permission denied) 2024-09-12T02:01:21.231 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84603 dashboard ceph rtd unknown /proc/30893/task/84603/root (readlink: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84603 dashboard ceph txt unknown /proc/30893/task/84603/exe (readlink: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84603 dashboard ceph NOFD /proc/30893/task/84603/fd (opendir: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84604 dashboard ceph cwd unknown /proc/30893/task/84604/cwd (readlink: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84604 dashboard ceph rtd unknown /proc/30893/task/84604/root (readlink: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84604 dashboard ceph txt unknown /proc/30893/task/84604/exe (readlink: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84604 dashboard ceph NOFD /proc/30893/task/84604/fd (opendir: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84605 dashboard ceph cwd unknown /proc/30893/task/84605/cwd (readlink: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84605 dashboard ceph rtd unknown /proc/30893/task/84605/root (readlink: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84605 dashboard ceph txt unknown /proc/30893/task/84605/exe (readlink: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84605 dashboard ceph NOFD /proc/30893/task/84605/fd (opendir: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84606 dashboard ceph cwd unknown /proc/30893/task/84606/cwd (readlink: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84606 dashboard ceph rtd unknown /proc/30893/task/84606/root (readlink: Permission denied) 2024-09-12T02:01:21.232 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84606 dashboard ceph txt unknown /proc/30893/task/84606/exe (readlink: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84606 dashboard ceph NOFD /proc/30893/task/84606/fd (opendir: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84607 dashboard ceph cwd unknown /proc/30893/task/84607/cwd (readlink: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84607 dashboard ceph rtd unknown /proc/30893/task/84607/root (readlink: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84607 dashboard ceph txt unknown /proc/30893/task/84607/exe (readlink: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84607 dashboard ceph NOFD /proc/30893/task/84607/fd (opendir: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84608 dashboard ceph cwd unknown /proc/30893/task/84608/cwd (readlink: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84608 dashboard ceph rtd unknown /proc/30893/task/84608/root (readlink: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84608 dashboard ceph txt unknown /proc/30893/task/84608/exe (readlink: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84608 dashboard ceph NOFD /proc/30893/task/84608/fd (opendir: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84609 dashboard ceph cwd unknown /proc/30893/task/84609/cwd (readlink: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84609 dashboard ceph rtd unknown /proc/30893/task/84609/root (readlink: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84609 dashboard ceph txt unknown /proc/30893/task/84609/exe (readlink: Permission denied) 2024-09-12T02:01:21.233 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84609 dashboard ceph NOFD /proc/30893/task/84609/fd (opendir: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84616 dashboard ceph cwd unknown /proc/30893/task/84616/cwd (readlink: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84616 dashboard ceph rtd unknown /proc/30893/task/84616/root (readlink: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84616 dashboard ceph txt unknown /proc/30893/task/84616/exe (readlink: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84616 dashboard ceph NOFD /proc/30893/task/84616/fd (opendir: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84860 devicehea ceph cwd unknown /proc/30893/task/84860/cwd (readlink: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84860 devicehea ceph rtd unknown /proc/30893/task/84860/root (readlink: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84860 devicehea ceph txt unknown /proc/30893/task/84860/exe (readlink: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84860 devicehea ceph NOFD /proc/30893/task/84860/fd (opendir: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84874 io_contex ceph cwd unknown /proc/30893/task/84874/cwd (readlink: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84874 io_contex ceph rtd unknown /proc/30893/task/84874/root (readlink: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84874 io_contex ceph txt unknown /proc/30893/task/84874/exe (readlink: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84874 io_contex ceph NOFD /proc/30893/task/84874/fd (opendir: Permission denied) 2024-09-12T02:01:21.234 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84875 io_contex ceph cwd unknown /proc/30893/task/84875/cwd (readlink: Permission denied) 2024-09-12T02:01:21.235 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84875 io_contex ceph rtd unknown /proc/30893/task/84875/root (readlink: Permission denied) 2024-09-12T02:01:21.235 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84875 io_contex ceph txt unknown /proc/30893/task/84875/exe (readlink: Permission denied) 2024-09-12T02:01:21.235 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84875 io_contex ceph NOFD /proc/30893/task/84875/fd (opendir: Permission denied) 2024-09-12T02:01:21.235 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84876 ceph_time ceph cwd unknown /proc/30893/task/84876/cwd (readlink: Permission denied) 2024-09-12T02:01:21.235 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84876 ceph_time ceph rtd unknown /proc/30893/task/84876/root (readlink: Permission denied) 2024-09-12T02:01:21.235 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84876 ceph_time ceph txt unknown /proc/30893/task/84876/exe (readlink: Permission denied) 2024-09-12T02:01:21.235 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84876 ceph_time ceph NOFD /proc/30893/task/84876/fd (opendir: Permission denied) 2024-09-12T02:01:21.235 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84877 ms_dispat ceph cwd unknown /proc/30893/task/84877/cwd (readlink: Permission denied) 2024-09-12T02:01:21.235 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84877 ms_dispat ceph rtd unknown /proc/30893/task/84877/root (readlink: Permission denied) 2024-09-12T02:01:21.235 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84877 ms_dispat ceph txt unknown /proc/30893/task/84877/exe (readlink: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84877 ms_dispat ceph NOFD /proc/30893/task/84877/fd (opendir: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84878 ms_local ceph cwd unknown /proc/30893/task/84878/cwd (readlink: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84878 ms_local ceph rtd unknown /proc/30893/task/84878/root (readlink: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84878 ms_local ceph txt unknown /proc/30893/task/84878/exe (readlink: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84878 ms_local ceph NOFD /proc/30893/task/84878/fd (opendir: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84879 safe_time ceph cwd unknown /proc/30893/task/84879/cwd (readlink: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84879 safe_time ceph rtd unknown /proc/30893/task/84879/root (readlink: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84879 safe_time ceph txt unknown /proc/30893/task/84879/exe (readlink: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84879 safe_time ceph NOFD /proc/30893/task/84879/fd (opendir: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84880 safe_time ceph cwd unknown /proc/30893/task/84880/cwd (readlink: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84880 safe_time ceph rtd unknown /proc/30893/task/84880/root (readlink: Permission denied) 2024-09-12T02:01:21.236 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84880 safe_time ceph txt unknown /proc/30893/task/84880/exe (readlink: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84880 safe_time ceph NOFD /proc/30893/task/84880/fd (opendir: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84937 mgr-fin ceph cwd unknown /proc/30893/task/84937/cwd (readlink: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84937 mgr-fin ceph rtd unknown /proc/30893/task/84937/root (readlink: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84937 mgr-fin ceph txt unknown /proc/30893/task/84937/exe (readlink: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84937 mgr-fin ceph NOFD /proc/30893/task/84937/fd (opendir: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84938 mgr-fin ceph cwd unknown /proc/30893/task/84938/cwd (readlink: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84938 mgr-fin ceph rtd unknown /proc/30893/task/84938/root (readlink: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84938 mgr-fin ceph txt unknown /proc/30893/task/84938/exe (readlink: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84938 mgr-fin ceph NOFD /proc/30893/task/84938/fd (opendir: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84939 mgr-fin ceph cwd unknown /proc/30893/task/84939/cwd (readlink: Permission denied) 2024-09-12T02:01:21.237 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84939 mgr-fin ceph rtd unknown /proc/30893/task/84939/root (readlink: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84939 mgr-fin ceph txt unknown /proc/30893/task/84939/exe (readlink: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84939 mgr-fin ceph NOFD /proc/30893/task/84939/fd (opendir: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84940 mgr-fin ceph cwd unknown /proc/30893/task/84940/cwd (readlink: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84940 mgr-fin ceph rtd unknown /proc/30893/task/84940/root (readlink: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84940 mgr-fin ceph txt unknown /proc/30893/task/84940/exe (readlink: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84940 mgr-fin ceph NOFD /proc/30893/task/84940/fd (opendir: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84941 mgr-fin ceph cwd unknown /proc/30893/task/84941/cwd (readlink: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84941 mgr-fin ceph rtd unknown /proc/30893/task/84941/root (readlink: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84941 mgr-fin ceph txt unknown /proc/30893/task/84941/exe (readlink: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84941 mgr-fin ceph NOFD /proc/30893/task/84941/fd (opendir: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84942 mgr-fin ceph cwd unknown /proc/30893/task/84942/cwd (readlink: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84942 mgr-fin ceph rtd unknown /proc/30893/task/84942/root (readlink: Permission denied) 2024-09-12T02:01:21.238 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84942 mgr-fin ceph txt unknown /proc/30893/task/84942/exe (readlink: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84942 mgr-fin ceph NOFD /proc/30893/task/84942/fd (opendir: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84943 mgr-fin ceph cwd unknown /proc/30893/task/84943/cwd (readlink: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84943 mgr-fin ceph rtd unknown /proc/30893/task/84943/root (readlink: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84943 mgr-fin ceph txt unknown /proc/30893/task/84943/exe (readlink: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84943 mgr-fin ceph NOFD /proc/30893/task/84943/fd (opendir: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84944 mgr-fin ceph cwd unknown /proc/30893/task/84944/cwd (readlink: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84944 mgr-fin ceph rtd unknown /proc/30893/task/84944/root (readlink: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84944 mgr-fin ceph txt unknown /proc/30893/task/84944/exe (readlink: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84944 mgr-fin ceph NOFD /proc/30893/task/84944/fd (opendir: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84945 mgr-fin ceph cwd unknown /proc/30893/task/84945/cwd (readlink: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84945 mgr-fin ceph rtd unknown /proc/30893/task/84945/root (readlink: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84945 mgr-fin ceph txt unknown /proc/30893/task/84945/exe (readlink: Permission denied) 2024-09-12T02:01:21.239 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84945 mgr-fin ceph NOFD /proc/30893/task/84945/fd (opendir: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84946 mgr-fin ceph cwd unknown /proc/30893/task/84946/cwd (readlink: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84946 mgr-fin ceph rtd unknown /proc/30893/task/84946/root (readlink: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84946 mgr-fin ceph txt unknown /proc/30893/task/84946/exe (readlink: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84946 mgr-fin ceph NOFD /proc/30893/task/84946/fd (opendir: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84947 mgr-fin ceph cwd unknown /proc/30893/task/84947/cwd (readlink: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84947 mgr-fin ceph rtd unknown /proc/30893/task/84947/root (readlink: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84947 mgr-fin ceph txt unknown /proc/30893/task/84947/exe (readlink: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84947 mgr-fin ceph NOFD /proc/30893/task/84947/fd (opendir: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84974 mgr-fin ceph cwd unknown /proc/30893/task/84974/cwd (readlink: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84974 mgr-fin ceph rtd unknown /proc/30893/task/84974/root (readlink: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84974 mgr-fin ceph txt unknown /proc/30893/task/84974/exe (readlink: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84974 mgr-fin ceph NOFD /proc/30893/task/84974/fd (opendir: Permission denied) 2024-09-12T02:01:21.240 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84975 mgr-fin ceph cwd unknown /proc/30893/task/84975/cwd (readlink: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84975 mgr-fin ceph rtd unknown /proc/30893/task/84975/root (readlink: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84975 mgr-fin ceph txt unknown /proc/30893/task/84975/exe (readlink: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84975 mgr-fin ceph NOFD /proc/30893/task/84975/fd (opendir: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84976 mgr-fin ceph cwd unknown /proc/30893/task/84976/cwd (readlink: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84976 mgr-fin ceph rtd unknown /proc/30893/task/84976/root (readlink: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84976 mgr-fin ceph txt unknown /proc/30893/task/84976/exe (readlink: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84976 mgr-fin ceph NOFD /proc/30893/task/84976/fd (opendir: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84977 mgr-fin ceph cwd unknown /proc/30893/task/84977/cwd (readlink: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84977 mgr-fin ceph rtd unknown /proc/30893/task/84977/root (readlink: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84977 mgr-fin ceph txt unknown /proc/30893/task/84977/exe (readlink: Permission denied) 2024-09-12T02:01:21.241 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84977 mgr-fin ceph NOFD /proc/30893/task/84977/fd (opendir: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84978 mgr-fin ceph cwd unknown /proc/30893/task/84978/cwd (readlink: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84978 mgr-fin ceph rtd unknown /proc/30893/task/84978/root (readlink: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84978 mgr-fin ceph txt unknown /proc/30893/task/84978/exe (readlink: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84978 mgr-fin ceph NOFD /proc/30893/task/84978/fd (opendir: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84979 mgr-fin ceph cwd unknown /proc/30893/task/84979/cwd (readlink: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84979 mgr-fin ceph rtd unknown /proc/30893/task/84979/root (readlink: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84979 mgr-fin ceph txt unknown /proc/30893/task/84979/exe (readlink: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84979 mgr-fin ceph NOFD /proc/30893/task/84979/fd (opendir: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84980 mgr-fin ceph cwd unknown /proc/30893/task/84980/cwd (readlink: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84980 mgr-fin ceph rtd unknown /proc/30893/task/84980/root (readlink: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84980 mgr-fin ceph txt unknown /proc/30893/task/84980/exe (readlink: Permission denied) 2024-09-12T02:01:21.242 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84980 mgr-fin ceph NOFD /proc/30893/task/84980/fd (opendir: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84981 mgr-fin ceph cwd unknown /proc/30893/task/84981/cwd (readlink: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84981 mgr-fin ceph rtd unknown /proc/30893/task/84981/root (readlink: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84981 mgr-fin ceph txt unknown /proc/30893/task/84981/exe (readlink: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84981 mgr-fin ceph NOFD /proc/30893/task/84981/fd (opendir: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84982 mgr-fin ceph cwd unknown /proc/30893/task/84982/cwd (readlink: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84982 mgr-fin ceph rtd unknown /proc/30893/task/84982/root (readlink: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84982 mgr-fin ceph txt unknown /proc/30893/task/84982/exe (readlink: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84982 mgr-fin ceph NOFD /proc/30893/task/84982/fd (opendir: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84983 mgr-fin ceph cwd unknown /proc/30893/task/84983/cwd (readlink: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84983 mgr-fin ceph rtd unknown /proc/30893/task/84983/root (readlink: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84983 mgr-fin ceph txt unknown /proc/30893/task/84983/exe (readlink: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84983 mgr-fin ceph NOFD /proc/30893/task/84983/fd (opendir: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84984 mgr-fin ceph cwd unknown /proc/30893/task/84984/cwd (readlink: Permission denied) 2024-09-12T02:01:21.243 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84984 mgr-fin ceph rtd unknown /proc/30893/task/84984/root (readlink: Permission denied) 2024-09-12T02:01:21.244 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84984 mgr-fin ceph txt unknown /proc/30893/task/84984/exe (readlink: Permission denied) 2024-09-12T02:01:21.244 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 84984 mgr-fin ceph NOFD /proc/30893/task/84984/fd (opendir: Permission denied) 2024-09-12T02:01:21.244 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86351 ceph_time ceph cwd unknown /proc/30893/task/86351/cwd (readlink: Permission denied) 2024-09-12T02:01:21.244 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86351 ceph_time ceph rtd unknown /proc/30893/task/86351/root (readlink: Permission denied) 2024-09-12T02:01:21.244 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86351 ceph_time ceph txt unknown /proc/30893/task/86351/exe (readlink: Permission denied) 2024-09-12T02:01:21.244 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86351 ceph_time ceph NOFD /proc/30893/task/86351/fd (opendir: Permission denied) 2024-09-12T02:01:21.244 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86352 fn_anonym ceph cwd unknown /proc/30893/task/86352/cwd (readlink: Permission denied) 2024-09-12T02:01:21.244 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86352 fn_anonym ceph rtd unknown /proc/30893/task/86352/root (readlink: Permission denied) 2024-09-12T02:01:21.244 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86352 fn_anonym ceph txt unknown /proc/30893/task/86352/exe (readlink: Permission denied) 2024-09-12T02:01:21.244 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86352 fn_anonym ceph NOFD /proc/30893/task/86352/fd (opendir: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86353 safe_time ceph cwd unknown /proc/30893/task/86353/cwd (readlink: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86353 safe_time ceph rtd unknown /proc/30893/task/86353/root (readlink: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86353 safe_time ceph txt unknown /proc/30893/task/86353/exe (readlink: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86353 safe_time ceph NOFD /proc/30893/task/86353/fd (opendir: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86354 fn_anonym ceph cwd unknown /proc/30893/task/86354/cwd (readlink: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86354 fn_anonym ceph rtd unknown /proc/30893/task/86354/root (readlink: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86354 fn_anonym ceph txt unknown /proc/30893/task/86354/exe (readlink: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86354 fn_anonym ceph NOFD /proc/30893/task/86354/fd (opendir: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86355 flusher ceph cwd unknown /proc/30893/task/86355/cwd (readlink: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86355 flusher ceph rtd unknown /proc/30893/task/86355/root (readlink: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86355 flusher ceph txt unknown /proc/30893/task/86355/exe (readlink: Permission denied) 2024-09-12T02:01:21.245 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86355 flusher ceph NOFD /proc/30893/task/86355/fd (opendir: Permission denied) 2024-09-12T02:01:21.246 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86356 ms_dispat ceph cwd unknown /proc/30893/task/86356/cwd (readlink: Permission denied) 2024-09-12T02:01:21.246 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86356 ms_dispat ceph rtd unknown /proc/30893/task/86356/root (readlink: Permission denied) 2024-09-12T02:01:21.246 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86356 ms_dispat ceph txt unknown /proc/30893/task/86356/exe (readlink: Permission denied) 2024-09-12T02:01:21.246 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86356 ms_dispat ceph NOFD /proc/30893/task/86356/fd (opendir: Permission denied) 2024-09-12T02:01:21.246 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86357 ms_local ceph cwd unknown /proc/30893/task/86357/cwd (readlink: Permission denied) 2024-09-12T02:01:21.246 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86357 ms_local ceph rtd unknown /proc/30893/task/86357/root (readlink: Permission denied) 2024-09-12T02:01:21.246 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86357 ms_local ceph txt unknown /proc/30893/task/86357/exe (readlink: Permission denied) 2024-09-12T02:01:21.246 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86357 ms_local ceph NOFD /proc/30893/task/86357/fd (opendir: Permission denied) 2024-09-12T02:01:21.246 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86358 safe_time ceph cwd unknown /proc/30893/task/86358/cwd (readlink: Permission denied) 2024-09-12T02:01:21.246 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86358 safe_time ceph rtd unknown /proc/30893/task/86358/root (readlink: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86358 safe_time ceph txt unknown /proc/30893/task/86358/exe (readlink: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86358 safe_time ceph NOFD /proc/30893/task/86358/fd (opendir: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86359 m-fin-sna ceph cwd unknown /proc/30893/task/86359/cwd (readlink: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86359 m-fin-sna ceph rtd unknown /proc/30893/task/86359/root (readlink: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86359 m-fin-sna ceph txt unknown /proc/30893/task/86359/exe (readlink: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86359 m-fin-sna ceph NOFD /proc/30893/task/86359/fd (opendir: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86620 m-fin-sna ceph cwd unknown /proc/30893/task/86620/cwd (readlink: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86620 m-fin-sna ceph rtd unknown /proc/30893/task/86620/root (readlink: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86620 m-fin-sna ceph txt unknown /proc/30893/task/86620/exe (readlink: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mgr 30893 86620 m-fin-sna ceph NOFD /proc/30893/task/86620/fd (opendir: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 31907 root cwd unknown /proc/31907/cwd (readlink: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 31907 root rtd unknown /proc/31907/root (readlink: Permission denied) 2024-09-12T02:01:21.247 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 31907 root txt unknown /proc/31907/exe (readlink: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:systemd 31907 root NOFD /proc/31907/fd (opendir: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:(sd-pam) 31909 root cwd unknown /proc/31909/cwd (readlink: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:(sd-pam) 31909 root rtd unknown /proc/31909/root (readlink: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:(sd-pam) 31909 root txt unknown /proc/31909/exe (readlink: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:(sd-pam) 31909 root NOFD /proc/31909/fd (opendir: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 32109 root cwd unknown /proc/32109/cwd (readlink: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 32109 root rtd unknown /proc/32109/root (readlink: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 32109 root txt unknown /proc/32109/exe (readlink: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 32109 root NOFD /proc/32109/fd (opendir: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 44542 root cwd unknown /proc/44542/cwd (readlink: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 44542 root rtd unknown /proc/44542/root (readlink: Permission denied) 2024-09-12T02:01:21.248 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 44542 root txt unknown /proc/44542/exe (readlink: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 44542 root NOFD /proc/44542/fd (opendir: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 44544 root cwd unknown /proc/44544/cwd (readlink: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 44544 root rtd unknown /proc/44544/root (readlink: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 44544 root txt unknown /proc/44544/exe (readlink: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 44544 root NOFD /proc/44544/fd (opendir: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 ceph cwd unknown /proc/44546/cwd (readlink: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 ceph rtd unknown /proc/44546/root (readlink: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 ceph txt unknown /proc/44546/exe (readlink: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 ceph NOFD /proc/44546/fd (opendir: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44547 log ceph cwd unknown /proc/44546/task/44547/cwd (readlink: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44547 log ceph rtd unknown /proc/44546/task/44547/root (readlink: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44547 log ceph txt unknown /proc/44546/task/44547/exe (readlink: Permission denied) 2024-09-12T02:01:21.249 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44547 log ceph NOFD /proc/44546/task/44547/fd (opendir: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44549 msgr-work ceph cwd unknown /proc/44546/task/44549/cwd (readlink: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44549 msgr-work ceph rtd unknown /proc/44546/task/44549/root (readlink: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44549 msgr-work ceph txt unknown /proc/44546/task/44549/exe (readlink: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44549 msgr-work ceph NOFD /proc/44546/task/44549/fd (opendir: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44550 msgr-work ceph cwd unknown /proc/44546/task/44550/cwd (readlink: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44550 msgr-work ceph rtd unknown /proc/44546/task/44550/root (readlink: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44550 msgr-work ceph txt unknown /proc/44546/task/44550/exe (readlink: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44550 msgr-work ceph NOFD /proc/44546/task/44550/fd (opendir: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44551 msgr-work ceph cwd unknown /proc/44546/task/44551/cwd (readlink: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44551 msgr-work ceph rtd unknown /proc/44546/task/44551/root (readlink: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44551 msgr-work ceph txt unknown /proc/44546/task/44551/exe (readlink: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44551 msgr-work ceph NOFD /proc/44546/task/44551/fd (opendir: Permission denied) 2024-09-12T02:01:21.250 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44555 service ceph cwd unknown /proc/44546/task/44555/cwd (readlink: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44555 service ceph rtd unknown /proc/44546/task/44555/root (readlink: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44555 service ceph txt unknown /proc/44546/task/44555/exe (readlink: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44555 service ceph NOFD /proc/44546/task/44555/fd (opendir: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44556 admin_soc ceph cwd unknown /proc/44546/task/44556/cwd (readlink: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44556 admin_soc ceph rtd unknown /proc/44546/task/44556/root (readlink: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44556 admin_soc ceph txt unknown /proc/44546/task/44556/exe (readlink: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44556 admin_soc ceph NOFD /proc/44546/task/44556/fd (opendir: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44873 signal_ha ceph cwd unknown /proc/44546/task/44873/cwd (readlink: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44873 signal_ha ceph rtd unknown /proc/44546/task/44873/root (readlink: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44873 signal_ha ceph txt unknown /proc/44546/task/44873/exe (readlink: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44873 signal_ha ceph NOFD /proc/44546/task/44873/fd (opendir: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44874 io_contex ceph cwd unknown /proc/44546/task/44874/cwd (readlink: Permission denied) 2024-09-12T02:01:21.251 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44874 io_contex ceph rtd unknown /proc/44546/task/44874/root (readlink: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44874 io_contex ceph txt unknown /proc/44546/task/44874/exe (readlink: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44874 io_contex ceph NOFD /proc/44546/task/44874/fd (opendir: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44875 io_contex ceph cwd unknown /proc/44546/task/44875/cwd (readlink: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44875 io_contex ceph rtd unknown /proc/44546/task/44875/root (readlink: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44875 io_contex ceph txt unknown /proc/44546/task/44875/exe (readlink: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44875 io_contex ceph NOFD /proc/44546/task/44875/fd (opendir: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44894 OpHistory ceph cwd unknown /proc/44546/task/44894/cwd (readlink: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44894 OpHistory ceph rtd unknown /proc/44546/task/44894/root (readlink: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44894 OpHistory ceph txt unknown /proc/44546/task/44894/exe (readlink: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44894 OpHistory ceph NOFD /proc/44546/task/44894/fd (opendir: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44895 ceph_time ceph cwd unknown /proc/44546/task/44895/cwd (readlink: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44895 ceph_time ceph rtd unknown /proc/44546/task/44895/root (readlink: Permission denied) 2024-09-12T02:01:21.252 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44895 ceph_time ceph txt unknown /proc/44546/task/44895/exe (readlink: Permission denied) 2024-09-12T02:01:21.253 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44895 ceph_time ceph NOFD /proc/44546/task/44895/fd (opendir: Permission denied) 2024-09-12T02:01:21.253 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44902 ceph-osd ceph cwd unknown /proc/44546/task/44902/cwd (readlink: Permission denied) 2024-09-12T02:01:21.253 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44902 ceph-osd ceph rtd unknown /proc/44546/task/44902/root (readlink: Permission denied) 2024-09-12T02:01:21.253 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44902 ceph-osd ceph txt unknown /proc/44546/task/44902/exe (readlink: Permission denied) 2024-09-12T02:01:21.253 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44902 ceph-osd ceph NOFD /proc/44546/task/44902/fd (opendir: Permission denied) 2024-09-12T02:01:21.253 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44978 ceph-osd ceph cwd unknown /proc/44546/task/44978/cwd (readlink: Permission denied) 2024-09-12T02:01:21.253 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44978 ceph-osd ceph rtd unknown /proc/44546/task/44978/root (readlink: Permission denied) 2024-09-12T02:01:21.253 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44978 ceph-osd ceph txt unknown /proc/44546/task/44978/exe (readlink: Permission denied) 2024-09-12T02:01:21.253 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44978 ceph-osd ceph NOFD /proc/44546/task/44978/fd (opendir: Permission denied) 2024-09-12T02:01:21.253 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44989 ceph-osd ceph cwd unknown /proc/44546/task/44989/cwd (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44989 ceph-osd ceph rtd unknown /proc/44546/task/44989/root (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44989 ceph-osd ceph txt unknown /proc/44546/task/44989/exe (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 44989 ceph-osd ceph NOFD /proc/44546/task/44989/fd (opendir: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45002 ceph-osd ceph cwd unknown /proc/44546/task/45002/cwd (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45002 ceph-osd ceph rtd unknown /proc/44546/task/45002/root (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45002 ceph-osd ceph txt unknown /proc/44546/task/45002/exe (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45002 ceph-osd ceph NOFD /proc/44546/task/45002/fd (opendir: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45013 ceph-osd ceph cwd unknown /proc/44546/task/45013/cwd (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45013 ceph-osd ceph rtd unknown /proc/44546/task/45013/root (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45013 ceph-osd ceph txt unknown /proc/44546/task/45013/exe (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45013 ceph-osd ceph NOFD /proc/44546/task/45013/fd (opendir: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45024 ceph-osd ceph cwd unknown /proc/44546/task/45024/cwd (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45024 ceph-osd ceph rtd unknown /proc/44546/task/45024/root (readlink: Permission denied) 2024-09-12T02:01:21.254 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45024 ceph-osd ceph txt unknown /proc/44546/task/45024/exe (readlink: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45024 ceph-osd ceph NOFD /proc/44546/task/45024/fd (opendir: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45036 ceph-osd ceph cwd unknown /proc/44546/task/45036/cwd (readlink: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45036 ceph-osd ceph rtd unknown /proc/44546/task/45036/root (readlink: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45036 ceph-osd ceph txt unknown /proc/44546/task/45036/exe (readlink: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45036 ceph-osd ceph NOFD /proc/44546/task/45036/fd (opendir: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45058 ceph-osd ceph cwd unknown /proc/44546/task/45058/cwd (readlink: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45058 ceph-osd ceph rtd unknown /proc/44546/task/45058/root (readlink: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45058 ceph-osd ceph txt unknown /proc/44546/task/45058/exe (readlink: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45058 ceph-osd ceph NOFD /proc/44546/task/45058/fd (opendir: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45059 ceph-osd ceph cwd unknown /proc/44546/task/45059/cwd (readlink: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45059 ceph-osd ceph rtd unknown /proc/44546/task/45059/root (readlink: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45059 ceph-osd ceph txt unknown /proc/44546/task/45059/exe (readlink: Permission denied) 2024-09-12T02:01:21.255 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45059 ceph-osd ceph NOFD /proc/44546/task/45059/fd (opendir: Permission denied) 2024-09-12T02:01:21.256 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45060 safe_time ceph cwd unknown /proc/44546/task/45060/cwd (readlink: Permission denied) 2024-09-12T02:01:21.256 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45060 safe_time ceph rtd unknown /proc/44546/task/45060/root (readlink: Permission denied) 2024-09-12T02:01:21.256 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45060 safe_time ceph txt unknown /proc/44546/task/45060/exe (readlink: Permission denied) 2024-09-12T02:01:21.256 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45060 safe_time ceph NOFD /proc/44546/task/45060/fd (opendir: Permission denied) 2024-09-12T02:01:21.256 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45061 safe_time ceph cwd unknown /proc/44546/task/45061/cwd (readlink: Permission denied) 2024-09-12T02:01:21.256 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45061 safe_time ceph rtd unknown /proc/44546/task/45061/root (readlink: Permission denied) 2024-09-12T02:01:21.256 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45061 safe_time ceph txt unknown /proc/44546/task/45061/exe (readlink: Permission denied) 2024-09-12T02:01:21.256 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45061 safe_time ceph NOFD /proc/44546/task/45061/fd (opendir: Permission denied) 2024-09-12T02:01:21.256 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45062 safe_time ceph cwd unknown /proc/44546/task/45062/cwd (readlink: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45062 safe_time ceph rtd unknown /proc/44546/task/45062/root (readlink: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45062 safe_time ceph txt unknown /proc/44546/task/45062/exe (readlink: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45062 safe_time ceph NOFD /proc/44546/task/45062/fd (opendir: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45063 safe_time ceph cwd unknown /proc/44546/task/45063/cwd (readlink: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45063 safe_time ceph rtd unknown /proc/44546/task/45063/root (readlink: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45063 safe_time ceph txt unknown /proc/44546/task/45063/exe (readlink: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45063 safe_time ceph NOFD /proc/44546/task/45063/fd (opendir: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45064 fn_anonym ceph cwd unknown /proc/44546/task/45064/cwd (readlink: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45064 fn_anonym ceph rtd unknown /proc/44546/task/45064/root (readlink: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45064 fn_anonym ceph txt unknown /proc/44546/task/45064/exe (readlink: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45064 fn_anonym ceph NOFD /proc/44546/task/45064/fd (opendir: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45082 rocksdb:l ceph cwd unknown /proc/44546/task/45082/cwd (readlink: Permission denied) 2024-09-12T02:01:21.257 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45082 rocksdb:l ceph rtd unknown /proc/44546/task/45082/root (readlink: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45082 rocksdb:l ceph txt unknown /proc/44546/task/45082/exe (readlink: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45082 rocksdb:l ceph NOFD /proc/44546/task/45082/fd (opendir: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45083 rocksdb:l ceph cwd unknown /proc/44546/task/45083/cwd (readlink: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45083 rocksdb:l ceph rtd unknown /proc/44546/task/45083/root (readlink: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45083 rocksdb:l ceph txt unknown /proc/44546/task/45083/exe (readlink: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45083 rocksdb:l ceph NOFD /proc/44546/task/45083/fd (opendir: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45084 rocksdb:l ceph cwd unknown /proc/44546/task/45084/cwd (readlink: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45084 rocksdb:l ceph rtd unknown /proc/44546/task/45084/root (readlink: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45084 rocksdb:l ceph txt unknown /proc/44546/task/45084/exe (readlink: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45084 rocksdb:l ceph NOFD /proc/44546/task/45084/fd (opendir: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45085 rocksdb:h ceph cwd unknown /proc/44546/task/45085/cwd (readlink: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45085 rocksdb:h ceph rtd unknown /proc/44546/task/45085/root (readlink: Permission denied) 2024-09-12T02:01:21.258 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45085 rocksdb:h ceph txt unknown /proc/44546/task/45085/exe (readlink: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45085 rocksdb:h ceph NOFD /proc/44546/task/45085/fd (opendir: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45562 bstore_ai ceph cwd unknown /proc/44546/task/45562/cwd (readlink: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45562 bstore_ai ceph rtd unknown /proc/44546/task/45562/root (readlink: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45562 bstore_ai ceph txt unknown /proc/44546/task/45562/exe (readlink: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45562 bstore_ai ceph NOFD /proc/44546/task/45562/fd (opendir: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45776 bstore_ai ceph cwd unknown /proc/44546/task/45776/cwd (readlink: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45776 bstore_ai ceph rtd unknown /proc/44546/task/45776/root (readlink: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45776 bstore_ai ceph txt unknown /proc/44546/task/45776/exe (readlink: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45776 bstore_ai ceph NOFD /proc/44546/task/45776/fd (opendir: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45961 ceph-osd ceph cwd unknown /proc/44546/task/45961/cwd (readlink: Permission denied) 2024-09-12T02:01:21.259 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45961 ceph-osd ceph rtd unknown /proc/44546/task/45961/root (readlink: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45961 ceph-osd ceph txt unknown /proc/44546/task/45961/exe (readlink: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45961 ceph-osd ceph NOFD /proc/44546/task/45961/fd (opendir: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45962 cfin ceph cwd unknown /proc/44546/task/45962/cwd (readlink: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45962 cfin ceph rtd unknown /proc/44546/task/45962/root (readlink: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45962 cfin ceph txt unknown /proc/44546/task/45962/exe (readlink: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45962 cfin ceph NOFD /proc/44546/task/45962/fd (opendir: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45963 bstore_kv ceph cwd unknown /proc/44546/task/45963/cwd (readlink: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45963 bstore_kv ceph rtd unknown /proc/44546/task/45963/root (readlink: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45963 bstore_kv ceph txt unknown /proc/44546/task/45963/exe (readlink: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45963 bstore_kv ceph NOFD /proc/44546/task/45963/fd (opendir: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45964 bstore_kv ceph cwd unknown /proc/44546/task/45964/cwd (readlink: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45964 bstore_kv ceph rtd unknown /proc/44546/task/45964/root (readlink: Permission denied) 2024-09-12T02:01:21.260 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45964 bstore_kv ceph txt unknown /proc/44546/task/45964/exe (readlink: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45964 bstore_kv ceph NOFD /proc/44546/task/45964/fd (opendir: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45965 bstore_me ceph cwd unknown /proc/44546/task/45965/cwd (readlink: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45965 bstore_me ceph rtd unknown /proc/44546/task/45965/root (readlink: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45965 bstore_me ceph txt unknown /proc/44546/task/45965/exe (readlink: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45965 bstore_me ceph NOFD /proc/44546/task/45965/fd (opendir: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45974 ms_dispat ceph cwd unknown /proc/44546/task/45974/cwd (readlink: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45974 ms_dispat ceph rtd unknown /proc/44546/task/45974/root (readlink: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45974 ms_dispat ceph txt unknown /proc/44546/task/45974/exe (readlink: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45974 ms_dispat ceph NOFD /proc/44546/task/45974/fd (opendir: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45975 ms_local ceph cwd unknown /proc/44546/task/45975/cwd (readlink: Permission denied) 2024-09-12T02:01:21.261 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45975 ms_local ceph rtd unknown /proc/44546/task/45975/root (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45975 ms_local ceph txt unknown /proc/44546/task/45975/exe (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45975 ms_local ceph NOFD /proc/44546/task/45975/fd (opendir: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45976 safe_time ceph cwd unknown /proc/44546/task/45976/cwd (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45976 safe_time ceph rtd unknown /proc/44546/task/45976/root (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45976 safe_time ceph txt unknown /proc/44546/task/45976/exe (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45976 safe_time ceph NOFD /proc/44546/task/45976/fd (opendir: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45977 safe_time ceph cwd unknown /proc/44546/task/45977/cwd (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45977 safe_time ceph rtd unknown /proc/44546/task/45977/root (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45977 safe_time ceph txt unknown /proc/44546/task/45977/exe (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45977 safe_time ceph NOFD /proc/44546/task/45977/fd (opendir: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45978 ms_dispat ceph cwd unknown /proc/44546/task/45978/cwd (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45978 ms_dispat ceph rtd unknown /proc/44546/task/45978/root (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45978 ms_dispat ceph txt unknown /proc/44546/task/45978/exe (readlink: Permission denied) 2024-09-12T02:01:21.262 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45978 ms_dispat ceph NOFD /proc/44546/task/45978/fd (opendir: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45979 ms_local ceph cwd unknown /proc/44546/task/45979/cwd (readlink: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45979 ms_local ceph rtd unknown /proc/44546/task/45979/root (readlink: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45979 ms_local ceph txt unknown /proc/44546/task/45979/exe (readlink: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45979 ms_local ceph NOFD /proc/44546/task/45979/fd (opendir: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45980 ms_dispat ceph cwd unknown /proc/44546/task/45980/cwd (readlink: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45980 ms_dispat ceph rtd unknown /proc/44546/task/45980/root (readlink: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45980 ms_dispat ceph txt unknown /proc/44546/task/45980/exe (readlink: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45980 ms_dispat ceph NOFD /proc/44546/task/45980/fd (opendir: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45981 ms_local ceph cwd unknown /proc/44546/task/45981/cwd (readlink: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45981 ms_local ceph rtd unknown /proc/44546/task/45981/root (readlink: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45981 ms_local ceph txt unknown /proc/44546/task/45981/exe (readlink: Permission denied) 2024-09-12T02:01:21.263 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45981 ms_local ceph NOFD /proc/44546/task/45981/fd (opendir: Permission denied) 2024-09-12T02:01:21.264 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45982 ms_dispat ceph cwd unknown /proc/44546/task/45982/cwd (readlink: Permission denied) 2024-09-12T02:01:21.264 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45982 ms_dispat ceph rtd unknown /proc/44546/task/45982/root (readlink: Permission denied) 2024-09-12T02:01:21.264 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45982 ms_dispat ceph txt unknown /proc/44546/task/45982/exe (readlink: Permission denied) 2024-09-12T02:01:21.264 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45982 ms_dispat ceph NOFD /proc/44546/task/45982/fd (opendir: Permission denied) 2024-09-12T02:01:21.264 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45983 ms_local ceph cwd unknown /proc/44546/task/45983/cwd (readlink: Permission denied) 2024-09-12T02:01:21.264 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45983 ms_local ceph rtd unknown /proc/44546/task/45983/root (readlink: Permission denied) 2024-09-12T02:01:21.264 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45983 ms_local ceph txt unknown /proc/44546/task/45983/exe (readlink: Permission denied) 2024-09-12T02:01:21.264 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45983 ms_local ceph NOFD /proc/44546/task/45983/fd (opendir: Permission denied) 2024-09-12T02:01:21.264 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45984 ms_dispat ceph cwd unknown /proc/44546/task/45984/cwd (readlink: Permission denied) 2024-09-12T02:01:21.264 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45984 ms_dispat ceph rtd unknown /proc/44546/task/45984/root (readlink: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45984 ms_dispat ceph txt unknown /proc/44546/task/45984/exe (readlink: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45984 ms_dispat ceph NOFD /proc/44546/task/45984/fd (opendir: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45985 ms_local ceph cwd unknown /proc/44546/task/45985/cwd (readlink: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45985 ms_local ceph rtd unknown /proc/44546/task/45985/root (readlink: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45985 ms_local ceph txt unknown /proc/44546/task/45985/exe (readlink: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45985 ms_local ceph NOFD /proc/44546/task/45985/fd (opendir: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45986 ms_dispat ceph cwd unknown /proc/44546/task/45986/cwd (readlink: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45986 ms_dispat ceph rtd unknown /proc/44546/task/45986/root (readlink: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45986 ms_dispat ceph txt unknown /proc/44546/task/45986/exe (readlink: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45986 ms_dispat ceph NOFD /proc/44546/task/45986/fd (opendir: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45987 ms_local ceph cwd unknown /proc/44546/task/45987/cwd (readlink: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45987 ms_local ceph rtd unknown /proc/44546/task/45987/root (readlink: Permission denied) 2024-09-12T02:01:21.265 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45987 ms_local ceph txt unknown /proc/44546/task/45987/exe (readlink: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45987 ms_local ceph NOFD /proc/44546/task/45987/fd (opendir: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45988 ms_dispat ceph cwd unknown /proc/44546/task/45988/cwd (readlink: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45988 ms_dispat ceph rtd unknown /proc/44546/task/45988/root (readlink: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45988 ms_dispat ceph txt unknown /proc/44546/task/45988/exe (readlink: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45988 ms_dispat ceph NOFD /proc/44546/task/45988/fd (opendir: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45989 ms_local ceph cwd unknown /proc/44546/task/45989/cwd (readlink: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45989 ms_local ceph rtd unknown /proc/44546/task/45989/root (readlink: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45989 ms_local ceph txt unknown /proc/44546/task/45989/exe (readlink: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45989 ms_local ceph NOFD /proc/44546/task/45989/fd (opendir: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45990 fn_anonym ceph cwd unknown /proc/44546/task/45990/cwd (readlink: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45990 fn_anonym ceph rtd unknown /proc/44546/task/45990/root (readlink: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45990 fn_anonym ceph txt unknown /proc/44546/task/45990/exe (readlink: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45990 fn_anonym ceph NOFD /proc/44546/task/45990/fd (opendir: Permission denied) 2024-09-12T02:01:21.266 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45991 finisher ceph cwd unknown /proc/44546/task/45991/cwd (readlink: Permission denied) 2024-09-12T02:01:21.267 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45991 finisher ceph rtd unknown /proc/44546/task/45991/root (readlink: Permission denied) 2024-09-12T02:01:21.267 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45991 finisher ceph txt unknown /proc/44546/task/45991/exe (readlink: Permission denied) 2024-09-12T02:01:21.267 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45991 finisher ceph NOFD /proc/44546/task/45991/fd (opendir: Permission denied) 2024-09-12T02:01:21.267 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45992 safe_time ceph cwd unknown /proc/44546/task/45992/cwd (readlink: Permission denied) 2024-09-12T02:01:21.267 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45992 safe_time ceph rtd unknown /proc/44546/task/45992/root (readlink: Permission denied) 2024-09-12T02:01:21.267 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45992 safe_time ceph txt unknown /proc/44546/task/45992/exe (readlink: Permission denied) 2024-09-12T02:01:21.267 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45992 safe_time ceph NOFD /proc/44546/task/45992/fd (opendir: Permission denied) 2024-09-12T02:01:21.268 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45993 safe_time ceph cwd unknown /proc/44546/task/45993/cwd (readlink: Permission denied) 2024-09-12T02:01:21.268 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45993 safe_time ceph rtd unknown /proc/44546/task/45993/root (readlink: Permission denied) 2024-09-12T02:01:21.268 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45993 safe_time ceph txt unknown /proc/44546/task/45993/exe (readlink: Permission denied) 2024-09-12T02:01:21.268 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45993 safe_time ceph NOFD /proc/44546/task/45993/fd (opendir: Permission denied) 2024-09-12T02:01:21.268 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45994 ceph-osd ceph cwd unknown /proc/44546/task/45994/cwd (readlink: Permission denied) 2024-09-12T02:01:21.268 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45994 ceph-osd ceph rtd unknown /proc/44546/task/45994/root (readlink: Permission denied) 2024-09-12T02:01:21.268 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45994 ceph-osd ceph txt unknown /proc/44546/task/45994/exe (readlink: Permission denied) 2024-09-12T02:01:21.268 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45994 ceph-osd ceph NOFD /proc/44546/task/45994/fd (opendir: Permission denied) 2024-09-12T02:01:21.268 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45995 osd_srv_a ceph cwd unknown /proc/44546/task/45995/cwd (readlink: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45995 osd_srv_a ceph rtd unknown /proc/44546/task/45995/root (readlink: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45995 osd_srv_a ceph txt unknown /proc/44546/task/45995/exe (readlink: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45995 osd_srv_a ceph NOFD /proc/44546/task/45995/fd (opendir: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45996 tp_osd_tp ceph cwd unknown /proc/44546/task/45996/cwd (readlink: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45996 tp_osd_tp ceph rtd unknown /proc/44546/task/45996/root (readlink: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45996 tp_osd_tp ceph txt unknown /proc/44546/task/45996/exe (readlink: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45996 tp_osd_tp ceph NOFD /proc/44546/task/45996/fd (opendir: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45997 tp_osd_tp ceph cwd unknown /proc/44546/task/45997/cwd (readlink: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45997 tp_osd_tp ceph rtd unknown /proc/44546/task/45997/root (readlink: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45997 tp_osd_tp ceph txt unknown /proc/44546/task/45997/exe (readlink: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45997 tp_osd_tp ceph NOFD /proc/44546/task/45997/fd (opendir: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45998 tp_osd_tp ceph cwd unknown /proc/44546/task/45998/cwd (readlink: Permission denied) 2024-09-12T02:01:21.269 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45998 tp_osd_tp ceph rtd unknown /proc/44546/task/45998/root (readlink: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45998 tp_osd_tp ceph txt unknown /proc/44546/task/45998/exe (readlink: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45998 tp_osd_tp ceph NOFD /proc/44546/task/45998/fd (opendir: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45999 tp_osd_tp ceph cwd unknown /proc/44546/task/45999/cwd (readlink: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45999 tp_osd_tp ceph rtd unknown /proc/44546/task/45999/root (readlink: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45999 tp_osd_tp ceph txt unknown /proc/44546/task/45999/exe (readlink: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 45999 tp_osd_tp ceph NOFD /proc/44546/task/45999/fd (opendir: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46000 tp_osd_tp ceph cwd unknown /proc/44546/task/46000/cwd (readlink: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46000 tp_osd_tp ceph rtd unknown /proc/44546/task/46000/root (readlink: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46000 tp_osd_tp ceph txt unknown /proc/44546/task/46000/exe (readlink: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46000 tp_osd_tp ceph NOFD /proc/44546/task/46000/fd (opendir: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46001 tp_osd_tp ceph cwd unknown /proc/44546/task/46001/cwd (readlink: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46001 tp_osd_tp ceph rtd unknown /proc/44546/task/46001/root (readlink: Permission denied) 2024-09-12T02:01:21.270 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46001 tp_osd_tp ceph txt unknown /proc/44546/task/46001/exe (readlink: Permission denied) 2024-09-12T02:01:21.271 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46001 tp_osd_tp ceph NOFD /proc/44546/task/46001/fd (opendir: Permission denied) 2024-09-12T02:01:21.271 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46002 tp_osd_tp ceph cwd unknown /proc/44546/task/46002/cwd (readlink: Permission denied) 2024-09-12T02:01:21.271 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46002 tp_osd_tp ceph rtd unknown /proc/44546/task/46002/root (readlink: Permission denied) 2024-09-12T02:01:21.271 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46002 tp_osd_tp ceph txt unknown /proc/44546/task/46002/exe (readlink: Permission denied) 2024-09-12T02:01:21.271 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46002 tp_osd_tp ceph NOFD /proc/44546/task/46002/fd (opendir: Permission denied) 2024-09-12T02:01:21.271 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46003 tp_osd_tp ceph cwd unknown /proc/44546/task/46003/cwd (readlink: Permission denied) 2024-09-12T02:01:21.271 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46003 tp_osd_tp ceph rtd unknown /proc/44546/task/46003/root (readlink: Permission denied) 2024-09-12T02:01:21.271 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46003 tp_osd_tp ceph txt unknown /proc/44546/task/46003/exe (readlink: Permission denied) 2024-09-12T02:01:21.271 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46003 tp_osd_tp ceph NOFD /proc/44546/task/46003/fd (opendir: Permission denied) 2024-09-12T02:01:21.271 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46004 tp_osd_tp ceph cwd unknown /proc/44546/task/46004/cwd (readlink: Permission denied) 2024-09-12T02:01:21.272 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46004 tp_osd_tp ceph rtd unknown /proc/44546/task/46004/root (readlink: Permission denied) 2024-09-12T02:01:21.272 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46004 tp_osd_tp ceph txt unknown /proc/44546/task/46004/exe (readlink: Permission denied) 2024-09-12T02:01:21.272 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46004 tp_osd_tp ceph NOFD /proc/44546/task/46004/fd (opendir: Permission denied) 2024-09-12T02:01:21.272 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46005 tp_osd_tp ceph cwd unknown /proc/44546/task/46005/cwd (readlink: Permission denied) 2024-09-12T02:01:21.272 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46005 tp_osd_tp ceph rtd unknown /proc/44546/task/46005/root (readlink: Permission denied) 2024-09-12T02:01:21.272 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46005 tp_osd_tp ceph txt unknown /proc/44546/task/46005/exe (readlink: Permission denied) 2024-09-12T02:01:21.273 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46005 tp_osd_tp ceph NOFD /proc/44546/task/46005/fd (opendir: Permission denied) 2024-09-12T02:01:21.273 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46006 tp_osd_tp ceph cwd unknown /proc/44546/task/46006/cwd (readlink: Permission denied) 2024-09-12T02:01:21.273 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46006 tp_osd_tp ceph rtd unknown /proc/44546/task/46006/root (readlink: Permission denied) 2024-09-12T02:01:21.273 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46006 tp_osd_tp ceph txt unknown /proc/44546/task/46006/exe (readlink: Permission denied) 2024-09-12T02:01:21.273 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46006 tp_osd_tp ceph NOFD /proc/44546/task/46006/fd (opendir: Permission denied) 2024-09-12T02:01:21.273 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46007 tp_osd_tp ceph cwd unknown /proc/44546/task/46007/cwd (readlink: Permission denied) 2024-09-12T02:01:21.273 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46007 tp_osd_tp ceph rtd unknown /proc/44546/task/46007/root (readlink: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46007 tp_osd_tp ceph txt unknown /proc/44546/task/46007/exe (readlink: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46007 tp_osd_tp ceph NOFD /proc/44546/task/46007/fd (opendir: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46008 tp_osd_tp ceph cwd unknown /proc/44546/task/46008/cwd (readlink: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46008 tp_osd_tp ceph rtd unknown /proc/44546/task/46008/root (readlink: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46008 tp_osd_tp ceph txt unknown /proc/44546/task/46008/exe (readlink: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46008 tp_osd_tp ceph NOFD /proc/44546/task/46008/fd (opendir: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46009 tp_osd_tp ceph cwd unknown /proc/44546/task/46009/cwd (readlink: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46009 tp_osd_tp ceph rtd unknown /proc/44546/task/46009/root (readlink: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46009 tp_osd_tp ceph txt unknown /proc/44546/task/46009/exe (readlink: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46009 tp_osd_tp ceph NOFD /proc/44546/task/46009/fd (opendir: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46010 tp_osd_tp ceph cwd unknown /proc/44546/task/46010/cwd (readlink: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46010 tp_osd_tp ceph rtd unknown /proc/44546/task/46010/root (readlink: Permission denied) 2024-09-12T02:01:21.274 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46010 tp_osd_tp ceph txt unknown /proc/44546/task/46010/exe (readlink: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46010 tp_osd_tp ceph NOFD /proc/44546/task/46010/fd (opendir: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46011 tp_osd_tp ceph cwd unknown /proc/44546/task/46011/cwd (readlink: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46011 tp_osd_tp ceph rtd unknown /proc/44546/task/46011/root (readlink: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46011 tp_osd_tp ceph txt unknown /proc/44546/task/46011/exe (readlink: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46011 tp_osd_tp ceph NOFD /proc/44546/task/46011/fd (opendir: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46012 osd_srv_h ceph cwd unknown /proc/44546/task/46012/cwd (readlink: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46012 osd_srv_h ceph rtd unknown /proc/44546/task/46012/root (readlink: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46012 osd_srv_h ceph txt unknown /proc/44546/task/46012/exe (readlink: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 44546 46012 osd_srv_h ceph NOFD /proc/44546/task/46012/fd (opendir: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 45747 root cwd unknown /proc/45747/cwd (readlink: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 45747 root rtd unknown /proc/45747/root (readlink: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 45747 root txt unknown /proc/45747/exe (readlink: Permission denied) 2024-09-12T02:01:21.275 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 45747 root NOFD /proc/45747/fd (opendir: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 45764 root cwd unknown /proc/45764/cwd (readlink: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 45764 root rtd unknown /proc/45764/root (readlink: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 45764 root txt unknown /proc/45764/exe (readlink: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 45764 root NOFD /proc/45764/fd (opendir: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 50907 root cwd unknown /proc/50907/cwd (readlink: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 50907 root rtd unknown /proc/50907/root (readlink: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 50907 root txt unknown /proc/50907/exe (readlink: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 50907 root NOFD /proc/50907/fd (opendir: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 51461 root cwd unknown /proc/51461/cwd (readlink: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 51461 root rtd unknown /proc/51461/root (readlink: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 51461 root txt unknown /proc/51461/exe (readlink: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 51461 root NOFD /proc/51461/fd (opendir: Permission denied) 2024-09-12T02:01:21.276 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 51463 root cwd unknown /proc/51463/cwd (readlink: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 51463 root rtd unknown /proc/51463/root (readlink: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 51463 root txt unknown /proc/51463/exe (readlink: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 51463 root NOFD /proc/51463/fd (opendir: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 ceph cwd unknown /proc/51465/cwd (readlink: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 ceph rtd unknown /proc/51465/root (readlink: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 ceph txt unknown /proc/51465/exe (readlink: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 ceph NOFD /proc/51465/fd (opendir: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51466 log ceph cwd unknown /proc/51465/task/51466/cwd (readlink: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51466 log ceph rtd unknown /proc/51465/task/51466/root (readlink: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51466 log ceph txt unknown /proc/51465/task/51466/exe (readlink: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51466 log ceph NOFD /proc/51465/task/51466/fd (opendir: Permission denied) 2024-09-12T02:01:21.277 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51468 msgr-work ceph cwd unknown /proc/51465/task/51468/cwd (readlink: Permission denied) 2024-09-12T02:01:21.278 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51468 msgr-work ceph rtd unknown /proc/51465/task/51468/root (readlink: Permission denied) 2024-09-12T02:01:21.278 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51468 msgr-work ceph txt unknown /proc/51465/task/51468/exe (readlink: Permission denied) 2024-09-12T02:01:21.278 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51468 msgr-work ceph NOFD /proc/51465/task/51468/fd (opendir: Permission denied) 2024-09-12T02:01:21.278 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51469 msgr-work ceph cwd unknown /proc/51465/task/51469/cwd (readlink: Permission denied) 2024-09-12T02:01:21.278 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51469 msgr-work ceph rtd unknown /proc/51465/task/51469/root (readlink: Permission denied) 2024-09-12T02:01:21.278 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51469 msgr-work ceph txt unknown /proc/51465/task/51469/exe (readlink: Permission denied) 2024-09-12T02:01:21.278 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51469 msgr-work ceph NOFD /proc/51465/task/51469/fd (opendir: Permission denied) 2024-09-12T02:01:21.278 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51470 msgr-work ceph cwd unknown /proc/51465/task/51470/cwd (readlink: Permission denied) 2024-09-12T02:01:21.278 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51470 msgr-work ceph rtd unknown /proc/51465/task/51470/root (readlink: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51470 msgr-work ceph txt unknown /proc/51465/task/51470/exe (readlink: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51470 msgr-work ceph NOFD /proc/51465/task/51470/fd (opendir: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51474 service ceph cwd unknown /proc/51465/task/51474/cwd (readlink: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51474 service ceph rtd unknown /proc/51465/task/51474/root (readlink: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51474 service ceph txt unknown /proc/51465/task/51474/exe (readlink: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51474 service ceph NOFD /proc/51465/task/51474/fd (opendir: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51475 admin_soc ceph cwd unknown /proc/51465/task/51475/cwd (readlink: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51475 admin_soc ceph rtd unknown /proc/51465/task/51475/root (readlink: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51475 admin_soc ceph txt unknown /proc/51465/task/51475/exe (readlink: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51475 admin_soc ceph NOFD /proc/51465/task/51475/fd (opendir: Permission denied) 2024-09-12T02:01:21.279 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51799 signal_ha ceph cwd unknown /proc/51465/task/51799/cwd (readlink: Permission denied) 2024-09-12T02:01:21.280 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51799 signal_ha ceph rtd unknown /proc/51465/task/51799/root (readlink: Permission denied) 2024-09-12T02:01:21.280 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51799 signal_ha ceph txt unknown /proc/51465/task/51799/exe (readlink: Permission denied) 2024-09-12T02:01:21.280 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51799 signal_ha ceph NOFD /proc/51465/task/51799/fd (opendir: Permission denied) 2024-09-12T02:01:21.280 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51800 io_contex ceph cwd unknown /proc/51465/task/51800/cwd (readlink: Permission denied) 2024-09-12T02:01:21.280 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51800 io_contex ceph rtd unknown /proc/51465/task/51800/root (readlink: Permission denied) 2024-09-12T02:01:21.280 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51800 io_contex ceph txt unknown /proc/51465/task/51800/exe (readlink: Permission denied) 2024-09-12T02:01:21.280 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51800 io_contex ceph NOFD /proc/51465/task/51800/fd (opendir: Permission denied) 2024-09-12T02:01:21.280 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51801 io_contex ceph cwd unknown /proc/51465/task/51801/cwd (readlink: Permission denied) 2024-09-12T02:01:21.280 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51801 io_contex ceph rtd unknown /proc/51465/task/51801/root (readlink: Permission denied) 2024-09-12T02:01:21.280 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51801 io_contex ceph txt unknown /proc/51465/task/51801/exe (readlink: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51801 io_contex ceph NOFD /proc/51465/task/51801/fd (opendir: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51819 OpHistory ceph cwd unknown /proc/51465/task/51819/cwd (readlink: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51819 OpHistory ceph rtd unknown /proc/51465/task/51819/root (readlink: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51819 OpHistory ceph txt unknown /proc/51465/task/51819/exe (readlink: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51819 OpHistory ceph NOFD /proc/51465/task/51819/fd (opendir: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51820 ceph_time ceph cwd unknown /proc/51465/task/51820/cwd (readlink: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51820 ceph_time ceph rtd unknown /proc/51465/task/51820/root (readlink: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51820 ceph_time ceph txt unknown /proc/51465/task/51820/exe (readlink: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51820 ceph_time ceph NOFD /proc/51465/task/51820/fd (opendir: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51839 ceph-osd ceph cwd unknown /proc/51465/task/51839/cwd (readlink: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51839 ceph-osd ceph rtd unknown /proc/51465/task/51839/root (readlink: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51839 ceph-osd ceph txt unknown /proc/51465/task/51839/exe (readlink: Permission denied) 2024-09-12T02:01:21.281 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51839 ceph-osd ceph NOFD /proc/51465/task/51839/fd (opendir: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51878 ceph-osd ceph cwd unknown /proc/51465/task/51878/cwd (readlink: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51878 ceph-osd ceph rtd unknown /proc/51465/task/51878/root (readlink: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51878 ceph-osd ceph txt unknown /proc/51465/task/51878/exe (readlink: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51878 ceph-osd ceph NOFD /proc/51465/task/51878/fd (opendir: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51909 ceph-osd ceph cwd unknown /proc/51465/task/51909/cwd (readlink: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51909 ceph-osd ceph rtd unknown /proc/51465/task/51909/root (readlink: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51909 ceph-osd ceph txt unknown /proc/51465/task/51909/exe (readlink: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51909 ceph-osd ceph NOFD /proc/51465/task/51909/fd (opendir: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51962 ceph-osd ceph cwd unknown /proc/51465/task/51962/cwd (readlink: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51962 ceph-osd ceph rtd unknown /proc/51465/task/51962/root (readlink: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51962 ceph-osd ceph txt unknown /proc/51465/task/51962/exe (readlink: Permission denied) 2024-09-12T02:01:21.282 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51962 ceph-osd ceph NOFD /proc/51465/task/51962/fd (opendir: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51968 ceph-osd ceph cwd unknown /proc/51465/task/51968/cwd (readlink: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51968 ceph-osd ceph rtd unknown /proc/51465/task/51968/root (readlink: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51968 ceph-osd ceph txt unknown /proc/51465/task/51968/exe (readlink: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51968 ceph-osd ceph NOFD /proc/51465/task/51968/fd (opendir: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51978 ceph-osd ceph cwd unknown /proc/51465/task/51978/cwd (readlink: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51978 ceph-osd ceph rtd unknown /proc/51465/task/51978/root (readlink: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51978 ceph-osd ceph txt unknown /proc/51465/task/51978/exe (readlink: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 51978 ceph-osd ceph NOFD /proc/51465/task/51978/fd (opendir: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52005 ceph-osd ceph cwd unknown /proc/51465/task/52005/cwd (readlink: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52005 ceph-osd ceph rtd unknown /proc/51465/task/52005/root (readlink: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52005 ceph-osd ceph txt unknown /proc/51465/task/52005/exe (readlink: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52005 ceph-osd ceph NOFD /proc/51465/task/52005/fd (opendir: Permission denied) 2024-09-12T02:01:21.283 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52010 ceph-osd ceph cwd unknown /proc/51465/task/52010/cwd (readlink: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52010 ceph-osd ceph rtd unknown /proc/51465/task/52010/root (readlink: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52010 ceph-osd ceph txt unknown /proc/51465/task/52010/exe (readlink: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52010 ceph-osd ceph NOFD /proc/51465/task/52010/fd (opendir: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52011 ceph-osd ceph cwd unknown /proc/51465/task/52011/cwd (readlink: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52011 ceph-osd ceph rtd unknown /proc/51465/task/52011/root (readlink: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52011 ceph-osd ceph txt unknown /proc/51465/task/52011/exe (readlink: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52011 ceph-osd ceph NOFD /proc/51465/task/52011/fd (opendir: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52012 safe_time ceph cwd unknown /proc/51465/task/52012/cwd (readlink: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52012 safe_time ceph rtd unknown /proc/51465/task/52012/root (readlink: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52012 safe_time ceph txt unknown /proc/51465/task/52012/exe (readlink: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52012 safe_time ceph NOFD /proc/51465/task/52012/fd (opendir: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52013 safe_time ceph cwd unknown /proc/51465/task/52013/cwd (readlink: Permission denied) 2024-09-12T02:01:21.284 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52013 safe_time ceph rtd unknown /proc/51465/task/52013/root (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52013 safe_time ceph txt unknown /proc/51465/task/52013/exe (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52013 safe_time ceph NOFD /proc/51465/task/52013/fd (opendir: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52014 safe_time ceph cwd unknown /proc/51465/task/52014/cwd (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52014 safe_time ceph rtd unknown /proc/51465/task/52014/root (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52014 safe_time ceph txt unknown /proc/51465/task/52014/exe (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52014 safe_time ceph NOFD /proc/51465/task/52014/fd (opendir: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52015 safe_time ceph cwd unknown /proc/51465/task/52015/cwd (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52015 safe_time ceph rtd unknown /proc/51465/task/52015/root (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52015 safe_time ceph txt unknown /proc/51465/task/52015/exe (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52015 safe_time ceph NOFD /proc/51465/task/52015/fd (opendir: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52016 fn_anonym ceph cwd unknown /proc/51465/task/52016/cwd (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52016 fn_anonym ceph rtd unknown /proc/51465/task/52016/root (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52016 fn_anonym ceph txt unknown /proc/51465/task/52016/exe (readlink: Permission denied) 2024-09-12T02:01:21.285 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52016 fn_anonym ceph NOFD /proc/51465/task/52016/fd (opendir: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52110 rocksdb:l ceph cwd unknown /proc/51465/task/52110/cwd (readlink: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52110 rocksdb:l ceph rtd unknown /proc/51465/task/52110/root (readlink: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52110 rocksdb:l ceph txt unknown /proc/51465/task/52110/exe (readlink: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52110 rocksdb:l ceph NOFD /proc/51465/task/52110/fd (opendir: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52111 rocksdb:l ceph cwd unknown /proc/51465/task/52111/cwd (readlink: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52111 rocksdb:l ceph rtd unknown /proc/51465/task/52111/root (readlink: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52111 rocksdb:l ceph txt unknown /proc/51465/task/52111/exe (readlink: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52111 rocksdb:l ceph NOFD /proc/51465/task/52111/fd (opendir: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52112 rocksdb:l ceph cwd unknown /proc/51465/task/52112/cwd (readlink: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52112 rocksdb:l ceph rtd unknown /proc/51465/task/52112/root (readlink: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52112 rocksdb:l ceph txt unknown /proc/51465/task/52112/exe (readlink: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52112 rocksdb:l ceph NOFD /proc/51465/task/52112/fd (opendir: Permission denied) 2024-09-12T02:01:21.286 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52113 rocksdb:h ceph cwd unknown /proc/51465/task/52113/cwd (readlink: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52113 rocksdb:h ceph rtd unknown /proc/51465/task/52113/root (readlink: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52113 rocksdb:h ceph txt unknown /proc/51465/task/52113/exe (readlink: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52113 rocksdb:h ceph NOFD /proc/51465/task/52113/fd (opendir: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52555 bstore_ai ceph cwd unknown /proc/51465/task/52555/cwd (readlink: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52555 bstore_ai ceph rtd unknown /proc/51465/task/52555/root (readlink: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52555 bstore_ai ceph txt unknown /proc/51465/task/52555/exe (readlink: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52555 bstore_ai ceph NOFD /proc/51465/task/52555/fd (opendir: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52743 bstore_ai ceph cwd unknown /proc/51465/task/52743/cwd (readlink: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52743 bstore_ai ceph rtd unknown /proc/51465/task/52743/root (readlink: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52743 bstore_ai ceph txt unknown /proc/51465/task/52743/exe (readlink: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52743 bstore_ai ceph NOFD /proc/51465/task/52743/fd (opendir: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52928 ceph-osd ceph cwd unknown /proc/51465/task/52928/cwd (readlink: Permission denied) 2024-09-12T02:01:21.287 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52928 ceph-osd ceph rtd unknown /proc/51465/task/52928/root (readlink: Permission denied) 2024-09-12T02:01:21.288 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52928 ceph-osd ceph txt unknown /proc/51465/task/52928/exe (readlink: Permission denied) 2024-09-12T02:01:21.288 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52928 ceph-osd ceph NOFD /proc/51465/task/52928/fd (opendir: Permission denied) 2024-09-12T02:01:21.288 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52929 cfin ceph cwd unknown /proc/51465/task/52929/cwd (readlink: Permission denied) 2024-09-12T02:01:21.288 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52929 cfin ceph rtd unknown /proc/51465/task/52929/root (readlink: Permission denied) 2024-09-12T02:01:21.288 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52929 cfin ceph txt unknown /proc/51465/task/52929/exe (readlink: Permission denied) 2024-09-12T02:01:21.288 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52929 cfin ceph NOFD /proc/51465/task/52929/fd (opendir: Permission denied) 2024-09-12T02:01:21.288 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52930 bstore_kv ceph cwd unknown /proc/51465/task/52930/cwd (readlink: Permission denied) 2024-09-12T02:01:21.288 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52930 bstore_kv ceph rtd unknown /proc/51465/task/52930/root (readlink: Permission denied) 2024-09-12T02:01:21.288 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52930 bstore_kv ceph txt unknown /proc/51465/task/52930/exe (readlink: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52930 bstore_kv ceph NOFD /proc/51465/task/52930/fd (opendir: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52931 bstore_kv ceph cwd unknown /proc/51465/task/52931/cwd (readlink: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52931 bstore_kv ceph rtd unknown /proc/51465/task/52931/root (readlink: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52931 bstore_kv ceph txt unknown /proc/51465/task/52931/exe (readlink: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52931 bstore_kv ceph NOFD /proc/51465/task/52931/fd (opendir: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52932 bstore_me ceph cwd unknown /proc/51465/task/52932/cwd (readlink: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52932 bstore_me ceph rtd unknown /proc/51465/task/52932/root (readlink: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52932 bstore_me ceph txt unknown /proc/51465/task/52932/exe (readlink: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52932 bstore_me ceph NOFD /proc/51465/task/52932/fd (opendir: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52940 ms_dispat ceph cwd unknown /proc/51465/task/52940/cwd (readlink: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52940 ms_dispat ceph rtd unknown /proc/51465/task/52940/root (readlink: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52940 ms_dispat ceph txt unknown /proc/51465/task/52940/exe (readlink: Permission denied) 2024-09-12T02:01:21.289 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52940 ms_dispat ceph NOFD /proc/51465/task/52940/fd (opendir: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52941 ms_local ceph cwd unknown /proc/51465/task/52941/cwd (readlink: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52941 ms_local ceph rtd unknown /proc/51465/task/52941/root (readlink: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52941 ms_local ceph txt unknown /proc/51465/task/52941/exe (readlink: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52941 ms_local ceph NOFD /proc/51465/task/52941/fd (opendir: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52942 safe_time ceph cwd unknown /proc/51465/task/52942/cwd (readlink: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52942 safe_time ceph rtd unknown /proc/51465/task/52942/root (readlink: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52942 safe_time ceph txt unknown /proc/51465/task/52942/exe (readlink: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52942 safe_time ceph NOFD /proc/51465/task/52942/fd (opendir: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52943 safe_time ceph cwd unknown /proc/51465/task/52943/cwd (readlink: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52943 safe_time ceph rtd unknown /proc/51465/task/52943/root (readlink: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52943 safe_time ceph txt unknown /proc/51465/task/52943/exe (readlink: Permission denied) 2024-09-12T02:01:21.290 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52943 safe_time ceph NOFD /proc/51465/task/52943/fd (opendir: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52944 ms_dispat ceph cwd unknown /proc/51465/task/52944/cwd (readlink: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52944 ms_dispat ceph rtd unknown /proc/51465/task/52944/root (readlink: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52944 ms_dispat ceph txt unknown /proc/51465/task/52944/exe (readlink: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52944 ms_dispat ceph NOFD /proc/51465/task/52944/fd (opendir: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52945 ms_local ceph cwd unknown /proc/51465/task/52945/cwd (readlink: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52945 ms_local ceph rtd unknown /proc/51465/task/52945/root (readlink: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52945 ms_local ceph txt unknown /proc/51465/task/52945/exe (readlink: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52945 ms_local ceph NOFD /proc/51465/task/52945/fd (opendir: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52946 ms_dispat ceph cwd unknown /proc/51465/task/52946/cwd (readlink: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52946 ms_dispat ceph rtd unknown /proc/51465/task/52946/root (readlink: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52946 ms_dispat ceph txt unknown /proc/51465/task/52946/exe (readlink: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52946 ms_dispat ceph NOFD /proc/51465/task/52946/fd (opendir: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52947 ms_local ceph cwd unknown /proc/51465/task/52947/cwd (readlink: Permission denied) 2024-09-12T02:01:21.291 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52947 ms_local ceph rtd unknown /proc/51465/task/52947/root (readlink: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52947 ms_local ceph txt unknown /proc/51465/task/52947/exe (readlink: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52947 ms_local ceph NOFD /proc/51465/task/52947/fd (opendir: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52948 ms_dispat ceph cwd unknown /proc/51465/task/52948/cwd (readlink: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52948 ms_dispat ceph rtd unknown /proc/51465/task/52948/root (readlink: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52948 ms_dispat ceph txt unknown /proc/51465/task/52948/exe (readlink: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52948 ms_dispat ceph NOFD /proc/51465/task/52948/fd (opendir: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52949 ms_local ceph cwd unknown /proc/51465/task/52949/cwd (readlink: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52949 ms_local ceph rtd unknown /proc/51465/task/52949/root (readlink: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52949 ms_local ceph txt unknown /proc/51465/task/52949/exe (readlink: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52949 ms_local ceph NOFD /proc/51465/task/52949/fd (opendir: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52950 ms_dispat ceph cwd unknown /proc/51465/task/52950/cwd (readlink: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52950 ms_dispat ceph rtd unknown /proc/51465/task/52950/root (readlink: Permission denied) 2024-09-12T02:01:21.292 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52950 ms_dispat ceph txt unknown /proc/51465/task/52950/exe (readlink: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52950 ms_dispat ceph NOFD /proc/51465/task/52950/fd (opendir: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52951 ms_local ceph cwd unknown /proc/51465/task/52951/cwd (readlink: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52951 ms_local ceph rtd unknown /proc/51465/task/52951/root (readlink: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52951 ms_local ceph txt unknown /proc/51465/task/52951/exe (readlink: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52951 ms_local ceph NOFD /proc/51465/task/52951/fd (opendir: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52952 ms_dispat ceph cwd unknown /proc/51465/task/52952/cwd (readlink: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52952 ms_dispat ceph rtd unknown /proc/51465/task/52952/root (readlink: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52952 ms_dispat ceph txt unknown /proc/51465/task/52952/exe (readlink: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52952 ms_dispat ceph NOFD /proc/51465/task/52952/fd (opendir: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52953 ms_local ceph cwd unknown /proc/51465/task/52953/cwd (readlink: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52953 ms_local ceph rtd unknown /proc/51465/task/52953/root (readlink: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52953 ms_local ceph txt unknown /proc/51465/task/52953/exe (readlink: Permission denied) 2024-09-12T02:01:21.293 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52953 ms_local ceph NOFD /proc/51465/task/52953/fd (opendir: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52954 ms_dispat ceph cwd unknown /proc/51465/task/52954/cwd (readlink: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52954 ms_dispat ceph rtd unknown /proc/51465/task/52954/root (readlink: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52954 ms_dispat ceph txt unknown /proc/51465/task/52954/exe (readlink: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52954 ms_dispat ceph NOFD /proc/51465/task/52954/fd (opendir: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52955 ms_local ceph cwd unknown /proc/51465/task/52955/cwd (readlink: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52955 ms_local ceph rtd unknown /proc/51465/task/52955/root (readlink: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52955 ms_local ceph txt unknown /proc/51465/task/52955/exe (readlink: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52955 ms_local ceph NOFD /proc/51465/task/52955/fd (opendir: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52956 fn_anonym ceph cwd unknown /proc/51465/task/52956/cwd (readlink: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52956 fn_anonym ceph rtd unknown /proc/51465/task/52956/root (readlink: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52956 fn_anonym ceph txt unknown /proc/51465/task/52956/exe (readlink: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52956 fn_anonym ceph NOFD /proc/51465/task/52956/fd (opendir: Permission denied) 2024-09-12T02:01:21.294 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52957 finisher ceph cwd unknown /proc/51465/task/52957/cwd (readlink: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52957 finisher ceph rtd unknown /proc/51465/task/52957/root (readlink: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52957 finisher ceph txt unknown /proc/51465/task/52957/exe (readlink: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52957 finisher ceph NOFD /proc/51465/task/52957/fd (opendir: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52958 safe_time ceph cwd unknown /proc/51465/task/52958/cwd (readlink: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52958 safe_time ceph rtd unknown /proc/51465/task/52958/root (readlink: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52958 safe_time ceph txt unknown /proc/51465/task/52958/exe (readlink: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52958 safe_time ceph NOFD /proc/51465/task/52958/fd (opendir: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52959 safe_time ceph cwd unknown /proc/51465/task/52959/cwd (readlink: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52959 safe_time ceph rtd unknown /proc/51465/task/52959/root (readlink: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52959 safe_time ceph txt unknown /proc/51465/task/52959/exe (readlink: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52959 safe_time ceph NOFD /proc/51465/task/52959/fd (opendir: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52960 ceph-osd ceph cwd unknown /proc/51465/task/52960/cwd (readlink: Permission denied) 2024-09-12T02:01:21.295 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52960 ceph-osd ceph rtd unknown /proc/51465/task/52960/root (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52960 ceph-osd ceph txt unknown /proc/51465/task/52960/exe (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52960 ceph-osd ceph NOFD /proc/51465/task/52960/fd (opendir: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52961 osd_srv_a ceph cwd unknown /proc/51465/task/52961/cwd (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52961 osd_srv_a ceph rtd unknown /proc/51465/task/52961/root (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52961 osd_srv_a ceph txt unknown /proc/51465/task/52961/exe (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52961 osd_srv_a ceph NOFD /proc/51465/task/52961/fd (opendir: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52962 tp_osd_tp ceph cwd unknown /proc/51465/task/52962/cwd (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52962 tp_osd_tp ceph rtd unknown /proc/51465/task/52962/root (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52962 tp_osd_tp ceph txt unknown /proc/51465/task/52962/exe (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52962 tp_osd_tp ceph NOFD /proc/51465/task/52962/fd (opendir: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52963 tp_osd_tp ceph cwd unknown /proc/51465/task/52963/cwd (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52963 tp_osd_tp ceph rtd unknown /proc/51465/task/52963/root (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52963 tp_osd_tp ceph txt unknown /proc/51465/task/52963/exe (readlink: Permission denied) 2024-09-12T02:01:21.296 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52963 tp_osd_tp ceph NOFD /proc/51465/task/52963/fd (opendir: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52964 tp_osd_tp ceph cwd unknown /proc/51465/task/52964/cwd (readlink: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52964 tp_osd_tp ceph rtd unknown /proc/51465/task/52964/root (readlink: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52964 tp_osd_tp ceph txt unknown /proc/51465/task/52964/exe (readlink: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52964 tp_osd_tp ceph NOFD /proc/51465/task/52964/fd (opendir: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52965 tp_osd_tp ceph cwd unknown /proc/51465/task/52965/cwd (readlink: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52965 tp_osd_tp ceph rtd unknown /proc/51465/task/52965/root (readlink: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52965 tp_osd_tp ceph txt unknown /proc/51465/task/52965/exe (readlink: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52965 tp_osd_tp ceph NOFD /proc/51465/task/52965/fd (opendir: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52966 tp_osd_tp ceph cwd unknown /proc/51465/task/52966/cwd (readlink: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52966 tp_osd_tp ceph rtd unknown /proc/51465/task/52966/root (readlink: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52966 tp_osd_tp ceph txt unknown /proc/51465/task/52966/exe (readlink: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52966 tp_osd_tp ceph NOFD /proc/51465/task/52966/fd (opendir: Permission denied) 2024-09-12T02:01:21.297 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52967 tp_osd_tp ceph cwd unknown /proc/51465/task/52967/cwd (readlink: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52967 tp_osd_tp ceph rtd unknown /proc/51465/task/52967/root (readlink: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52967 tp_osd_tp ceph txt unknown /proc/51465/task/52967/exe (readlink: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52967 tp_osd_tp ceph NOFD /proc/51465/task/52967/fd (opendir: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52968 tp_osd_tp ceph cwd unknown /proc/51465/task/52968/cwd (readlink: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52968 tp_osd_tp ceph rtd unknown /proc/51465/task/52968/root (readlink: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52968 tp_osd_tp ceph txt unknown /proc/51465/task/52968/exe (readlink: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52968 tp_osd_tp ceph NOFD /proc/51465/task/52968/fd (opendir: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52969 tp_osd_tp ceph cwd unknown /proc/51465/task/52969/cwd (readlink: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52969 tp_osd_tp ceph rtd unknown /proc/51465/task/52969/root (readlink: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52969 tp_osd_tp ceph txt unknown /proc/51465/task/52969/exe (readlink: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52969 tp_osd_tp ceph NOFD /proc/51465/task/52969/fd (opendir: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52970 tp_osd_tp ceph cwd unknown /proc/51465/task/52970/cwd (readlink: Permission denied) 2024-09-12T02:01:21.298 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52970 tp_osd_tp ceph rtd unknown /proc/51465/task/52970/root (readlink: Permission denied) 2024-09-12T02:01:21.299 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52970 tp_osd_tp ceph txt unknown /proc/51465/task/52970/exe (readlink: Permission denied) 2024-09-12T02:01:21.299 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52970 tp_osd_tp ceph NOFD /proc/51465/task/52970/fd (opendir: Permission denied) 2024-09-12T02:01:21.299 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52971 tp_osd_tp ceph cwd unknown /proc/51465/task/52971/cwd (readlink: Permission denied) 2024-09-12T02:01:21.299 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52971 tp_osd_tp ceph rtd unknown /proc/51465/task/52971/root (readlink: Permission denied) 2024-09-12T02:01:21.299 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52971 tp_osd_tp ceph txt unknown /proc/51465/task/52971/exe (readlink: Permission denied) 2024-09-12T02:01:21.299 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52971 tp_osd_tp ceph NOFD /proc/51465/task/52971/fd (opendir: Permission denied) 2024-09-12T02:01:21.299 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52972 tp_osd_tp ceph cwd unknown /proc/51465/task/52972/cwd (readlink: Permission denied) 2024-09-12T02:01:21.299 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52972 tp_osd_tp ceph rtd unknown /proc/51465/task/52972/root (readlink: Permission denied) 2024-09-12T02:01:21.299 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52972 tp_osd_tp ceph txt unknown /proc/51465/task/52972/exe (readlink: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52972 tp_osd_tp ceph NOFD /proc/51465/task/52972/fd (opendir: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52973 tp_osd_tp ceph cwd unknown /proc/51465/task/52973/cwd (readlink: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52973 tp_osd_tp ceph rtd unknown /proc/51465/task/52973/root (readlink: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52973 tp_osd_tp ceph txt unknown /proc/51465/task/52973/exe (readlink: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52973 tp_osd_tp ceph NOFD /proc/51465/task/52973/fd (opendir: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52974 tp_osd_tp ceph cwd unknown /proc/51465/task/52974/cwd (readlink: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52974 tp_osd_tp ceph rtd unknown /proc/51465/task/52974/root (readlink: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52974 tp_osd_tp ceph txt unknown /proc/51465/task/52974/exe (readlink: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52974 tp_osd_tp ceph NOFD /proc/51465/task/52974/fd (opendir: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52975 tp_osd_tp ceph cwd unknown /proc/51465/task/52975/cwd (readlink: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52975 tp_osd_tp ceph rtd unknown /proc/51465/task/52975/root (readlink: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52975 tp_osd_tp ceph txt unknown /proc/51465/task/52975/exe (readlink: Permission denied) 2024-09-12T02:01:21.300 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52975 tp_osd_tp ceph NOFD /proc/51465/task/52975/fd (opendir: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52976 tp_osd_tp ceph cwd unknown /proc/51465/task/52976/cwd (readlink: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52976 tp_osd_tp ceph rtd unknown /proc/51465/task/52976/root (readlink: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52976 tp_osd_tp ceph txt unknown /proc/51465/task/52976/exe (readlink: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52976 tp_osd_tp ceph NOFD /proc/51465/task/52976/fd (opendir: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52977 tp_osd_tp ceph cwd unknown /proc/51465/task/52977/cwd (readlink: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52977 tp_osd_tp ceph rtd unknown /proc/51465/task/52977/root (readlink: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52977 tp_osd_tp ceph txt unknown /proc/51465/task/52977/exe (readlink: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52977 tp_osd_tp ceph NOFD /proc/51465/task/52977/fd (opendir: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52978 osd_srv_h ceph cwd unknown /proc/51465/task/52978/cwd (readlink: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52978 osd_srv_h ceph rtd unknown /proc/51465/task/52978/root (readlink: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52978 osd_srv_h ceph txt unknown /proc/51465/task/52978/exe (readlink: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 51465 52978 osd_srv_h ceph NOFD /proc/51465/task/52978/fd (opendir: Permission denied) 2024-09-12T02:01:21.301 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 52509 root cwd unknown /proc/52509/cwd (readlink: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 52509 root rtd unknown /proc/52509/root (readlink: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 52509 root txt unknown /proc/52509/exe (readlink: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 52509 root NOFD /proc/52509/fd (opendir: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 52537 root cwd unknown /proc/52537/cwd (readlink: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 52537 root rtd unknown /proc/52537/root (readlink: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 52537 root txt unknown /proc/52537/exe (readlink: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 52537 root NOFD /proc/52537/fd (opendir: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 55414 root cwd unknown /proc/55414/cwd (readlink: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 55414 root rtd unknown /proc/55414/root (readlink: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 55414 root txt unknown /proc/55414/exe (readlink: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 55414 root NOFD /proc/55414/fd (opendir: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 55458 root cwd unknown /proc/55458/cwd (readlink: Permission denied) 2024-09-12T02:01:21.302 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 55458 root rtd unknown /proc/55458/root (readlink: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 55458 root txt unknown /proc/55458/exe (readlink: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 55458 root NOFD /proc/55458/fd (opendir: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 57494 root cwd unknown /proc/57494/cwd (readlink: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 57494 root rtd unknown /proc/57494/root (readlink: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 57494 root txt unknown /proc/57494/exe (readlink: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 57494 root NOFD /proc/57494/fd (opendir: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 58233 root cwd unknown /proc/58233/cwd (readlink: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 58233 root rtd unknown /proc/58233/root (readlink: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 58233 root txt unknown /proc/58233/exe (readlink: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 58233 root NOFD /proc/58233/fd (opendir: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 58235 root cwd unknown /proc/58235/cwd (readlink: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 58235 root rtd unknown /proc/58235/root (readlink: Permission denied) 2024-09-12T02:01:21.303 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 58235 root txt unknown /proc/58235/exe (readlink: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 58235 root NOFD /proc/58235/fd (opendir: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 ceph cwd unknown /proc/58237/cwd (readlink: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 ceph rtd unknown /proc/58237/root (readlink: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 ceph txt unknown /proc/58237/exe (readlink: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 ceph NOFD /proc/58237/fd (opendir: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58238 log ceph cwd unknown /proc/58237/task/58238/cwd (readlink: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58238 log ceph rtd unknown /proc/58237/task/58238/root (readlink: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58238 log ceph txt unknown /proc/58237/task/58238/exe (readlink: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58238 log ceph NOFD /proc/58237/task/58238/fd (opendir: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58240 msgr-work ceph cwd unknown /proc/58237/task/58240/cwd (readlink: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58240 msgr-work ceph rtd unknown /proc/58237/task/58240/root (readlink: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58240 msgr-work ceph txt unknown /proc/58237/task/58240/exe (readlink: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58240 msgr-work ceph NOFD /proc/58237/task/58240/fd (opendir: Permission denied) 2024-09-12T02:01:21.304 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58241 msgr-work ceph cwd unknown /proc/58237/task/58241/cwd (readlink: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58241 msgr-work ceph rtd unknown /proc/58237/task/58241/root (readlink: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58241 msgr-work ceph txt unknown /proc/58237/task/58241/exe (readlink: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58241 msgr-work ceph NOFD /proc/58237/task/58241/fd (opendir: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58242 msgr-work ceph cwd unknown /proc/58237/task/58242/cwd (readlink: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58242 msgr-work ceph rtd unknown /proc/58237/task/58242/root (readlink: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58242 msgr-work ceph txt unknown /proc/58237/task/58242/exe (readlink: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58242 msgr-work ceph NOFD /proc/58237/task/58242/fd (opendir: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58246 service ceph cwd unknown /proc/58237/task/58246/cwd (readlink: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58246 service ceph rtd unknown /proc/58237/task/58246/root (readlink: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58246 service ceph txt unknown /proc/58237/task/58246/exe (readlink: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58246 service ceph NOFD /proc/58237/task/58246/fd (opendir: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58247 admin_soc ceph cwd unknown /proc/58237/task/58247/cwd (readlink: Permission denied) 2024-09-12T02:01:21.305 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58247 admin_soc ceph rtd unknown /proc/58237/task/58247/root (readlink: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58247 admin_soc ceph txt unknown /proc/58237/task/58247/exe (readlink: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58247 admin_soc ceph NOFD /proc/58237/task/58247/fd (opendir: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58581 signal_ha ceph cwd unknown /proc/58237/task/58581/cwd (readlink: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58581 signal_ha ceph rtd unknown /proc/58237/task/58581/root (readlink: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58581 signal_ha ceph txt unknown /proc/58237/task/58581/exe (readlink: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58581 signal_ha ceph NOFD /proc/58237/task/58581/fd (opendir: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58582 io_contex ceph cwd unknown /proc/58237/task/58582/cwd (readlink: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58582 io_contex ceph rtd unknown /proc/58237/task/58582/root (readlink: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58582 io_contex ceph txt unknown /proc/58237/task/58582/exe (readlink: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58582 io_contex ceph NOFD /proc/58237/task/58582/fd (opendir: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58583 io_contex ceph cwd unknown /proc/58237/task/58583/cwd (readlink: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58583 io_contex ceph rtd unknown /proc/58237/task/58583/root (readlink: Permission denied) 2024-09-12T02:01:21.306 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58583 io_contex ceph txt unknown /proc/58237/task/58583/exe (readlink: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58583 io_contex ceph NOFD /proc/58237/task/58583/fd (opendir: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58586 OpHistory ceph cwd unknown /proc/58237/task/58586/cwd (readlink: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58586 OpHistory ceph rtd unknown /proc/58237/task/58586/root (readlink: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58586 OpHistory ceph txt unknown /proc/58237/task/58586/exe (readlink: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58586 OpHistory ceph NOFD /proc/58237/task/58586/fd (opendir: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58587 ceph_time ceph cwd unknown /proc/58237/task/58587/cwd (readlink: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58587 ceph_time ceph rtd unknown /proc/58237/task/58587/root (readlink: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58587 ceph_time ceph txt unknown /proc/58237/task/58587/exe (readlink: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58587 ceph_time ceph NOFD /proc/58237/task/58587/fd (opendir: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58794 ceph-osd ceph cwd unknown /proc/58237/task/58794/cwd (readlink: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58794 ceph-osd ceph rtd unknown /proc/58237/task/58794/root (readlink: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58794 ceph-osd ceph txt unknown /proc/58237/task/58794/exe (readlink: Permission denied) 2024-09-12T02:01:21.307 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58794 ceph-osd ceph NOFD /proc/58237/task/58794/fd (opendir: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58795 safe_time ceph cwd unknown /proc/58237/task/58795/cwd (readlink: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58795 safe_time ceph rtd unknown /proc/58237/task/58795/root (readlink: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58795 safe_time ceph txt unknown /proc/58237/task/58795/exe (readlink: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58795 safe_time ceph NOFD /proc/58237/task/58795/fd (opendir: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58796 safe_time ceph cwd unknown /proc/58237/task/58796/cwd (readlink: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58796 safe_time ceph rtd unknown /proc/58237/task/58796/root (readlink: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58796 safe_time ceph txt unknown /proc/58237/task/58796/exe (readlink: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58796 safe_time ceph NOFD /proc/58237/task/58796/fd (opendir: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58797 safe_time ceph cwd unknown /proc/58237/task/58797/cwd (readlink: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58797 safe_time ceph rtd unknown /proc/58237/task/58797/root (readlink: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58797 safe_time ceph txt unknown /proc/58237/task/58797/exe (readlink: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58797 safe_time ceph NOFD /proc/58237/task/58797/fd (opendir: Permission denied) 2024-09-12T02:01:21.308 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58798 safe_time ceph cwd unknown /proc/58237/task/58798/cwd (readlink: Permission denied) 2024-09-12T02:01:21.309 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58798 safe_time ceph rtd unknown /proc/58237/task/58798/root (readlink: Permission denied) 2024-09-12T02:01:21.309 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58798 safe_time ceph txt unknown /proc/58237/task/58798/exe (readlink: Permission denied) 2024-09-12T02:01:21.309 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58798 safe_time ceph NOFD /proc/58237/task/58798/fd (opendir: Permission denied) 2024-09-12T02:01:21.309 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58799 fn_anonym ceph cwd unknown /proc/58237/task/58799/cwd (readlink: Permission denied) 2024-09-12T02:01:21.309 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58799 fn_anonym ceph rtd unknown /proc/58237/task/58799/root (readlink: Permission denied) 2024-09-12T02:01:21.309 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58799 fn_anonym ceph txt unknown /proc/58237/task/58799/exe (readlink: Permission denied) 2024-09-12T02:01:21.309 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58799 fn_anonym ceph NOFD /proc/58237/task/58799/fd (opendir: Permission denied) 2024-09-12T02:01:21.309 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58890 rocksdb:l ceph cwd unknown /proc/58237/task/58890/cwd (readlink: Permission denied) 2024-09-12T02:01:21.309 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58890 rocksdb:l ceph rtd unknown /proc/58237/task/58890/root (readlink: Permission denied) 2024-09-12T02:01:21.309 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58890 rocksdb:l ceph txt unknown /proc/58237/task/58890/exe (readlink: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58890 rocksdb:l ceph NOFD /proc/58237/task/58890/fd (opendir: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58891 rocksdb:l ceph cwd unknown /proc/58237/task/58891/cwd (readlink: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58891 rocksdb:l ceph rtd unknown /proc/58237/task/58891/root (readlink: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58891 rocksdb:l ceph txt unknown /proc/58237/task/58891/exe (readlink: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58891 rocksdb:l ceph NOFD /proc/58237/task/58891/fd (opendir: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58892 rocksdb:l ceph cwd unknown /proc/58237/task/58892/cwd (readlink: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58892 rocksdb:l ceph rtd unknown /proc/58237/task/58892/root (readlink: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58892 rocksdb:l ceph txt unknown /proc/58237/task/58892/exe (readlink: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58892 rocksdb:l ceph NOFD /proc/58237/task/58892/fd (opendir: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58893 rocksdb:h ceph cwd unknown /proc/58237/task/58893/cwd (readlink: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58893 rocksdb:h ceph rtd unknown /proc/58237/task/58893/root (readlink: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58893 rocksdb:h ceph txt unknown /proc/58237/task/58893/exe (readlink: Permission denied) 2024-09-12T02:01:21.310 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 58893 rocksdb:h ceph NOFD /proc/58237/task/58893/fd (opendir: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59340 bstore_ai ceph cwd unknown /proc/58237/task/59340/cwd (readlink: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59340 bstore_ai ceph rtd unknown /proc/58237/task/59340/root (readlink: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59340 bstore_ai ceph txt unknown /proc/58237/task/59340/exe (readlink: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59340 bstore_ai ceph NOFD /proc/58237/task/59340/fd (opendir: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59540 bstore_ai ceph cwd unknown /proc/58237/task/59540/cwd (readlink: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59540 bstore_ai ceph rtd unknown /proc/58237/task/59540/root (readlink: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59540 bstore_ai ceph txt unknown /proc/58237/task/59540/exe (readlink: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59540 bstore_ai ceph NOFD /proc/58237/task/59540/fd (opendir: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59724 ceph-osd ceph cwd unknown /proc/58237/task/59724/cwd (readlink: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59724 ceph-osd ceph rtd unknown /proc/58237/task/59724/root (readlink: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59724 ceph-osd ceph txt unknown /proc/58237/task/59724/exe (readlink: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59724 ceph-osd ceph NOFD /proc/58237/task/59724/fd (opendir: Permission denied) 2024-09-12T02:01:21.311 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59725 cfin ceph cwd unknown /proc/58237/task/59725/cwd (readlink: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59725 cfin ceph rtd unknown /proc/58237/task/59725/root (readlink: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59725 cfin ceph txt unknown /proc/58237/task/59725/exe (readlink: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59725 cfin ceph NOFD /proc/58237/task/59725/fd (opendir: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59726 bstore_kv ceph cwd unknown /proc/58237/task/59726/cwd (readlink: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59726 bstore_kv ceph rtd unknown /proc/58237/task/59726/root (readlink: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59726 bstore_kv ceph txt unknown /proc/58237/task/59726/exe (readlink: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59726 bstore_kv ceph NOFD /proc/58237/task/59726/fd (opendir: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59727 bstore_kv ceph cwd unknown /proc/58237/task/59727/cwd (readlink: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59727 bstore_kv ceph rtd unknown /proc/58237/task/59727/root (readlink: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59727 bstore_kv ceph txt unknown /proc/58237/task/59727/exe (readlink: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59727 bstore_kv ceph NOFD /proc/58237/task/59727/fd (opendir: Permission denied) 2024-09-12T02:01:21.312 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59728 bstore_me ceph cwd unknown /proc/58237/task/59728/cwd (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59728 bstore_me ceph rtd unknown /proc/58237/task/59728/root (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59728 bstore_me ceph txt unknown /proc/58237/task/59728/exe (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59728 bstore_me ceph NOFD /proc/58237/task/59728/fd (opendir: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59729 ms_dispat ceph cwd unknown /proc/58237/task/59729/cwd (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59729 ms_dispat ceph rtd unknown /proc/58237/task/59729/root (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59729 ms_dispat ceph txt unknown /proc/58237/task/59729/exe (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59729 ms_dispat ceph NOFD /proc/58237/task/59729/fd (opendir: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59730 ms_local ceph cwd unknown /proc/58237/task/59730/cwd (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59730 ms_local ceph rtd unknown /proc/58237/task/59730/root (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59730 ms_local ceph txt unknown /proc/58237/task/59730/exe (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59730 ms_local ceph NOFD /proc/58237/task/59730/fd (opendir: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59731 safe_time ceph cwd unknown /proc/58237/task/59731/cwd (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59731 safe_time ceph rtd unknown /proc/58237/task/59731/root (readlink: Permission denied) 2024-09-12T02:01:21.313 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59731 safe_time ceph txt unknown /proc/58237/task/59731/exe (readlink: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59731 safe_time ceph NOFD /proc/58237/task/59731/fd (opendir: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59732 safe_time ceph cwd unknown /proc/58237/task/59732/cwd (readlink: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59732 safe_time ceph rtd unknown /proc/58237/task/59732/root (readlink: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59732 safe_time ceph txt unknown /proc/58237/task/59732/exe (readlink: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59732 safe_time ceph NOFD /proc/58237/task/59732/fd (opendir: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59733 ms_dispat ceph cwd unknown /proc/58237/task/59733/cwd (readlink: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59733 ms_dispat ceph rtd unknown /proc/58237/task/59733/root (readlink: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59733 ms_dispat ceph txt unknown /proc/58237/task/59733/exe (readlink: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59733 ms_dispat ceph NOFD /proc/58237/task/59733/fd (opendir: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59734 ms_local ceph cwd unknown /proc/58237/task/59734/cwd (readlink: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59734 ms_local ceph rtd unknown /proc/58237/task/59734/root (readlink: Permission denied) 2024-09-12T02:01:21.314 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59734 ms_local ceph txt unknown /proc/58237/task/59734/exe (readlink: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59734 ms_local ceph NOFD /proc/58237/task/59734/fd (opendir: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59735 ms_dispat ceph cwd unknown /proc/58237/task/59735/cwd (readlink: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59735 ms_dispat ceph rtd unknown /proc/58237/task/59735/root (readlink: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59735 ms_dispat ceph txt unknown /proc/58237/task/59735/exe (readlink: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59735 ms_dispat ceph NOFD /proc/58237/task/59735/fd (opendir: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59736 ms_local ceph cwd unknown /proc/58237/task/59736/cwd (readlink: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59736 ms_local ceph rtd unknown /proc/58237/task/59736/root (readlink: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59736 ms_local ceph txt unknown /proc/58237/task/59736/exe (readlink: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59736 ms_local ceph NOFD /proc/58237/task/59736/fd (opendir: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59737 ms_dispat ceph cwd unknown /proc/58237/task/59737/cwd (readlink: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59737 ms_dispat ceph rtd unknown /proc/58237/task/59737/root (readlink: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59737 ms_dispat ceph txt unknown /proc/58237/task/59737/exe (readlink: Permission denied) 2024-09-12T02:01:21.315 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59737 ms_dispat ceph NOFD /proc/58237/task/59737/fd (opendir: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59738 ms_local ceph cwd unknown /proc/58237/task/59738/cwd (readlink: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59738 ms_local ceph rtd unknown /proc/58237/task/59738/root (readlink: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59738 ms_local ceph txt unknown /proc/58237/task/59738/exe (readlink: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59738 ms_local ceph NOFD /proc/58237/task/59738/fd (opendir: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59739 ms_dispat ceph cwd unknown /proc/58237/task/59739/cwd (readlink: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59739 ms_dispat ceph rtd unknown /proc/58237/task/59739/root (readlink: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59739 ms_dispat ceph txt unknown /proc/58237/task/59739/exe (readlink: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59739 ms_dispat ceph NOFD /proc/58237/task/59739/fd (opendir: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59740 ms_local ceph cwd unknown /proc/58237/task/59740/cwd (readlink: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59740 ms_local ceph rtd unknown /proc/58237/task/59740/root (readlink: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59740 ms_local ceph txt unknown /proc/58237/task/59740/exe (readlink: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59740 ms_local ceph NOFD /proc/58237/task/59740/fd (opendir: Permission denied) 2024-09-12T02:01:21.316 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59741 ms_dispat ceph cwd unknown /proc/58237/task/59741/cwd (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59741 ms_dispat ceph rtd unknown /proc/58237/task/59741/root (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59741 ms_dispat ceph txt unknown /proc/58237/task/59741/exe (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59741 ms_dispat ceph NOFD /proc/58237/task/59741/fd (opendir: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59742 ms_local ceph cwd unknown /proc/58237/task/59742/cwd (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59742 ms_local ceph rtd unknown /proc/58237/task/59742/root (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59742 ms_local ceph txt unknown /proc/58237/task/59742/exe (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59742 ms_local ceph NOFD /proc/58237/task/59742/fd (opendir: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59743 ms_dispat ceph cwd unknown /proc/58237/task/59743/cwd (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59743 ms_dispat ceph rtd unknown /proc/58237/task/59743/root (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59743 ms_dispat ceph txt unknown /proc/58237/task/59743/exe (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59743 ms_dispat ceph NOFD /proc/58237/task/59743/fd (opendir: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59744 ms_local ceph cwd unknown /proc/58237/task/59744/cwd (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59744 ms_local ceph rtd unknown /proc/58237/task/59744/root (readlink: Permission denied) 2024-09-12T02:01:21.317 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59744 ms_local ceph txt unknown /proc/58237/task/59744/exe (readlink: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59744 ms_local ceph NOFD /proc/58237/task/59744/fd (opendir: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59745 fn_anonym ceph cwd unknown /proc/58237/task/59745/cwd (readlink: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59745 fn_anonym ceph rtd unknown /proc/58237/task/59745/root (readlink: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59745 fn_anonym ceph txt unknown /proc/58237/task/59745/exe (readlink: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59745 fn_anonym ceph NOFD /proc/58237/task/59745/fd (opendir: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59746 finisher ceph cwd unknown /proc/58237/task/59746/cwd (readlink: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59746 finisher ceph rtd unknown /proc/58237/task/59746/root (readlink: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59746 finisher ceph txt unknown /proc/58237/task/59746/exe (readlink: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59746 finisher ceph NOFD /proc/58237/task/59746/fd (opendir: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59747 safe_time ceph cwd unknown /proc/58237/task/59747/cwd (readlink: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59747 safe_time ceph rtd unknown /proc/58237/task/59747/root (readlink: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59747 safe_time ceph txt unknown /proc/58237/task/59747/exe (readlink: Permission denied) 2024-09-12T02:01:21.318 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59747 safe_time ceph NOFD /proc/58237/task/59747/fd (opendir: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59748 safe_time ceph cwd unknown /proc/58237/task/59748/cwd (readlink: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59748 safe_time ceph rtd unknown /proc/58237/task/59748/root (readlink: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59748 safe_time ceph txt unknown /proc/58237/task/59748/exe (readlink: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59748 safe_time ceph NOFD /proc/58237/task/59748/fd (opendir: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59749 ceph-osd ceph cwd unknown /proc/58237/task/59749/cwd (readlink: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59749 ceph-osd ceph rtd unknown /proc/58237/task/59749/root (readlink: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59749 ceph-osd ceph txt unknown /proc/58237/task/59749/exe (readlink: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59749 ceph-osd ceph NOFD /proc/58237/task/59749/fd (opendir: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59750 osd_srv_a ceph cwd unknown /proc/58237/task/59750/cwd (readlink: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59750 osd_srv_a ceph rtd unknown /proc/58237/task/59750/root (readlink: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59750 osd_srv_a ceph txt unknown /proc/58237/task/59750/exe (readlink: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59750 osd_srv_a ceph NOFD /proc/58237/task/59750/fd (opendir: Permission denied) 2024-09-12T02:01:21.319 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59751 tp_osd_tp ceph cwd unknown /proc/58237/task/59751/cwd (readlink: Permission denied) 2024-09-12T02:01:21.320 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59751 tp_osd_tp ceph rtd unknown /proc/58237/task/59751/root (readlink: Permission denied) 2024-09-12T02:01:21.320 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59751 tp_osd_tp ceph txt unknown /proc/58237/task/59751/exe (readlink: Permission denied) 2024-09-12T02:01:21.320 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59751 tp_osd_tp ceph NOFD /proc/58237/task/59751/fd (opendir: Permission denied) 2024-09-12T02:01:21.320 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59752 tp_osd_tp ceph cwd unknown /proc/58237/task/59752/cwd (readlink: Permission denied) 2024-09-12T02:01:21.320 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59752 tp_osd_tp ceph rtd unknown /proc/58237/task/59752/root (readlink: Permission denied) 2024-09-12T02:01:21.320 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59752 tp_osd_tp ceph txt unknown /proc/58237/task/59752/exe (readlink: Permission denied) 2024-09-12T02:01:21.320 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59752 tp_osd_tp ceph NOFD /proc/58237/task/59752/fd (opendir: Permission denied) 2024-09-12T02:01:21.320 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59753 tp_osd_tp ceph cwd unknown /proc/58237/task/59753/cwd (readlink: Permission denied) 2024-09-12T02:01:21.320 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59753 tp_osd_tp ceph rtd unknown /proc/58237/task/59753/root (readlink: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59753 tp_osd_tp ceph txt unknown /proc/58237/task/59753/exe (readlink: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59753 tp_osd_tp ceph NOFD /proc/58237/task/59753/fd (opendir: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59754 tp_osd_tp ceph cwd unknown /proc/58237/task/59754/cwd (readlink: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59754 tp_osd_tp ceph rtd unknown /proc/58237/task/59754/root (readlink: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59754 tp_osd_tp ceph txt unknown /proc/58237/task/59754/exe (readlink: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59754 tp_osd_tp ceph NOFD /proc/58237/task/59754/fd (opendir: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59755 tp_osd_tp ceph cwd unknown /proc/58237/task/59755/cwd (readlink: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59755 tp_osd_tp ceph rtd unknown /proc/58237/task/59755/root (readlink: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59755 tp_osd_tp ceph txt unknown /proc/58237/task/59755/exe (readlink: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59755 tp_osd_tp ceph NOFD /proc/58237/task/59755/fd (opendir: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59756 tp_osd_tp ceph cwd unknown /proc/58237/task/59756/cwd (readlink: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59756 tp_osd_tp ceph rtd unknown /proc/58237/task/59756/root (readlink: Permission denied) 2024-09-12T02:01:21.321 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59756 tp_osd_tp ceph txt unknown /proc/58237/task/59756/exe (readlink: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59756 tp_osd_tp ceph NOFD /proc/58237/task/59756/fd (opendir: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59757 tp_osd_tp ceph cwd unknown /proc/58237/task/59757/cwd (readlink: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59757 tp_osd_tp ceph rtd unknown /proc/58237/task/59757/root (readlink: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59757 tp_osd_tp ceph txt unknown /proc/58237/task/59757/exe (readlink: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59757 tp_osd_tp ceph NOFD /proc/58237/task/59757/fd (opendir: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59758 tp_osd_tp ceph cwd unknown /proc/58237/task/59758/cwd (readlink: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59758 tp_osd_tp ceph rtd unknown /proc/58237/task/59758/root (readlink: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59758 tp_osd_tp ceph txt unknown /proc/58237/task/59758/exe (readlink: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59758 tp_osd_tp ceph NOFD /proc/58237/task/59758/fd (opendir: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59759 tp_osd_tp ceph cwd unknown /proc/58237/task/59759/cwd (readlink: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59759 tp_osd_tp ceph rtd unknown /proc/58237/task/59759/root (readlink: Permission denied) 2024-09-12T02:01:21.322 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59759 tp_osd_tp ceph txt unknown /proc/58237/task/59759/exe (readlink: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59759 tp_osd_tp ceph NOFD /proc/58237/task/59759/fd (opendir: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59760 tp_osd_tp ceph cwd unknown /proc/58237/task/59760/cwd (readlink: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59760 tp_osd_tp ceph rtd unknown /proc/58237/task/59760/root (readlink: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59760 tp_osd_tp ceph txt unknown /proc/58237/task/59760/exe (readlink: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59760 tp_osd_tp ceph NOFD /proc/58237/task/59760/fd (opendir: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59761 tp_osd_tp ceph cwd unknown /proc/58237/task/59761/cwd (readlink: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59761 tp_osd_tp ceph rtd unknown /proc/58237/task/59761/root (readlink: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59761 tp_osd_tp ceph txt unknown /proc/58237/task/59761/exe (readlink: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59761 tp_osd_tp ceph NOFD /proc/58237/task/59761/fd (opendir: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59762 tp_osd_tp ceph cwd unknown /proc/58237/task/59762/cwd (readlink: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59762 tp_osd_tp ceph rtd unknown /proc/58237/task/59762/root (readlink: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59762 tp_osd_tp ceph txt unknown /proc/58237/task/59762/exe (readlink: Permission denied) 2024-09-12T02:01:21.323 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59762 tp_osd_tp ceph NOFD /proc/58237/task/59762/fd (opendir: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59763 tp_osd_tp ceph cwd unknown /proc/58237/task/59763/cwd (readlink: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59763 tp_osd_tp ceph rtd unknown /proc/58237/task/59763/root (readlink: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59763 tp_osd_tp ceph txt unknown /proc/58237/task/59763/exe (readlink: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59763 tp_osd_tp ceph NOFD /proc/58237/task/59763/fd (opendir: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59764 tp_osd_tp ceph cwd unknown /proc/58237/task/59764/cwd (readlink: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59764 tp_osd_tp ceph rtd unknown /proc/58237/task/59764/root (readlink: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59764 tp_osd_tp ceph txt unknown /proc/58237/task/59764/exe (readlink: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59764 tp_osd_tp ceph NOFD /proc/58237/task/59764/fd (opendir: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59765 tp_osd_tp ceph cwd unknown /proc/58237/task/59765/cwd (readlink: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59765 tp_osd_tp ceph rtd unknown /proc/58237/task/59765/root (readlink: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59765 tp_osd_tp ceph txt unknown /proc/58237/task/59765/exe (readlink: Permission denied) 2024-09-12T02:01:21.324 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59765 tp_osd_tp ceph NOFD /proc/58237/task/59765/fd (opendir: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59766 tp_osd_tp ceph cwd unknown /proc/58237/task/59766/cwd (readlink: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59766 tp_osd_tp ceph rtd unknown /proc/58237/task/59766/root (readlink: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59766 tp_osd_tp ceph txt unknown /proc/58237/task/59766/exe (readlink: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59766 tp_osd_tp ceph NOFD /proc/58237/task/59766/fd (opendir: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59767 osd_srv_h ceph cwd unknown /proc/58237/task/59767/cwd (readlink: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59767 osd_srv_h ceph rtd unknown /proc/58237/task/59767/root (readlink: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59767 osd_srv_h ceph txt unknown /proc/58237/task/59767/exe (readlink: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 58237 59767 osd_srv_h ceph NOFD /proc/58237/task/59767/fd (opendir: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 59286 root cwd unknown /proc/59286/cwd (readlink: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 59286 root rtd unknown /proc/59286/root (readlink: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 59286 root txt unknown /proc/59286/exe (readlink: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 59286 root NOFD /proc/59286/fd (opendir: Permission denied) 2024-09-12T02:01:21.325 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 59305 root cwd unknown /proc/59305/cwd (readlink: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 59305 root rtd unknown /proc/59305/root (readlink: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 59305 root txt unknown /proc/59305/exe (readlink: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 59305 root NOFD /proc/59305/fd (opendir: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 65234 root cwd unknown /proc/65234/cwd (readlink: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 65234 root rtd unknown /proc/65234/root (readlink: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 65234 root txt unknown /proc/65234/exe (readlink: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 65234 root NOFD /proc/65234/fd (opendir: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 65236 root cwd unknown /proc/65236/cwd (readlink: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 65236 root rtd unknown /proc/65236/root (readlink: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 65236 root txt unknown /proc/65236/exe (readlink: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 65236 root NOFD /proc/65236/fd (opendir: Permission denied) 2024-09-12T02:01:21.326 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 ceph cwd unknown /proc/65238/cwd (readlink: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 ceph rtd unknown /proc/65238/root (readlink: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 ceph txt unknown /proc/65238/exe (readlink: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 ceph NOFD /proc/65238/fd (opendir: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65239 log ceph cwd unknown /proc/65238/task/65239/cwd (readlink: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65239 log ceph rtd unknown /proc/65238/task/65239/root (readlink: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65239 log ceph txt unknown /proc/65238/task/65239/exe (readlink: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65239 log ceph NOFD /proc/65238/task/65239/fd (opendir: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65241 msgr-work ceph cwd unknown /proc/65238/task/65241/cwd (readlink: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65241 msgr-work ceph rtd unknown /proc/65238/task/65241/root (readlink: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65241 msgr-work ceph txt unknown /proc/65238/task/65241/exe (readlink: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65241 msgr-work ceph NOFD /proc/65238/task/65241/fd (opendir: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65242 msgr-work ceph cwd unknown /proc/65238/task/65242/cwd (readlink: Permission denied) 2024-09-12T02:01:21.327 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65242 msgr-work ceph rtd unknown /proc/65238/task/65242/root (readlink: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65242 msgr-work ceph txt unknown /proc/65238/task/65242/exe (readlink: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65242 msgr-work ceph NOFD /proc/65238/task/65242/fd (opendir: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65243 msgr-work ceph cwd unknown /proc/65238/task/65243/cwd (readlink: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65243 msgr-work ceph rtd unknown /proc/65238/task/65243/root (readlink: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65243 msgr-work ceph txt unknown /proc/65238/task/65243/exe (readlink: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65243 msgr-work ceph NOFD /proc/65238/task/65243/fd (opendir: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65247 service ceph cwd unknown /proc/65238/task/65247/cwd (readlink: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65247 service ceph rtd unknown /proc/65238/task/65247/root (readlink: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65247 service ceph txt unknown /proc/65238/task/65247/exe (readlink: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65247 service ceph NOFD /proc/65238/task/65247/fd (opendir: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65248 admin_soc ceph cwd unknown /proc/65238/task/65248/cwd (readlink: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65248 admin_soc ceph rtd unknown /proc/65238/task/65248/root (readlink: Permission denied) 2024-09-12T02:01:21.328 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65248 admin_soc ceph txt unknown /proc/65238/task/65248/exe (readlink: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65248 admin_soc ceph NOFD /proc/65238/task/65248/fd (opendir: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65577 signal_ha ceph cwd unknown /proc/65238/task/65577/cwd (readlink: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65577 signal_ha ceph rtd unknown /proc/65238/task/65577/root (readlink: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65577 signal_ha ceph txt unknown /proc/65238/task/65577/exe (readlink: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65577 signal_ha ceph NOFD /proc/65238/task/65577/fd (opendir: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65578 io_contex ceph cwd unknown /proc/65238/task/65578/cwd (readlink: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65578 io_contex ceph rtd unknown /proc/65238/task/65578/root (readlink: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65578 io_contex ceph txt unknown /proc/65238/task/65578/exe (readlink: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65578 io_contex ceph NOFD /proc/65238/task/65578/fd (opendir: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65579 io_contex ceph cwd unknown /proc/65238/task/65579/cwd (readlink: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65579 io_contex ceph rtd unknown /proc/65238/task/65579/root (readlink: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65579 io_contex ceph txt unknown /proc/65238/task/65579/exe (readlink: Permission denied) 2024-09-12T02:01:21.329 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65579 io_contex ceph NOFD /proc/65238/task/65579/fd (opendir: Permission denied) 2024-09-12T02:01:21.330 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65595 OpHistory ceph cwd unknown /proc/65238/task/65595/cwd (readlink: Permission denied) 2024-09-12T02:01:21.330 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65595 OpHistory ceph rtd unknown /proc/65238/task/65595/root (readlink: Permission denied) 2024-09-12T02:01:21.330 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65595 OpHistory ceph txt unknown /proc/65238/task/65595/exe (readlink: Permission denied) 2024-09-12T02:01:21.330 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65595 OpHistory ceph NOFD /proc/65238/task/65595/fd (opendir: Permission denied) 2024-09-12T02:01:21.330 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65596 ceph_time ceph cwd unknown /proc/65238/task/65596/cwd (readlink: Permission denied) 2024-09-12T02:01:21.330 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65596 ceph_time ceph rtd unknown /proc/65238/task/65596/root (readlink: Permission denied) 2024-09-12T02:01:21.330 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65596 ceph_time ceph txt unknown /proc/65238/task/65596/exe (readlink: Permission denied) 2024-09-12T02:01:21.330 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65596 ceph_time ceph NOFD /proc/65238/task/65596/fd (opendir: Permission denied) 2024-09-12T02:01:21.330 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65808 ceph-osd ceph cwd unknown /proc/65238/task/65808/cwd (readlink: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65808 ceph-osd ceph rtd unknown /proc/65238/task/65808/root (readlink: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65808 ceph-osd ceph txt unknown /proc/65238/task/65808/exe (readlink: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65808 ceph-osd ceph NOFD /proc/65238/task/65808/fd (opendir: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65809 safe_time ceph cwd unknown /proc/65238/task/65809/cwd (readlink: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65809 safe_time ceph rtd unknown /proc/65238/task/65809/root (readlink: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65809 safe_time ceph txt unknown /proc/65238/task/65809/exe (readlink: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65809 safe_time ceph NOFD /proc/65238/task/65809/fd (opendir: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65810 safe_time ceph cwd unknown /proc/65238/task/65810/cwd (readlink: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65810 safe_time ceph rtd unknown /proc/65238/task/65810/root (readlink: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65810 safe_time ceph txt unknown /proc/65238/task/65810/exe (readlink: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65810 safe_time ceph NOFD /proc/65238/task/65810/fd (opendir: Permission denied) 2024-09-12T02:01:21.331 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65811 safe_time ceph cwd unknown /proc/65238/task/65811/cwd (readlink: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65811 safe_time ceph rtd unknown /proc/65238/task/65811/root (readlink: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65811 safe_time ceph txt unknown /proc/65238/task/65811/exe (readlink: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65811 safe_time ceph NOFD /proc/65238/task/65811/fd (opendir: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65812 safe_time ceph cwd unknown /proc/65238/task/65812/cwd (readlink: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65812 safe_time ceph rtd unknown /proc/65238/task/65812/root (readlink: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65812 safe_time ceph txt unknown /proc/65238/task/65812/exe (readlink: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65812 safe_time ceph NOFD /proc/65238/task/65812/fd (opendir: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65813 fn_anonym ceph cwd unknown /proc/65238/task/65813/cwd (readlink: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65813 fn_anonym ceph rtd unknown /proc/65238/task/65813/root (readlink: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65813 fn_anonym ceph txt unknown /proc/65238/task/65813/exe (readlink: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65813 fn_anonym ceph NOFD /proc/65238/task/65813/fd (opendir: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65904 rocksdb:l ceph cwd unknown /proc/65238/task/65904/cwd (readlink: Permission denied) 2024-09-12T02:01:21.332 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65904 rocksdb:l ceph rtd unknown /proc/65238/task/65904/root (readlink: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65904 rocksdb:l ceph txt unknown /proc/65238/task/65904/exe (readlink: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65904 rocksdb:l ceph NOFD /proc/65238/task/65904/fd (opendir: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65905 rocksdb:l ceph cwd unknown /proc/65238/task/65905/cwd (readlink: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65905 rocksdb:l ceph rtd unknown /proc/65238/task/65905/root (readlink: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65905 rocksdb:l ceph txt unknown /proc/65238/task/65905/exe (readlink: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65905 rocksdb:l ceph NOFD /proc/65238/task/65905/fd (opendir: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65906 rocksdb:l ceph cwd unknown /proc/65238/task/65906/cwd (readlink: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65906 rocksdb:l ceph rtd unknown /proc/65238/task/65906/root (readlink: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65906 rocksdb:l ceph txt unknown /proc/65238/task/65906/exe (readlink: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65906 rocksdb:l ceph NOFD /proc/65238/task/65906/fd (opendir: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65907 rocksdb:h ceph cwd unknown /proc/65238/task/65907/cwd (readlink: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65907 rocksdb:h ceph rtd unknown /proc/65238/task/65907/root (readlink: Permission denied) 2024-09-12T02:01:21.333 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65907 rocksdb:h ceph txt unknown /proc/65238/task/65907/exe (readlink: Permission denied) 2024-09-12T02:01:21.334 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 65907 rocksdb:h ceph NOFD /proc/65238/task/65907/fd (opendir: Permission denied) 2024-09-12T02:01:21.334 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66354 bstore_ai ceph cwd unknown /proc/65238/task/66354/cwd (readlink: Permission denied) 2024-09-12T02:01:21.334 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66354 bstore_ai ceph rtd unknown /proc/65238/task/66354/root (readlink: Permission denied) 2024-09-12T02:01:21.334 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66354 bstore_ai ceph txt unknown /proc/65238/task/66354/exe (readlink: Permission denied) 2024-09-12T02:01:21.334 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66354 bstore_ai ceph NOFD /proc/65238/task/66354/fd (opendir: Permission denied) 2024-09-12T02:01:21.334 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66543 bstore_ai ceph cwd unknown /proc/65238/task/66543/cwd (readlink: Permission denied) 2024-09-12T02:01:21.334 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66543 bstore_ai ceph rtd unknown /proc/65238/task/66543/root (readlink: Permission denied) 2024-09-12T02:01:21.334 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66543 bstore_ai ceph txt unknown /proc/65238/task/66543/exe (readlink: Permission denied) 2024-09-12T02:01:21.334 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66543 bstore_ai ceph NOFD /proc/65238/task/66543/fd (opendir: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66726 ceph-osd ceph cwd unknown /proc/65238/task/66726/cwd (readlink: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66726 ceph-osd ceph rtd unknown /proc/65238/task/66726/root (readlink: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66726 ceph-osd ceph txt unknown /proc/65238/task/66726/exe (readlink: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66726 ceph-osd ceph NOFD /proc/65238/task/66726/fd (opendir: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66727 cfin ceph cwd unknown /proc/65238/task/66727/cwd (readlink: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66727 cfin ceph rtd unknown /proc/65238/task/66727/root (readlink: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66727 cfin ceph txt unknown /proc/65238/task/66727/exe (readlink: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66727 cfin ceph NOFD /proc/65238/task/66727/fd (opendir: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66728 bstore_kv ceph cwd unknown /proc/65238/task/66728/cwd (readlink: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66728 bstore_kv ceph rtd unknown /proc/65238/task/66728/root (readlink: Permission denied) 2024-09-12T02:01:21.335 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66728 bstore_kv ceph txt unknown /proc/65238/task/66728/exe (readlink: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66728 bstore_kv ceph NOFD /proc/65238/task/66728/fd (opendir: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66729 bstore_kv ceph cwd unknown /proc/65238/task/66729/cwd (readlink: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66729 bstore_kv ceph rtd unknown /proc/65238/task/66729/root (readlink: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66729 bstore_kv ceph txt unknown /proc/65238/task/66729/exe (readlink: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66729 bstore_kv ceph NOFD /proc/65238/task/66729/fd (opendir: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66730 bstore_me ceph cwd unknown /proc/65238/task/66730/cwd (readlink: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66730 bstore_me ceph rtd unknown /proc/65238/task/66730/root (readlink: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66730 bstore_me ceph txt unknown /proc/65238/task/66730/exe (readlink: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66730 bstore_me ceph NOFD /proc/65238/task/66730/fd (opendir: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66731 ms_dispat ceph cwd unknown /proc/65238/task/66731/cwd (readlink: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66731 ms_dispat ceph rtd unknown /proc/65238/task/66731/root (readlink: Permission denied) 2024-09-12T02:01:21.336 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66731 ms_dispat ceph txt unknown /proc/65238/task/66731/exe (readlink: Permission denied) 2024-09-12T02:01:21.337 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66731 ms_dispat ceph NOFD /proc/65238/task/66731/fd (opendir: Permission denied) 2024-09-12T02:01:21.337 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66732 ms_local ceph cwd unknown /proc/65238/task/66732/cwd (readlink: Permission denied) 2024-09-12T02:01:21.337 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66732 ms_local ceph rtd unknown /proc/65238/task/66732/root (readlink: Permission denied) 2024-09-12T02:01:21.337 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66732 ms_local ceph txt unknown /proc/65238/task/66732/exe (readlink: Permission denied) 2024-09-12T02:01:21.337 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66732 ms_local ceph NOFD /proc/65238/task/66732/fd (opendir: Permission denied) 2024-09-12T02:01:21.337 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66733 safe_time ceph cwd unknown /proc/65238/task/66733/cwd (readlink: Permission denied) 2024-09-12T02:01:21.337 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66733 safe_time ceph rtd unknown /proc/65238/task/66733/root (readlink: Permission denied) 2024-09-12T02:01:21.337 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66733 safe_time ceph txt unknown /proc/65238/task/66733/exe (readlink: Permission denied) 2024-09-12T02:01:21.337 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66733 safe_time ceph NOFD /proc/65238/task/66733/fd (opendir: Permission denied) 2024-09-12T02:01:21.337 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66734 safe_time ceph cwd unknown /proc/65238/task/66734/cwd (readlink: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66734 safe_time ceph rtd unknown /proc/65238/task/66734/root (readlink: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66734 safe_time ceph txt unknown /proc/65238/task/66734/exe (readlink: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66734 safe_time ceph NOFD /proc/65238/task/66734/fd (opendir: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66735 ms_dispat ceph cwd unknown /proc/65238/task/66735/cwd (readlink: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66735 ms_dispat ceph rtd unknown /proc/65238/task/66735/root (readlink: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66735 ms_dispat ceph txt unknown /proc/65238/task/66735/exe (readlink: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66735 ms_dispat ceph NOFD /proc/65238/task/66735/fd (opendir: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66736 ms_local ceph cwd unknown /proc/65238/task/66736/cwd (readlink: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66736 ms_local ceph rtd unknown /proc/65238/task/66736/root (readlink: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66736 ms_local ceph txt unknown /proc/65238/task/66736/exe (readlink: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66736 ms_local ceph NOFD /proc/65238/task/66736/fd (opendir: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66737 ms_dispat ceph cwd unknown /proc/65238/task/66737/cwd (readlink: Permission denied) 2024-09-12T02:01:21.338 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66737 ms_dispat ceph rtd unknown /proc/65238/task/66737/root (readlink: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66737 ms_dispat ceph txt unknown /proc/65238/task/66737/exe (readlink: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66737 ms_dispat ceph NOFD /proc/65238/task/66737/fd (opendir: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66738 ms_local ceph cwd unknown /proc/65238/task/66738/cwd (readlink: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66738 ms_local ceph rtd unknown /proc/65238/task/66738/root (readlink: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66738 ms_local ceph txt unknown /proc/65238/task/66738/exe (readlink: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66738 ms_local ceph NOFD /proc/65238/task/66738/fd (opendir: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66739 ms_dispat ceph cwd unknown /proc/65238/task/66739/cwd (readlink: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66739 ms_dispat ceph rtd unknown /proc/65238/task/66739/root (readlink: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66739 ms_dispat ceph txt unknown /proc/65238/task/66739/exe (readlink: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66739 ms_dispat ceph NOFD /proc/65238/task/66739/fd (opendir: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66740 ms_local ceph cwd unknown /proc/65238/task/66740/cwd (readlink: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66740 ms_local ceph rtd unknown /proc/65238/task/66740/root (readlink: Permission denied) 2024-09-12T02:01:21.339 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66740 ms_local ceph txt unknown /proc/65238/task/66740/exe (readlink: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66740 ms_local ceph NOFD /proc/65238/task/66740/fd (opendir: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66741 ms_dispat ceph cwd unknown /proc/65238/task/66741/cwd (readlink: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66741 ms_dispat ceph rtd unknown /proc/65238/task/66741/root (readlink: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66741 ms_dispat ceph txt unknown /proc/65238/task/66741/exe (readlink: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66741 ms_dispat ceph NOFD /proc/65238/task/66741/fd (opendir: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66742 ms_local ceph cwd unknown /proc/65238/task/66742/cwd (readlink: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66742 ms_local ceph rtd unknown /proc/65238/task/66742/root (readlink: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66742 ms_local ceph txt unknown /proc/65238/task/66742/exe (readlink: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66742 ms_local ceph NOFD /proc/65238/task/66742/fd (opendir: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66743 ms_dispat ceph cwd unknown /proc/65238/task/66743/cwd (readlink: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66743 ms_dispat ceph rtd unknown /proc/65238/task/66743/root (readlink: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66743 ms_dispat ceph txt unknown /proc/65238/task/66743/exe (readlink: Permission denied) 2024-09-12T02:01:21.340 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66743 ms_dispat ceph NOFD /proc/65238/task/66743/fd (opendir: Permission denied) 2024-09-12T02:01:21.341 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66744 ms_local ceph cwd unknown /proc/65238/task/66744/cwd (readlink: Permission denied) 2024-09-12T02:01:21.341 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66744 ms_local ceph rtd unknown /proc/65238/task/66744/root (readlink: Permission denied) 2024-09-12T02:01:21.341 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66744 ms_local ceph txt unknown /proc/65238/task/66744/exe (readlink: Permission denied) 2024-09-12T02:01:21.341 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66744 ms_local ceph NOFD /proc/65238/task/66744/fd (opendir: Permission denied) 2024-09-12T02:01:21.341 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66745 ms_dispat ceph cwd unknown /proc/65238/task/66745/cwd (readlink: Permission denied) 2024-09-12T02:01:21.341 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66745 ms_dispat ceph rtd unknown /proc/65238/task/66745/root (readlink: Permission denied) 2024-09-12T02:01:21.341 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66745 ms_dispat ceph txt unknown /proc/65238/task/66745/exe (readlink: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66745 ms_dispat ceph NOFD /proc/65238/task/66745/fd (opendir: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66746 ms_local ceph cwd unknown /proc/65238/task/66746/cwd (readlink: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66746 ms_local ceph rtd unknown /proc/65238/task/66746/root (readlink: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66746 ms_local ceph txt unknown /proc/65238/task/66746/exe (readlink: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66746 ms_local ceph NOFD /proc/65238/task/66746/fd (opendir: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66747 fn_anonym ceph cwd unknown /proc/65238/task/66747/cwd (readlink: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66747 fn_anonym ceph rtd unknown /proc/65238/task/66747/root (readlink: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66747 fn_anonym ceph txt unknown /proc/65238/task/66747/exe (readlink: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66747 fn_anonym ceph NOFD /proc/65238/task/66747/fd (opendir: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66748 finisher ceph cwd unknown /proc/65238/task/66748/cwd (readlink: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66748 finisher ceph rtd unknown /proc/65238/task/66748/root (readlink: Permission denied) 2024-09-12T02:01:21.342 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66748 finisher ceph txt unknown /proc/65238/task/66748/exe (readlink: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66748 finisher ceph NOFD /proc/65238/task/66748/fd (opendir: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66749 safe_time ceph cwd unknown /proc/65238/task/66749/cwd (readlink: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66749 safe_time ceph rtd unknown /proc/65238/task/66749/root (readlink: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66749 safe_time ceph txt unknown /proc/65238/task/66749/exe (readlink: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66749 safe_time ceph NOFD /proc/65238/task/66749/fd (opendir: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66750 safe_time ceph cwd unknown /proc/65238/task/66750/cwd (readlink: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66750 safe_time ceph rtd unknown /proc/65238/task/66750/root (readlink: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66750 safe_time ceph txt unknown /proc/65238/task/66750/exe (readlink: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66750 safe_time ceph NOFD /proc/65238/task/66750/fd (opendir: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66751 ceph-osd ceph cwd unknown /proc/65238/task/66751/cwd (readlink: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66751 ceph-osd ceph rtd unknown /proc/65238/task/66751/root (readlink: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66751 ceph-osd ceph txt unknown /proc/65238/task/66751/exe (readlink: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66751 ceph-osd ceph NOFD /proc/65238/task/66751/fd (opendir: Permission denied) 2024-09-12T02:01:21.343 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66752 osd_srv_a ceph cwd unknown /proc/65238/task/66752/cwd (readlink: Permission denied) 2024-09-12T02:01:21.344 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66752 osd_srv_a ceph rtd unknown /proc/65238/task/66752/root (readlink: Permission denied) 2024-09-12T02:01:21.344 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66752 osd_srv_a ceph txt unknown /proc/65238/task/66752/exe (readlink: Permission denied) 2024-09-12T02:01:21.344 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66752 osd_srv_a ceph NOFD /proc/65238/task/66752/fd (opendir: Permission denied) 2024-09-12T02:01:21.344 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66753 tp_osd_tp ceph cwd unknown /proc/65238/task/66753/cwd (readlink: Permission denied) 2024-09-12T02:01:21.344 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66753 tp_osd_tp ceph rtd unknown /proc/65238/task/66753/root (readlink: Permission denied) 2024-09-12T02:01:21.344 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66753 tp_osd_tp ceph txt unknown /proc/65238/task/66753/exe (readlink: Permission denied) 2024-09-12T02:01:21.344 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66753 tp_osd_tp ceph NOFD /proc/65238/task/66753/fd (opendir: Permission denied) 2024-09-12T02:01:21.344 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66754 tp_osd_tp ceph cwd unknown /proc/65238/task/66754/cwd (readlink: Permission denied) 2024-09-12T02:01:21.344 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66754 tp_osd_tp ceph rtd unknown /proc/65238/task/66754/root (readlink: Permission denied) 2024-09-12T02:01:21.344 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66754 tp_osd_tp ceph txt unknown /proc/65238/task/66754/exe (readlink: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66754 tp_osd_tp ceph NOFD /proc/65238/task/66754/fd (opendir: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66755 tp_osd_tp ceph cwd unknown /proc/65238/task/66755/cwd (readlink: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66755 tp_osd_tp ceph rtd unknown /proc/65238/task/66755/root (readlink: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66755 tp_osd_tp ceph txt unknown /proc/65238/task/66755/exe (readlink: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66755 tp_osd_tp ceph NOFD /proc/65238/task/66755/fd (opendir: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66756 tp_osd_tp ceph cwd unknown /proc/65238/task/66756/cwd (readlink: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66756 tp_osd_tp ceph rtd unknown /proc/65238/task/66756/root (readlink: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66756 tp_osd_tp ceph txt unknown /proc/65238/task/66756/exe (readlink: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66756 tp_osd_tp ceph NOFD /proc/65238/task/66756/fd (opendir: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66757 tp_osd_tp ceph cwd unknown /proc/65238/task/66757/cwd (readlink: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66757 tp_osd_tp ceph rtd unknown /proc/65238/task/66757/root (readlink: Permission denied) 2024-09-12T02:01:21.345 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66757 tp_osd_tp ceph txt unknown /proc/65238/task/66757/exe (readlink: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66757 tp_osd_tp ceph NOFD /proc/65238/task/66757/fd (opendir: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66758 tp_osd_tp ceph cwd unknown /proc/65238/task/66758/cwd (readlink: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66758 tp_osd_tp ceph rtd unknown /proc/65238/task/66758/root (readlink: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66758 tp_osd_tp ceph txt unknown /proc/65238/task/66758/exe (readlink: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66758 tp_osd_tp ceph NOFD /proc/65238/task/66758/fd (opendir: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66759 tp_osd_tp ceph cwd unknown /proc/65238/task/66759/cwd (readlink: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66759 tp_osd_tp ceph rtd unknown /proc/65238/task/66759/root (readlink: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66759 tp_osd_tp ceph txt unknown /proc/65238/task/66759/exe (readlink: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66759 tp_osd_tp ceph NOFD /proc/65238/task/66759/fd (opendir: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66760 tp_osd_tp ceph cwd unknown /proc/65238/task/66760/cwd (readlink: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66760 tp_osd_tp ceph rtd unknown /proc/65238/task/66760/root (readlink: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66760 tp_osd_tp ceph txt unknown /proc/65238/task/66760/exe (readlink: Permission denied) 2024-09-12T02:01:21.346 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66760 tp_osd_tp ceph NOFD /proc/65238/task/66760/fd (opendir: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66761 tp_osd_tp ceph cwd unknown /proc/65238/task/66761/cwd (readlink: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66761 tp_osd_tp ceph rtd unknown /proc/65238/task/66761/root (readlink: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66761 tp_osd_tp ceph txt unknown /proc/65238/task/66761/exe (readlink: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66761 tp_osd_tp ceph NOFD /proc/65238/task/66761/fd (opendir: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66762 tp_osd_tp ceph cwd unknown /proc/65238/task/66762/cwd (readlink: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66762 tp_osd_tp ceph rtd unknown /proc/65238/task/66762/root (readlink: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66762 tp_osd_tp ceph txt unknown /proc/65238/task/66762/exe (readlink: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66762 tp_osd_tp ceph NOFD /proc/65238/task/66762/fd (opendir: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66763 tp_osd_tp ceph cwd unknown /proc/65238/task/66763/cwd (readlink: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66763 tp_osd_tp ceph rtd unknown /proc/65238/task/66763/root (readlink: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66763 tp_osd_tp ceph txt unknown /proc/65238/task/66763/exe (readlink: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66763 tp_osd_tp ceph NOFD /proc/65238/task/66763/fd (opendir: Permission denied) 2024-09-12T02:01:21.347 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66764 tp_osd_tp ceph cwd unknown /proc/65238/task/66764/cwd (readlink: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66764 tp_osd_tp ceph rtd unknown /proc/65238/task/66764/root (readlink: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66764 tp_osd_tp ceph txt unknown /proc/65238/task/66764/exe (readlink: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66764 tp_osd_tp ceph NOFD /proc/65238/task/66764/fd (opendir: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66765 tp_osd_tp ceph cwd unknown /proc/65238/task/66765/cwd (readlink: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66765 tp_osd_tp ceph rtd unknown /proc/65238/task/66765/root (readlink: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66765 tp_osd_tp ceph txt unknown /proc/65238/task/66765/exe (readlink: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66765 tp_osd_tp ceph NOFD /proc/65238/task/66765/fd (opendir: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66766 tp_osd_tp ceph cwd unknown /proc/65238/task/66766/cwd (readlink: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66766 tp_osd_tp ceph rtd unknown /proc/65238/task/66766/root (readlink: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66766 tp_osd_tp ceph txt unknown /proc/65238/task/66766/exe (readlink: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66766 tp_osd_tp ceph NOFD /proc/65238/task/66766/fd (opendir: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66767 tp_osd_tp ceph cwd unknown /proc/65238/task/66767/cwd (readlink: Permission denied) 2024-09-12T02:01:21.348 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66767 tp_osd_tp ceph rtd unknown /proc/65238/task/66767/root (readlink: Permission denied) 2024-09-12T02:01:21.349 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66767 tp_osd_tp ceph txt unknown /proc/65238/task/66767/exe (readlink: Permission denied) 2024-09-12T02:01:21.349 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66767 tp_osd_tp ceph NOFD /proc/65238/task/66767/fd (opendir: Permission denied) 2024-09-12T02:01:21.349 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66768 tp_osd_tp ceph cwd unknown /proc/65238/task/66768/cwd (readlink: Permission denied) 2024-09-12T02:01:21.349 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66768 tp_osd_tp ceph rtd unknown /proc/65238/task/66768/root (readlink: Permission denied) 2024-09-12T02:01:21.349 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66768 tp_osd_tp ceph txt unknown /proc/65238/task/66768/exe (readlink: Permission denied) 2024-09-12T02:01:21.349 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66768 tp_osd_tp ceph NOFD /proc/65238/task/66768/fd (opendir: Permission denied) 2024-09-12T02:01:21.349 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66769 osd_srv_h ceph cwd unknown /proc/65238/task/66769/cwd (readlink: Permission denied) 2024-09-12T02:01:21.349 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66769 osd_srv_h ceph rtd unknown /proc/65238/task/66769/root (readlink: Permission denied) 2024-09-12T02:01:21.349 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66769 osd_srv_h ceph txt unknown /proc/65238/task/66769/exe (readlink: Permission denied) 2024-09-12T02:01:21.349 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-osd 65238 66769 osd_srv_h ceph NOFD /proc/65238/task/66769/fd (opendir: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 65250 root cwd unknown /proc/65250/cwd (readlink: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 65250 root rtd unknown /proc/65250/root (readlink: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 65250 root txt unknown /proc/65250/exe (readlink: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/u 65250 root NOFD /proc/65250/fd (opendir: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 66304 root cwd unknown /proc/66304/cwd (readlink: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 66304 root rtd unknown /proc/66304/root (readlink: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 66304 root txt unknown /proc/66304/exe (readlink: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 66304 root NOFD /proc/66304/fd (opendir: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 66331 root cwd unknown /proc/66331/cwd (readlink: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 66331 root rtd unknown /proc/66331/root (readlink: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 66331 root txt unknown /proc/66331/exe (readlink: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 66331 root NOFD /proc/66331/fd (opendir: Permission denied) 2024-09-12T02:01:21.350 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 69296 root cwd unknown /proc/69296/cwd (readlink: Permission denied) 2024-09-12T02:01:21.351 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 69296 root rtd unknown /proc/69296/root (readlink: Permission denied) 2024-09-12T02:01:21.351 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 69296 root txt unknown /proc/69296/exe (readlink: Permission denied) 2024-09-12T02:01:21.351 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 69296 root NOFD /proc/69296/fd (opendir: Permission denied) 2024-09-12T02:01:21.351 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 69999 root cwd unknown /proc/69999/cwd (readlink: Permission denied) 2024-09-12T02:01:21.351 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 69999 root rtd unknown /proc/69999/root (readlink: Permission denied) 2024-09-12T02:01:21.351 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 69999 root txt unknown /proc/69999/exe (readlink: Permission denied) 2024-09-12T02:01:21.351 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 69999 root NOFD /proc/69999/fd (opendir: Permission denied) 2024-09-12T02:01:21.351 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70015 root cwd unknown /proc/70015/cwd (readlink: Permission denied) 2024-09-12T02:01:21.351 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70015 root rtd unknown /proc/70015/root (readlink: Permission denied) 2024-09-12T02:01:21.351 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70015 root txt unknown /proc/70015/exe (readlink: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70015 root NOFD /proc/70015/fd (opendir: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70020 root cwd unknown /proc/70020/cwd (readlink: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70020 root rtd unknown /proc/70020/root (readlink: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70020 root txt unknown /proc/70020/exe (readlink: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70020 root NOFD /proc/70020/fd (opendir: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70034 root cwd unknown /proc/70034/cwd (readlink: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70034 root rtd unknown /proc/70034/root (readlink: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70034 root txt unknown /proc/70034/exe (readlink: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70034 root NOFD /proc/70034/fd (opendir: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70037 root cwd unknown /proc/70037/cwd (readlink: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70037 root rtd unknown /proc/70037/root (readlink: Permission denied) 2024-09-12T02:01:21.352 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70037 root txt unknown /proc/70037/exe (readlink: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70037 root NOFD /proc/70037/fd (opendir: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70052 root cwd unknown /proc/70052/cwd (readlink: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70052 root rtd unknown /proc/70052/root (readlink: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70052 root txt unknown /proc/70052/exe (readlink: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:sudo 70052 root NOFD /proc/70052/fd (opendir: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70053 root cwd unknown /proc/70053/cwd (readlink: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70053 root rtd unknown /proc/70053/root (readlink: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70053 root txt unknown /proc/70053/exe (readlink: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70053 root NOFD /proc/70053/fd (opendir: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70070 root cwd unknown /proc/70070/cwd (readlink: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70070 root rtd unknown /proc/70070/root (readlink: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70070 root txt unknown /proc/70070/exe (readlink: Permission denied) 2024-09-12T02:01:21.353 INFO:tasks.workunit.client.0.smithi062.stdout:journalct 70070 root NOFD /proc/70070/fd (opendir: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 70182 root cwd unknown /proc/70182/cwd (readlink: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 70182 root rtd unknown /proc/70182/root (readlink: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 70182 root txt unknown /proc/70182/exe (readlink: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/5 70182 root NOFD /proc/70182/fd (opendir: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 70428 root cwd unknown /proc/70428/cwd (readlink: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 70428 root rtd unknown /proc/70428/root (readlink: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 70428 root txt unknown /proc/70428/exe (readlink: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 70428 root NOFD /proc/70428/fd (opendir: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 70566 root cwd unknown /proc/70566/cwd (readlink: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 70566 root rtd unknown /proc/70566/root (readlink: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 70566 root txt unknown /proc/70566/exe (readlink: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 70566 root NOFD /proc/70566/fd (opendir: Permission denied) 2024-09-12T02:01:21.354 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 70568 root cwd unknown /proc/70568/cwd (readlink: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 70568 root rtd unknown /proc/70568/root (readlink: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 70568 root txt unknown /proc/70568/exe (readlink: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 70568 root NOFD /proc/70568/fd (opendir: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 ceph cwd unknown /proc/70570/cwd (readlink: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 ceph rtd unknown /proc/70570/root (readlink: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 ceph txt unknown /proc/70570/exe (readlink: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 ceph NOFD /proc/70570/fd (opendir: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70571 log ceph cwd unknown /proc/70570/task/70571/cwd (readlink: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70571 log ceph rtd unknown /proc/70570/task/70571/root (readlink: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70571 log ceph txt unknown /proc/70570/task/70571/exe (readlink: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70571 log ceph NOFD /proc/70570/task/70571/fd (opendir: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70573 msgr-work ceph cwd unknown /proc/70570/task/70573/cwd (readlink: Permission denied) 2024-09-12T02:01:21.355 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70573 msgr-work ceph rtd unknown /proc/70570/task/70573/root (readlink: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70573 msgr-work ceph txt unknown /proc/70570/task/70573/exe (readlink: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70573 msgr-work ceph NOFD /proc/70570/task/70573/fd (opendir: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70574 msgr-work ceph cwd unknown /proc/70570/task/70574/cwd (readlink: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70574 msgr-work ceph rtd unknown /proc/70570/task/70574/root (readlink: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70574 msgr-work ceph txt unknown /proc/70570/task/70574/exe (readlink: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70574 msgr-work ceph NOFD /proc/70570/task/70574/fd (opendir: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70575 msgr-work ceph cwd unknown /proc/70570/task/70575/cwd (readlink: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70575 msgr-work ceph rtd unknown /proc/70570/task/70575/root (readlink: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70575 msgr-work ceph txt unknown /proc/70570/task/70575/exe (readlink: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70575 msgr-work ceph NOFD /proc/70570/task/70575/fd (opendir: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70579 service ceph cwd unknown /proc/70570/task/70579/cwd (readlink: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70579 service ceph rtd unknown /proc/70570/task/70579/root (readlink: Permission denied) 2024-09-12T02:01:21.356 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70579 service ceph txt unknown /proc/70570/task/70579/exe (readlink: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70579 service ceph NOFD /proc/70570/task/70579/fd (opendir: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70580 admin_soc ceph cwd unknown /proc/70570/task/70580/cwd (readlink: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70580 admin_soc ceph rtd unknown /proc/70570/task/70580/root (readlink: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70580 admin_soc ceph txt unknown /proc/70570/task/70580/exe (readlink: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70580 admin_soc ceph NOFD /proc/70570/task/70580/fd (opendir: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70581 signal_ha ceph cwd unknown /proc/70570/task/70581/cwd (readlink: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70581 signal_ha ceph rtd unknown /proc/70570/task/70581/root (readlink: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70581 signal_ha ceph txt unknown /proc/70570/task/70581/exe (readlink: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70581 signal_ha ceph NOFD /proc/70570/task/70581/fd (opendir: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70582 io_contex ceph cwd unknown /proc/70570/task/70582/cwd (readlink: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70582 io_contex ceph rtd unknown /proc/70570/task/70582/root (readlink: Permission denied) 2024-09-12T02:01:21.357 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70582 io_contex ceph txt unknown /proc/70570/task/70582/exe (readlink: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70582 io_contex ceph NOFD /proc/70570/task/70582/fd (opendir: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70583 io_contex ceph cwd unknown /proc/70570/task/70583/cwd (readlink: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70583 io_contex ceph rtd unknown /proc/70570/task/70583/root (readlink: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70583 io_contex ceph txt unknown /proc/70570/task/70583/exe (readlink: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70583 io_contex ceph NOFD /proc/70570/task/70583/fd (opendir: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70584 ms_dispat ceph cwd unknown /proc/70570/task/70584/cwd (readlink: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70584 ms_dispat ceph rtd unknown /proc/70570/task/70584/root (readlink: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70584 ms_dispat ceph txt unknown /proc/70570/task/70584/exe (readlink: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70584 ms_dispat ceph NOFD /proc/70570/task/70584/fd (opendir: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70585 ms_local ceph cwd unknown /proc/70570/task/70585/cwd (readlink: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70585 ms_local ceph rtd unknown /proc/70570/task/70585/root (readlink: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70585 ms_local ceph txt unknown /proc/70570/task/70585/exe (readlink: Permission denied) 2024-09-12T02:01:21.358 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70585 ms_local ceph NOFD /proc/70570/task/70585/fd (opendir: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70586 safe_time ceph cwd unknown /proc/70570/task/70586/cwd (readlink: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70586 safe_time ceph rtd unknown /proc/70570/task/70586/root (readlink: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70586 safe_time ceph txt unknown /proc/70570/task/70586/exe (readlink: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70586 safe_time ceph NOFD /proc/70570/task/70586/fd (opendir: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70587 safe_time ceph cwd unknown /proc/70570/task/70587/cwd (readlink: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70587 safe_time ceph rtd unknown /proc/70570/task/70587/root (readlink: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70587 safe_time ceph txt unknown /proc/70570/task/70587/exe (readlink: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70587 safe_time ceph NOFD /proc/70570/task/70587/fd (opendir: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70588 ceph-mds ceph cwd unknown /proc/70570/task/70588/cwd (readlink: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70588 ceph-mds ceph rtd unknown /proc/70570/task/70588/root (readlink: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70588 ceph-mds ceph txt unknown /proc/70570/task/70588/exe (readlink: Permission denied) 2024-09-12T02:01:21.359 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70588 ceph-mds ceph NOFD /proc/70570/task/70588/fd (opendir: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70659 safe_time ceph cwd unknown /proc/70570/task/70659/cwd (readlink: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70659 safe_time ceph rtd unknown /proc/70570/task/70659/root (readlink: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70659 safe_time ceph txt unknown /proc/70570/task/70659/exe (readlink: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70570 70659 safe_time ceph NOFD /proc/70570/task/70659/fd (opendir: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 70976 root cwd unknown /proc/70976/cwd (readlink: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 70976 root rtd unknown /proc/70976/root (readlink: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 70976 root txt unknown /proc/70976/exe (readlink: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 70976 root NOFD /proc/70976/fd (opendir: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 70978 root cwd unknown /proc/70978/cwd (readlink: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 70978 root rtd unknown /proc/70978/root (readlink: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 70978 root txt unknown /proc/70978/exe (readlink: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 70978 root NOFD /proc/70978/fd (opendir: Permission denied) 2024-09-12T02:01:21.360 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 ceph cwd unknown /proc/70980/cwd (readlink: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 ceph rtd unknown /proc/70980/root (readlink: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 ceph txt unknown /proc/70980/exe (readlink: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 ceph NOFD /proc/70980/fd (opendir: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70981 log ceph cwd unknown /proc/70980/task/70981/cwd (readlink: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70981 log ceph rtd unknown /proc/70980/task/70981/root (readlink: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70981 log ceph txt unknown /proc/70980/task/70981/exe (readlink: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70981 log ceph NOFD /proc/70980/task/70981/fd (opendir: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70983 msgr-work ceph cwd unknown /proc/70980/task/70983/cwd (readlink: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70983 msgr-work ceph rtd unknown /proc/70980/task/70983/root (readlink: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70983 msgr-work ceph txt unknown /proc/70980/task/70983/exe (readlink: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70983 msgr-work ceph NOFD /proc/70980/task/70983/fd (opendir: Permission denied) 2024-09-12T02:01:21.361 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70984 msgr-work ceph cwd unknown /proc/70980/task/70984/cwd (readlink: Permission denied) 2024-09-12T02:01:21.362 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70984 msgr-work ceph rtd unknown /proc/70980/task/70984/root (readlink: Permission denied) 2024-09-12T02:01:21.362 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70984 msgr-work ceph txt unknown /proc/70980/task/70984/exe (readlink: Permission denied) 2024-09-12T02:01:21.362 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70984 msgr-work ceph NOFD /proc/70980/task/70984/fd (opendir: Permission denied) 2024-09-12T02:01:21.362 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70985 msgr-work ceph cwd unknown /proc/70980/task/70985/cwd (readlink: Permission denied) 2024-09-12T02:01:21.362 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70985 msgr-work ceph rtd unknown /proc/70980/task/70985/root (readlink: Permission denied) 2024-09-12T02:01:21.362 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70985 msgr-work ceph txt unknown /proc/70980/task/70985/exe (readlink: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70985 msgr-work ceph NOFD /proc/70980/task/70985/fd (opendir: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70989 service ceph cwd unknown /proc/70980/task/70989/cwd (readlink: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70989 service ceph rtd unknown /proc/70980/task/70989/root (readlink: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70989 service ceph txt unknown /proc/70980/task/70989/exe (readlink: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70989 service ceph NOFD /proc/70980/task/70989/fd (opendir: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70990 admin_soc ceph cwd unknown /proc/70980/task/70990/cwd (readlink: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70990 admin_soc ceph rtd unknown /proc/70980/task/70990/root (readlink: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70990 admin_soc ceph txt unknown /proc/70980/task/70990/exe (readlink: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70990 admin_soc ceph NOFD /proc/70980/task/70990/fd (opendir: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70991 signal_ha ceph cwd unknown /proc/70980/task/70991/cwd (readlink: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70991 signal_ha ceph rtd unknown /proc/70980/task/70991/root (readlink: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70991 signal_ha ceph txt unknown /proc/70980/task/70991/exe (readlink: Permission denied) 2024-09-12T02:01:21.363 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70991 signal_ha ceph NOFD /proc/70980/task/70991/fd (opendir: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70992 io_contex ceph cwd unknown /proc/70980/task/70992/cwd (readlink: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70992 io_contex ceph rtd unknown /proc/70980/task/70992/root (readlink: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70992 io_contex ceph txt unknown /proc/70980/task/70992/exe (readlink: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70992 io_contex ceph NOFD /proc/70980/task/70992/fd (opendir: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70993 io_contex ceph cwd unknown /proc/70980/task/70993/cwd (readlink: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70993 io_contex ceph rtd unknown /proc/70980/task/70993/root (readlink: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70993 io_contex ceph txt unknown /proc/70980/task/70993/exe (readlink: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70993 io_contex ceph NOFD /proc/70980/task/70993/fd (opendir: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70994 ms_dispat ceph cwd unknown /proc/70980/task/70994/cwd (readlink: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70994 ms_dispat ceph rtd unknown /proc/70980/task/70994/root (readlink: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70994 ms_dispat ceph txt unknown /proc/70980/task/70994/exe (readlink: Permission denied) 2024-09-12T02:01:21.364 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70994 ms_dispat ceph NOFD /proc/70980/task/70994/fd (opendir: Permission denied) 2024-09-12T02:01:21.365 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70995 ms_local ceph cwd unknown /proc/70980/task/70995/cwd (readlink: Permission denied) 2024-09-12T02:01:21.365 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70995 ms_local ceph rtd unknown /proc/70980/task/70995/root (readlink: Permission denied) 2024-09-12T02:01:21.365 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70995 ms_local ceph txt unknown /proc/70980/task/70995/exe (readlink: Permission denied) 2024-09-12T02:01:21.365 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70995 ms_local ceph NOFD /proc/70980/task/70995/fd (opendir: Permission denied) 2024-09-12T02:01:21.365 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70996 safe_time ceph cwd unknown /proc/70980/task/70996/cwd (readlink: Permission denied) 2024-09-12T02:01:21.365 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70996 safe_time ceph rtd unknown /proc/70980/task/70996/root (readlink: Permission denied) 2024-09-12T02:01:21.365 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70996 safe_time ceph txt unknown /proc/70980/task/70996/exe (readlink: Permission denied) 2024-09-12T02:01:21.365 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70996 safe_time ceph NOFD /proc/70980/task/70996/fd (opendir: Permission denied) 2024-09-12T02:01:21.365 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70997 safe_time ceph cwd unknown /proc/70980/task/70997/cwd (readlink: Permission denied) 2024-09-12T02:01:21.365 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70997 safe_time ceph rtd unknown /proc/70980/task/70997/root (readlink: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70997 safe_time ceph txt unknown /proc/70980/task/70997/exe (readlink: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70997 safe_time ceph NOFD /proc/70980/task/70997/fd (opendir: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70998 ceph-mds ceph cwd unknown /proc/70980/task/70998/cwd (readlink: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70998 ceph-mds ceph rtd unknown /proc/70980/task/70998/root (readlink: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70998 ceph-mds ceph txt unknown /proc/70980/task/70998/exe (readlink: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 70998 ceph-mds ceph NOFD /proc/70980/task/70998/fd (opendir: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 71003 safe_time ceph cwd unknown /proc/70980/task/71003/cwd (readlink: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 71003 safe_time ceph rtd unknown /proc/70980/task/71003/root (readlink: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 71003 safe_time ceph txt unknown /proc/70980/task/71003/exe (readlink: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 70980 71003 safe_time ceph NOFD /proc/70980/task/71003/fd (opendir: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 71733 root cwd unknown /proc/71733/cwd (readlink: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 71733 root rtd unknown /proc/71733/root (readlink: Permission denied) 2024-09-12T02:01:21.366 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 71733 root txt unknown /proc/71733/exe (readlink: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 71733 root NOFD /proc/71733/fd (opendir: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 71735 root cwd unknown /proc/71735/cwd (readlink: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 71735 root rtd unknown /proc/71735/root (readlink: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 71735 root txt unknown /proc/71735/exe (readlink: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 71735 root NOFD /proc/71735/fd (opendir: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 ceph cwd unknown /proc/71739/cwd (readlink: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 ceph rtd unknown /proc/71739/root (readlink: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 ceph txt unknown /proc/71739/exe (readlink: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 ceph NOFD /proc/71739/fd (opendir: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71740 log ceph cwd unknown /proc/71739/task/71740/cwd (readlink: Permission denied) 2024-09-12T02:01:21.367 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71740 log ceph rtd unknown /proc/71739/task/71740/root (readlink: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71740 log ceph txt unknown /proc/71739/task/71740/exe (readlink: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71740 log ceph NOFD /proc/71739/task/71740/fd (opendir: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71742 msgr-work ceph cwd unknown /proc/71739/task/71742/cwd (readlink: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71742 msgr-work ceph rtd unknown /proc/71739/task/71742/root (readlink: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71742 msgr-work ceph txt unknown /proc/71739/task/71742/exe (readlink: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71742 msgr-work ceph NOFD /proc/71739/task/71742/fd (opendir: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71743 msgr-work ceph cwd unknown /proc/71739/task/71743/cwd (readlink: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71743 msgr-work ceph rtd unknown /proc/71739/task/71743/root (readlink: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71743 msgr-work ceph txt unknown /proc/71739/task/71743/exe (readlink: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71743 msgr-work ceph NOFD /proc/71739/task/71743/fd (opendir: Permission denied) 2024-09-12T02:01:21.368 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71744 msgr-work ceph cwd unknown /proc/71739/task/71744/cwd (readlink: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71744 msgr-work ceph rtd unknown /proc/71739/task/71744/root (readlink: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71744 msgr-work ceph txt unknown /proc/71739/task/71744/exe (readlink: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71744 msgr-work ceph NOFD /proc/71739/task/71744/fd (opendir: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71748 service ceph cwd unknown /proc/71739/task/71748/cwd (readlink: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71748 service ceph rtd unknown /proc/71739/task/71748/root (readlink: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71748 service ceph txt unknown /proc/71739/task/71748/exe (readlink: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71748 service ceph NOFD /proc/71739/task/71748/fd (opendir: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71749 admin_soc ceph cwd unknown /proc/71739/task/71749/cwd (readlink: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71749 admin_soc ceph rtd unknown /proc/71739/task/71749/root (readlink: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71749 admin_soc ceph txt unknown /proc/71739/task/71749/exe (readlink: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71749 admin_soc ceph NOFD /proc/71739/task/71749/fd (opendir: Permission denied) 2024-09-12T02:01:21.369 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71750 signal_ha ceph cwd unknown /proc/71739/task/71750/cwd (readlink: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71750 signal_ha ceph rtd unknown /proc/71739/task/71750/root (readlink: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71750 signal_ha ceph txt unknown /proc/71739/task/71750/exe (readlink: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71750 signal_ha ceph NOFD /proc/71739/task/71750/fd (opendir: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71751 io_contex ceph cwd unknown /proc/71739/task/71751/cwd (readlink: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71751 io_contex ceph rtd unknown /proc/71739/task/71751/root (readlink: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71751 io_contex ceph txt unknown /proc/71739/task/71751/exe (readlink: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71751 io_contex ceph NOFD /proc/71739/task/71751/fd (opendir: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71752 io_contex ceph cwd unknown /proc/71739/task/71752/cwd (readlink: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71752 io_contex ceph rtd unknown /proc/71739/task/71752/root (readlink: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71752 io_contex ceph txt unknown /proc/71739/task/71752/exe (readlink: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71752 io_contex ceph NOFD /proc/71739/task/71752/fd (opendir: Permission denied) 2024-09-12T02:01:21.370 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71753 ms_dispat ceph cwd unknown /proc/71739/task/71753/cwd (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71753 ms_dispat ceph rtd unknown /proc/71739/task/71753/root (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71753 ms_dispat ceph txt unknown /proc/71739/task/71753/exe (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71753 ms_dispat ceph NOFD /proc/71739/task/71753/fd (opendir: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71754 ms_local ceph cwd unknown /proc/71739/task/71754/cwd (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71754 ms_local ceph rtd unknown /proc/71739/task/71754/root (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71754 ms_local ceph txt unknown /proc/71739/task/71754/exe (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71754 ms_local ceph NOFD /proc/71739/task/71754/fd (opendir: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71755 safe_time ceph cwd unknown /proc/71739/task/71755/cwd (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71755 safe_time ceph rtd unknown /proc/71739/task/71755/root (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71755 safe_time ceph txt unknown /proc/71739/task/71755/exe (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71755 safe_time ceph NOFD /proc/71739/task/71755/fd (opendir: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71756 safe_time ceph cwd unknown /proc/71739/task/71756/cwd (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71756 safe_time ceph rtd unknown /proc/71739/task/71756/root (readlink: Permission denied) 2024-09-12T02:01:21.371 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71756 safe_time ceph txt unknown /proc/71739/task/71756/exe (readlink: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71756 safe_time ceph NOFD /proc/71739/task/71756/fd (opendir: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71757 ceph-mds ceph cwd unknown /proc/71739/task/71757/cwd (readlink: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71757 ceph-mds ceph rtd unknown /proc/71739/task/71757/root (readlink: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71757 ceph-mds ceph txt unknown /proc/71739/task/71757/exe (readlink: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71757 ceph-mds ceph NOFD /proc/71739/task/71757/fd (opendir: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71758 safe_time ceph cwd unknown /proc/71739/task/71758/cwd (readlink: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71758 safe_time ceph rtd unknown /proc/71739/task/71758/root (readlink: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71758 safe_time ceph txt unknown /proc/71739/task/71758/exe (readlink: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 71739 71758 safe_time ceph NOFD /proc/71739/task/71758/fd (opendir: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 72141 root cwd unknown /proc/72141/cwd (readlink: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 72141 root rtd unknown /proc/72141/root (readlink: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 72141 root txt unknown /proc/72141/exe (readlink: Permission denied) 2024-09-12T02:01:21.372 INFO:tasks.workunit.client.0.smithi062.stdout:conmon 72141 root NOFD /proc/72141/fd (opendir: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 72143 root cwd unknown /proc/72143/cwd (readlink: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 72143 root rtd unknown /proc/72143/root (readlink: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 72143 root txt unknown /proc/72143/exe (readlink: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:podman-in 72143 root NOFD /proc/72143/fd (opendir: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 ceph cwd unknown /proc/72146/cwd (readlink: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 ceph rtd unknown /proc/72146/root (readlink: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 ceph txt unknown /proc/72146/exe (readlink: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 ceph NOFD /proc/72146/fd (opendir: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72147 log ceph cwd unknown /proc/72146/task/72147/cwd (readlink: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72147 log ceph rtd unknown /proc/72146/task/72147/root (readlink: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72147 log ceph txt unknown /proc/72146/task/72147/exe (readlink: Permission denied) 2024-09-12T02:01:21.373 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72147 log ceph NOFD /proc/72146/task/72147/fd (opendir: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72149 msgr-work ceph cwd unknown /proc/72146/task/72149/cwd (readlink: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72149 msgr-work ceph rtd unknown /proc/72146/task/72149/root (readlink: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72149 msgr-work ceph txt unknown /proc/72146/task/72149/exe (readlink: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72149 msgr-work ceph NOFD /proc/72146/task/72149/fd (opendir: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72150 msgr-work ceph cwd unknown /proc/72146/task/72150/cwd (readlink: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72150 msgr-work ceph rtd unknown /proc/72146/task/72150/root (readlink: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72150 msgr-work ceph txt unknown /proc/72146/task/72150/exe (readlink: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72150 msgr-work ceph NOFD /proc/72146/task/72150/fd (opendir: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72151 msgr-work ceph cwd unknown /proc/72146/task/72151/cwd (readlink: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72151 msgr-work ceph rtd unknown /proc/72146/task/72151/root (readlink: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72151 msgr-work ceph txt unknown /proc/72146/task/72151/exe (readlink: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72151 msgr-work ceph NOFD /proc/72146/task/72151/fd (opendir: Permission denied) 2024-09-12T02:01:21.374 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72155 service ceph cwd unknown /proc/72146/task/72155/cwd (readlink: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72155 service ceph rtd unknown /proc/72146/task/72155/root (readlink: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72155 service ceph txt unknown /proc/72146/task/72155/exe (readlink: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72155 service ceph NOFD /proc/72146/task/72155/fd (opendir: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72156 admin_soc ceph cwd unknown /proc/72146/task/72156/cwd (readlink: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72156 admin_soc ceph rtd unknown /proc/72146/task/72156/root (readlink: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72156 admin_soc ceph txt unknown /proc/72146/task/72156/exe (readlink: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72156 admin_soc ceph NOFD /proc/72146/task/72156/fd (opendir: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72157 signal_ha ceph cwd unknown /proc/72146/task/72157/cwd (readlink: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72157 signal_ha ceph rtd unknown /proc/72146/task/72157/root (readlink: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72157 signal_ha ceph txt unknown /proc/72146/task/72157/exe (readlink: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72157 signal_ha ceph NOFD /proc/72146/task/72157/fd (opendir: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72158 io_contex ceph cwd unknown /proc/72146/task/72158/cwd (readlink: Permission denied) 2024-09-12T02:01:21.375 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72158 io_contex ceph rtd unknown /proc/72146/task/72158/root (readlink: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72158 io_contex ceph txt unknown /proc/72146/task/72158/exe (readlink: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72158 io_contex ceph NOFD /proc/72146/task/72158/fd (opendir: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72159 io_contex ceph cwd unknown /proc/72146/task/72159/cwd (readlink: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72159 io_contex ceph rtd unknown /proc/72146/task/72159/root (readlink: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72159 io_contex ceph txt unknown /proc/72146/task/72159/exe (readlink: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72159 io_contex ceph NOFD /proc/72146/task/72159/fd (opendir: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72160 ms_dispat ceph cwd unknown /proc/72146/task/72160/cwd (readlink: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72160 ms_dispat ceph rtd unknown /proc/72146/task/72160/root (readlink: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72160 ms_dispat ceph txt unknown /proc/72146/task/72160/exe (readlink: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72160 ms_dispat ceph NOFD /proc/72146/task/72160/fd (opendir: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72161 ms_local ceph cwd unknown /proc/72146/task/72161/cwd (readlink: Permission denied) 2024-09-12T02:01:21.376 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72161 ms_local ceph rtd unknown /proc/72146/task/72161/root (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72161 ms_local ceph txt unknown /proc/72146/task/72161/exe (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72161 ms_local ceph NOFD /proc/72146/task/72161/fd (opendir: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72162 safe_time ceph cwd unknown /proc/72146/task/72162/cwd (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72162 safe_time ceph rtd unknown /proc/72146/task/72162/root (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72162 safe_time ceph txt unknown /proc/72146/task/72162/exe (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72162 safe_time ceph NOFD /proc/72146/task/72162/fd (opendir: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72163 safe_time ceph cwd unknown /proc/72146/task/72163/cwd (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72163 safe_time ceph rtd unknown /proc/72146/task/72163/root (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72163 safe_time ceph txt unknown /proc/72146/task/72163/exe (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72163 safe_time ceph NOFD /proc/72146/task/72163/fd (opendir: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72164 ceph-mds ceph cwd unknown /proc/72146/task/72164/cwd (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72164 ceph-mds ceph rtd unknown /proc/72146/task/72164/root (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72164 ceph-mds ceph txt unknown /proc/72146/task/72164/exe (readlink: Permission denied) 2024-09-12T02:01:21.377 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72164 ceph-mds ceph NOFD /proc/72146/task/72164/fd (opendir: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72172 safe_time ceph cwd unknown /proc/72146/task/72172/cwd (readlink: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72172 safe_time ceph rtd unknown /proc/72146/task/72172/root (readlink: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72172 safe_time ceph txt unknown /proc/72146/task/72172/exe (readlink: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:ceph-mds 72146 72172 safe_time ceph NOFD /proc/72146/task/72172/fd (opendir: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 72464 root cwd unknown /proc/72464/cwd (readlink: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 72464 root rtd unknown /proc/72464/root (readlink: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 72464 root txt unknown /proc/72464/exe (readlink: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/1 72464 root NOFD /proc/72464/fd (opendir: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 74695 root cwd unknown /proc/74695/cwd (readlink: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 74695 root rtd unknown /proc/74695/root (readlink: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 74695 root txt unknown /proc/74695/exe (readlink: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/4 74695 root NOFD /proc/74695/fd (opendir: Permission denied) 2024-09-12T02:01:21.378 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 76791 root cwd unknown /proc/76791/cwd (readlink: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 76791 root rtd unknown /proc/76791/root (readlink: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 76791 root txt unknown /proc/76791/exe (readlink: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/6 76791 root NOFD /proc/76791/fd (opendir: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 83842 root cwd unknown /proc/83842/cwd (readlink: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 83842 root rtd unknown /proc/83842/root (readlink: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 83842 root txt unknown /proc/83842/exe (readlink: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/7 83842 root NOFD /proc/83842/fd (opendir: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84159 root cwd unknown /proc/84159/cwd (readlink: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84159 root rtd unknown /proc/84159/root (readlink: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84159 root txt unknown /proc/84159/exe (readlink: Permission denied) 2024-09-12T02:01:21.379 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84159 root NOFD /proc/84159/fd (opendir: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84174 root cwd unknown /proc/84174/cwd (readlink: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84174 root rtd unknown /proc/84174/root (readlink: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84174 root txt unknown /proc/84174/exe (readlink: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84174 root NOFD /proc/84174/fd (opendir: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84175 root cwd unknown /proc/84175/cwd (readlink: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84175 root rtd unknown /proc/84175/root (readlink: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84175 root txt unknown /proc/84175/exe (readlink: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/R 84175 root NOFD /proc/84175/fd (opendir: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 84577 root cwd unknown /proc/84577/cwd (readlink: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 84577 root rtd unknown /proc/84577/root (readlink: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 84577 root txt unknown /proc/84577/exe (readlink: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 84577 root NOFD /proc/84577/fd (opendir: Permission denied) 2024-09-12T02:01:21.380 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 84611 root cwd unknown /proc/84611/cwd (readlink: Permission denied) 2024-09-12T02:01:21.381 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 84611 root rtd unknown /proc/84611/root (readlink: Permission denied) 2024-09-12T02:01:21.381 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 84611 root txt unknown /proc/84611/exe (readlink: Permission denied) 2024-09-12T02:01:21.381 INFO:tasks.workunit.client.0.smithi062.stdout:sshd 84611 root NOFD /proc/84611/fd (opendir: Permission denied) 2024-09-12T02:01:21.381 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 86331 root cwd unknown /proc/86331/cwd (readlink: Permission denied) 2024-09-12T02:01:21.381 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 86331 root rtd unknown /proc/86331/root (readlink: Permission denied) 2024-09-12T02:01:21.381 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 86331 root txt unknown /proc/86331/exe (readlink: Permission denied) 2024-09-12T02:01:21.381 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/3 86331 root NOFD /proc/86331/fd (opendir: Permission denied) 2024-09-12T02:01:21.381 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 86362 root cwd unknown /proc/86362/cwd (readlink: Permission denied) 2024-09-12T02:01:21.381 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 86362 root rtd unknown /proc/86362/root (readlink: Permission denied) 2024-09-12T02:01:21.381 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 86362 root txt unknown /proc/86362/exe (readlink: Permission denied) 2024-09-12T02:01:21.382 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/0 86362 root NOFD /proc/86362/fd (opendir: Permission denied) 2024-09-12T02:01:21.382 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu cwd DIR 0,108 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:01:21.382 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T02:01:21.382 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-12T02:01:21.382 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-12T02:01:21.382 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T02:01:21.382 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T02:01:21.382 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-12T02:01:21.382 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-12T02:01:21.382 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu 0r FIFO 0,14 0t0 210677 pipe 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu 1w FIFO 0,14 0t0 210678 pipe 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:timeout 86591 ubuntu 2w FIFO 0,14 0t0 210679 pipe 2024-09-12T02:01:21.383 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu cwd DIR 0,108 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-12T02:01:21.384 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu 0r FIFO 0,14 0t0 210677 pipe 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu 1w FIFO 0,14 0t0 210678 pipe 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu 2w FIFO 0,14 0t0 210679 pipe 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:fsync-tes 86609 ubuntu 255r REG 8,1 207 663649 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 86618 root cwd unknown /proc/86618/cwd (readlink: Permission denied) 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 86618 root rtd unknown /proc/86618/root (readlink: Permission denied) 2024-09-12T02:01:21.385 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 86618 root txt unknown /proc/86618/exe (readlink: Permission denied) 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 86618 root NOFD /proc/86618/fd (opendir: Permission denied) 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 86619 root cwd unknown /proc/86619/cwd (readlink: Permission denied) 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 86619 root rtd unknown /proc/86619/root (readlink: Permission denied) 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 86619 root txt unknown /proc/86619/exe (readlink: Permission denied) 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:kworker/2 86619 root NOFD /proc/86619/fd (opendir: Permission denied) 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:anacron 86633 root cwd unknown /proc/86633/cwd (readlink: Permission denied) 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:anacron 86633 root rtd unknown /proc/86633/root (readlink: Permission denied) 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:anacron 86633 root txt unknown /proc/86633/exe (readlink: Permission denied) 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:anacron 86633 root NOFD /proc/86633/fd (opendir: Permission denied) 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu cwd DIR 0,108 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T02:01:21.386 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 5436544 2393 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T02:01:21.387 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu 0r FIFO 0,14 0t0 210677 pipe 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu 1w FIFO 0,14 0t0 210678 pipe 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu 2w FIFO 0,14 0t0 210679 pipe 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu 3r DIR 0,21 0 1 /proc 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu 4r DIR 0,21 7 214512 /proc/86766/fd 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu 5w FIFO 0,14 0t0 214517 pipe 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86766 ubuntu 6r FIFO 0,14 0t0 214518 pipe 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu cwd DIR 0,108 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-12T02:01:21.388 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 5436544 2393 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-12T02:01:21.389 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T02:01:21.390 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T02:01:21.390 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T02:01:21.390 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu 4r FIFO 0,14 0t0 214517 pipe 2024-09-12T02:01:21.390 INFO:tasks.workunit.client.0.smithi062.stdout:lsof 86767 ubuntu 7w FIFO 0,14 0t0 214518 pipe 2024-09-12T02:01:21.390 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:01:21.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:01:21.472 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-12T02:01:21.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:01:22.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:21 smithi107 ceph-mon[35463]: pgmap v69: 129 pgs: 129 active+clean; 260 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.2 MiB/s wr, 510 op/s 2024-09-12T02:01:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:21 smithi077 ceph-mon[35095]: pgmap v69: 129 pgs: 129 active+clean; 260 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.2 MiB/s wr, 510 op/s 2024-09-12T02:01:22.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:21 smithi062 ceph-mon[30666]: pgmap v69: 129 pgs: 129 active+clean; 260 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.2 MiB/s wr, 510 op/s 2024-09-12T02:01:22.805 DEBUG:teuthology.parallel:result is None 2024-09-12T02:01:22.806 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:01:22.922 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:01:22.923 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-12T02:01:22.936 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-12T02:01:22.936 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:01:22.937 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T02:01:22.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-12T02:01:23.090 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-12T02:01:24.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:23 smithi107 ceph-mon[35463]: pgmap v70: 129 pgs: 129 active+clean; 260 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-09-12T02:01:24.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:23 smithi077 ceph-mon[35095]: pgmap v70: 129 pgs: 129 active+clean; 260 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-09-12T02:01:24.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:23 smithi062 ceph-mon[30666]: pgmap v70: 129 pgs: 129 active+clean; 260 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.1 MiB/s wr, 336 op/s 2024-09-12T02:01:26.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:25 smithi107 ceph-mon[35463]: pgmap v71: 129 pgs: 129 active+clean; 259 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 981 op/s 2024-09-12T02:01:26.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:25 smithi077 ceph-mon[35095]: pgmap v71: 129 pgs: 129 active+clean; 259 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 981 op/s 2024-09-12T02:01:26.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:25 smithi062 ceph-mon[30666]: pgmap v71: 129 pgs: 129 active+clean; 259 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 981 op/s 2024-09-12T02:01:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:27 smithi107 ceph-mon[35463]: pgmap v72: 129 pgs: 129 active+clean; 259 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 810 op/s 2024-09-12T02:01:28.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:27 smithi077 ceph-mon[35095]: pgmap v72: 129 pgs: 129 active+clean; 259 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 810 op/s 2024-09-12T02:01:28.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:27 smithi062 ceph-mon[30666]: pgmap v72: 129 pgs: 129 active+clean; 259 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 810 op/s 2024-09-12T02:01:30.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:29 smithi107 ceph-mon[35463]: pgmap v73: 129 pgs: 129 active+clean; 259 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 810 op/s 2024-09-12T02:01:30.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:29 smithi077 ceph-mon[35095]: pgmap v73: 129 pgs: 129 active+clean; 259 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 810 op/s 2024-09-12T02:01:30.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:29 smithi062 ceph-mon[30666]: pgmap v73: 129 pgs: 129 active+clean; 259 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 810 op/s 2024-09-12T02:01:32.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:31 smithi077 ceph-mon[35095]: pgmap v74: 129 pgs: 129 active+clean; 292 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 1.41k op/s 2024-09-12T02:01:32.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:31 smithi062 ceph-mon[30666]: pgmap v74: 129 pgs: 129 active+clean; 292 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 1.41k op/s 2024-09-12T02:01:32.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:31 smithi107 ceph-mon[35463]: pgmap v74: 129 pgs: 129 active+clean; 292 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 1.41k op/s 2024-09-12T02:01:34.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:33 smithi077 ceph-mon[35095]: pgmap v75: 129 pgs: 129 active+clean; 292 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 22 MiB/s wr, 1.25k op/s 2024-09-12T02:01:34.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:33 smithi062 ceph-mon[30666]: pgmap v75: 129 pgs: 129 active+clean; 292 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 22 MiB/s wr, 1.25k op/s 2024-09-12T02:01:34.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:33 smithi107 ceph-mon[35463]: pgmap v75: 129 pgs: 129 active+clean; 292 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 22 MiB/s wr, 1.25k op/s 2024-09-12T02:01:36.247 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:35 smithi062 ceph-mon[30666]: pgmap v76: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 1.25k op/s 2024-09-12T02:01:36.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:35 smithi107 ceph-mon[35463]: pgmap v76: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 1.25k op/s 2024-09-12T02:01:36.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:35 smithi077 ceph-mon[35095]: pgmap v76: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 MiB/s wr, 1.25k op/s 2024-09-12T02:01:38.255 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:37 smithi107 ceph-mon[35463]: pgmap v77: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 608 op/s 2024-09-12T02:01:38.266 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:37 smithi077 ceph-mon[35095]: pgmap v77: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 608 op/s 2024-09-12T02:01:38.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:37 smithi062 ceph-mon[30666]: pgmap v77: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 608 op/s 2024-09-12T02:01:40.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:39 smithi062 ceph-mon[30666]: pgmap v78: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 608 op/s 2024-09-12T02:01:40.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:39 smithi107 ceph-mon[35463]: pgmap v78: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 608 op/s 2024-09-12T02:01:40.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:39 smithi077 ceph-mon[35095]: pgmap v78: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 MiB/s wr, 608 op/s 2024-09-12T02:01:42.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:41 smithi062 ceph-mon[30666]: pgmap v79: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 609 op/s 2024-09-12T02:01:42.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:41 smithi107 ceph-mon[35463]: pgmap v79: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 609 op/s 2024-09-12T02:01:42.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:41 smithi077 ceph-mon[35095]: pgmap v79: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 609 op/s 2024-09-12T02:01:44.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:43 smithi062 ceph-mon[30666]: pgmap v80: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-12T02:01:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:43 smithi107 ceph-mon[35463]: pgmap v80: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-12T02:01:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:43 smithi077 ceph-mon[35095]: pgmap v80: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-12T02:01:46.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:45 smithi062 ceph-mon[30666]: pgmap v81: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-12T02:01:46.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:45 smithi107 ceph-mon[35463]: pgmap v81: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-12T02:01:46.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:45 smithi077 ceph-mon[35095]: pgmap v81: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-12T02:01:48.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:47 smithi062 ceph-mon[30666]: pgmap v82: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-12T02:01:48.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:47 smithi107 ceph-mon[35463]: pgmap v82: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-12T02:01:48.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:47 smithi077 ceph-mon[35095]: pgmap v82: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-12T02:01:50.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:49 smithi062 ceph-mon[30666]: pgmap v83: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-12T02:01:50.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:49 smithi107 ceph-mon[35463]: pgmap v83: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-12T02:01:50.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:49 smithi077 ceph-mon[35095]: pgmap v83: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-12T02:01:52.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:51 smithi062 ceph-mon[30666]: pgmap v84: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-12T02:01:52.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:51 smithi107 ceph-mon[35463]: pgmap v84: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-12T02:01:52.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:51 smithi077 ceph-mon[35095]: pgmap v84: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-12T02:01:54.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:53 smithi062 ceph-mon[30666]: pgmap v85: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 341 B/s wr, 1 op/s 2024-09-12T02:01:54.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:53 smithi107 ceph-mon[35463]: pgmap v85: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 341 B/s wr, 1 op/s 2024-09-12T02:01:54.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:53 smithi077 ceph-mon[35095]: pgmap v85: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 341 B/s wr, 1 op/s 2024-09-12T02:01:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:56 smithi062 ceph-mon[30666]: pgmap v86: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-12T02:01:56.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:56 smithi107 ceph-mon[35463]: pgmap v86: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-12T02:01:56.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:56 smithi077 ceph-mon[35095]: pgmap v86: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-12T02:01:58.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:01:58 smithi062 ceph-mon[30666]: pgmap v87: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:01:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:01:58 smithi107 ceph-mon[35463]: pgmap v87: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:01:58.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:01:58 smithi077 ceph-mon[35095]: pgmap v87: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:00.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:00 smithi062 ceph-mon[30666]: pgmap v88: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:00.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:00 smithi107 ceph-mon[35463]: pgmap v88: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:00.515 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:00 smithi077 ceph-mon[35095]: pgmap v88: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:02.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:02 smithi062 ceph-mon[30666]: pgmap v89: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:02.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:02 smithi107 ceph-mon[35463]: pgmap v89: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:02.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:02 smithi077 ceph-mon[35095]: pgmap v89: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:04 smithi062 ceph-mon[30666]: pgmap v90: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:04.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:04 smithi107 ceph-mon[35463]: pgmap v90: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:04.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:04 smithi077 ceph-mon[35095]: pgmap v90: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:06.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:06 smithi062 ceph-mon[30666]: pgmap v91: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:02:06.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:06 smithi107 ceph-mon[35463]: pgmap v91: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:02:06.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:06 smithi077 ceph-mon[35095]: pgmap v91: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:02:08.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:08 smithi062 ceph-mon[30666]: pgmap v92: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:02:08.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:08 smithi107 ceph-mon[35463]: pgmap v92: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:02:08.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:08 smithi077 ceph-mon[35095]: pgmap v92: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:02:10.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:10 smithi062 ceph-mon[30666]: pgmap v93: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:02:10.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:10 smithi107 ceph-mon[35463]: pgmap v93: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:02:10.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:10 smithi077 ceph-mon[35095]: pgmap v93: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:02:12.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:12 smithi062 ceph-mon[30666]: pgmap v94: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:02:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:12 smithi107 ceph-mon[35463]: pgmap v94: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:02:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:12 smithi077 ceph-mon[35095]: pgmap v94: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:02:14.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:14 smithi062 ceph-mon[30666]: pgmap v95: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:02:14.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:14 smithi107 ceph-mon[35463]: pgmap v95: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:02:14.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:14 smithi077 ceph-mon[35095]: pgmap v95: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:02:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:16 smithi062 ceph-mon[30666]: pgmap v96: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:02:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:16 smithi107 ceph-mon[35463]: pgmap v96: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:02:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:16 smithi077 ceph-mon[35095]: pgmap v96: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:02:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:18 smithi062 ceph-mon[30666]: pgmap v97: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:02:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:18 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:18.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:18 smithi107 ceph-mon[35463]: pgmap v97: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:02:18.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:18 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:18.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:18 smithi077 ceph-mon[35095]: pgmap v97: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:02:18.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:18 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:19.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:19 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:19.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:19 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:19.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:19 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:02:19.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:19 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:19.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:19 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:19.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:19 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:02:19.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:19 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:19.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:19 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:19.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:19 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:02:20.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:20 smithi062 ceph-mon[30666]: pgmap v98: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:02:20.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:20 smithi107 ceph-mon[35463]: pgmap v98: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:02:20.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:20 smithi077 ceph-mon[35095]: pgmap v98: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:02:22.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:22 smithi062 ceph-mon[30666]: pgmap v99: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:02:22.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:22 smithi107 ceph-mon[35463]: pgmap v99: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:02:22.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:22 smithi077 ceph-mon[35095]: pgmap v99: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:02:24.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:24 smithi062 ceph-mon[30666]: pgmap v100: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:02:24.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:24 smithi107 ceph-mon[35463]: pgmap v100: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:02:24.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:24 smithi077 ceph-mon[35095]: pgmap v100: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:02:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:26 smithi062 ceph-mon[30666]: pgmap v101: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:02:26.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:26 smithi107 ceph-mon[35463]: pgmap v101: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:02:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:26 smithi077 ceph-mon[35095]: pgmap v101: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:02:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:28 smithi062 ceph-mon[30666]: pgmap v102: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:28.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:28 smithi107 ceph-mon[35463]: pgmap v102: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:28.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:28 smithi077 ceph-mon[35095]: pgmap v102: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:30.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:30 smithi062 ceph-mon[30666]: pgmap v103: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:30.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:30 smithi107 ceph-mon[35463]: pgmap v103: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:30.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:30 smithi077 ceph-mon[35095]: pgmap v103: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:32.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:32 smithi062 ceph-mon[30666]: pgmap v104: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:32.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:32 smithi107 ceph-mon[35463]: pgmap v104: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:32.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:32 smithi077 ceph-mon[35095]: pgmap v104: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:33.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:33 smithi062 ceph-mon[30666]: pgmap v105: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:33.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:33 smithi107 ceph-mon[35463]: pgmap v105: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:33.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:33 smithi077 ceph-mon[35095]: pgmap v105: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:36.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:35 smithi107 ceph-mon[35463]: pgmap v106: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:36.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:35 smithi077 ceph-mon[35095]: pgmap v106: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:36.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:35 smithi062 ceph-mon[30666]: pgmap v106: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:38.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:37 smithi107 ceph-mon[35463]: pgmap v107: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:38.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:37 smithi077 ceph-mon[35095]: pgmap v107: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:38.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:37 smithi062 ceph-mon[30666]: pgmap v107: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:40.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:39 smithi107 ceph-mon[35463]: pgmap v108: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:40.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:39 smithi077 ceph-mon[35095]: pgmap v108: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:40.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:39 smithi062 ceph-mon[30666]: pgmap v108: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:42.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:41 smithi107 ceph-mon[35463]: pgmap v109: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:42.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:41 smithi077 ceph-mon[35095]: pgmap v109: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:42.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:41 smithi062 ceph-mon[30666]: pgmap v109: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:44.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:43 smithi107 ceph-mon[35463]: pgmap v110: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:44.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:43 smithi077 ceph-mon[35095]: pgmap v110: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:44.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:43 smithi062 ceph-mon[30666]: pgmap v110: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:46.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:45 smithi107 ceph-mon[35463]: pgmap v111: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:46.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:45 smithi077 ceph-mon[35095]: pgmap v111: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:46.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:45 smithi062 ceph-mon[30666]: pgmap v111: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:48.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:47 smithi107 ceph-mon[35463]: pgmap v112: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:48.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:47 smithi077 ceph-mon[35095]: pgmap v112: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:48.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:47 smithi062 ceph-mon[30666]: pgmap v112: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:50.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:49 smithi107 ceph-mon[35463]: pgmap v113: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:50.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:49 smithi077 ceph-mon[35095]: pgmap v113: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:50.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:49 smithi062 ceph-mon[30666]: pgmap v113: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:52.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:51 smithi107 ceph-mon[35463]: pgmap v114: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:51 smithi077 ceph-mon[35095]: pgmap v114: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:52.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:51 smithi062 ceph-mon[30666]: pgmap v114: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:54.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:53 smithi107 ceph-mon[35463]: pgmap v115: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:53 smithi077 ceph-mon[35095]: pgmap v115: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:54.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:53 smithi062 ceph-mon[30666]: pgmap v115: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:56.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:55 smithi107 ceph-mon[35463]: pgmap v116: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:56.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:55 smithi077 ceph-mon[35095]: pgmap v116: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:55 smithi062 ceph-mon[30666]: pgmap v116: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:02:58.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:57 smithi107 ceph-mon[35463]: pgmap v117: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:58.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:57 smithi077 ceph-mon[35095]: pgmap v117: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:02:58.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:57 smithi062 ceph-mon[30666]: pgmap v117: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:00.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:02:59 smithi107 ceph-mon[35463]: pgmap v118: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:00.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:02:59 smithi077 ceph-mon[35095]: pgmap v118: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:00.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:02:59 smithi062 ceph-mon[30666]: pgmap v118: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:02.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:01 smithi107 ceph-mon[35463]: pgmap v119: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:02.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:01 smithi077 ceph-mon[35095]: pgmap v119: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:02.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:01 smithi062 ceph-mon[30666]: pgmap v119: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:04.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:03 smithi107 ceph-mon[35463]: pgmap v120: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:04.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:03 smithi077 ceph-mon[35095]: pgmap v120: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:03 smithi062 ceph-mon[30666]: pgmap v120: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:06.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:05 smithi107 ceph-mon[35463]: pgmap v121: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:03:06.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:05 smithi077 ceph-mon[35095]: pgmap v121: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:03:06.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:05 smithi062 ceph-mon[30666]: pgmap v121: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:03:08.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:07 smithi107 ceph-mon[35463]: pgmap v122: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:03:08.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:07 smithi077 ceph-mon[35095]: pgmap v122: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:03:08.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:07 smithi062 ceph-mon[30666]: pgmap v122: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:03:10.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:09 smithi107 ceph-mon[35463]: pgmap v123: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:03:10.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:09 smithi077 ceph-mon[35095]: pgmap v123: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:03:10.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:09 smithi062 ceph-mon[30666]: pgmap v123: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:03:12.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:11 smithi107 ceph-mon[35463]: pgmap v124: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:03:12.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:11 smithi077 ceph-mon[35095]: pgmap v124: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:03:12.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:11 smithi062 ceph-mon[30666]: pgmap v124: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:03:14.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:13 smithi107 ceph-mon[35463]: pgmap v125: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:03:14.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:13 smithi077 ceph-mon[35095]: pgmap v125: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:03:14.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:13 smithi062 ceph-mon[30666]: pgmap v125: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:03:16.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:15 smithi077 ceph-mon[35095]: pgmap v126: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:03:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:15 smithi062 ceph-mon[30666]: pgmap v126: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:03:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:15 smithi107 ceph-mon[35463]: pgmap v126: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:03:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:17 smithi077 ceph-mon[35095]: pgmap v127: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:03:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:17 smithi062 ceph-mon[30666]: pgmap v127: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:03:18.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:17 smithi107 ceph-mon[35463]: pgmap v127: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:03:19.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:18 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:19.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:18 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:19.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:18 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:19 smithi062 ceph-mon[30666]: pgmap v128: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:03:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:19 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:19 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:19 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:03:20.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:19 smithi107 ceph-mon[35463]: pgmap v128: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:03:20.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:19 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:20.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:19 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:20.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:19 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:03:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:19 smithi077 ceph-mon[35095]: pgmap v128: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:03:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:19 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:19 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:19 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:03:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:21 smithi062 ceph-mon[30666]: pgmap v129: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:03:22.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:21 smithi107 ceph-mon[35463]: pgmap v129: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:03:22.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:21 smithi077 ceph-mon[35095]: pgmap v129: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:03:24.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:23 smithi062 ceph-mon[30666]: pgmap v130: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:03:24.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:23 smithi107 ceph-mon[35463]: pgmap v130: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:03:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:23 smithi077 ceph-mon[35095]: pgmap v130: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:03:26.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:25 smithi062 ceph-mon[30666]: pgmap v131: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:03:26.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:25 smithi107 ceph-mon[35463]: pgmap v131: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:03:26.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:25 smithi077 ceph-mon[35095]: pgmap v131: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:03:28.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:27 smithi062 ceph-mon[30666]: pgmap v132: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:28.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:27 smithi107 ceph-mon[35463]: pgmap v132: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:28.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:27 smithi077 ceph-mon[35095]: pgmap v132: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:30.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:29 smithi062 ceph-mon[30666]: pgmap v133: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:29 smithi107 ceph-mon[35463]: pgmap v133: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:30.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:29 smithi077 ceph-mon[35095]: pgmap v133: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:32.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:31 smithi062 ceph-mon[30666]: pgmap v134: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:32.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:31 smithi107 ceph-mon[35463]: pgmap v134: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:32.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:31 smithi077 ceph-mon[35095]: pgmap v134: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:34.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:33 smithi062 ceph-mon[30666]: pgmap v135: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:34.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:33 smithi107 ceph-mon[35463]: pgmap v135: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:34.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:33 smithi077 ceph-mon[35095]: pgmap v135: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:36.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:35 smithi062 ceph-mon[30666]: pgmap v136: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:36.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:35 smithi107 ceph-mon[35463]: pgmap v136: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:36.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:35 smithi077 ceph-mon[35095]: pgmap v136: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:38.255 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:37 smithi107 ceph-mon[35463]: pgmap v137: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:38.266 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:37 smithi077 ceph-mon[35095]: pgmap v137: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:38.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:37 smithi062 ceph-mon[30666]: pgmap v137: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:40.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:40 smithi062 ceph-mon[30666]: pgmap v138: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:40.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:40 smithi107 ceph-mon[35463]: pgmap v138: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:40.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:40 smithi077 ceph-mon[35095]: pgmap v138: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:42.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:42 smithi062 ceph-mon[30666]: pgmap v139: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:42.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:42 smithi107 ceph-mon[35463]: pgmap v139: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:42.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:42 smithi077 ceph-mon[35095]: pgmap v139: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:44.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:44 smithi062 ceph-mon[30666]: pgmap v140: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:44 smithi107 ceph-mon[35463]: pgmap v140: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:44 smithi077 ceph-mon[35095]: pgmap v140: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:46.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:46 smithi062 ceph-mon[30666]: pgmap v141: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:46.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:46 smithi107 ceph-mon[35463]: pgmap v141: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:46.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:46 smithi077 ceph-mon[35095]: pgmap v141: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:48.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:48 smithi062 ceph-mon[30666]: pgmap v142: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:48.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:48 smithi107 ceph-mon[35463]: pgmap v142: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:48.496 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:48 smithi077 ceph-mon[35095]: pgmap v142: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:50.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:50 smithi062 ceph-mon[30666]: pgmap v143: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:50.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:50 smithi107 ceph-mon[35463]: pgmap v143: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:50.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:50 smithi077 ceph-mon[35095]: pgmap v143: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:52.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:52 smithi062 ceph-mon[30666]: pgmap v144: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:52.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:52 smithi107 ceph-mon[35463]: pgmap v144: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:52.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:52 smithi077 ceph-mon[35095]: pgmap v144: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:54.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:54 smithi062 ceph-mon[30666]: pgmap v145: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:54.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:54 smithi107 ceph-mon[35463]: pgmap v145: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:54.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:54 smithi077 ceph-mon[35095]: pgmap v145: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:56 smithi062 ceph-mon[30666]: pgmap v146: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:56.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:56 smithi107 ceph-mon[35463]: pgmap v146: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:56.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:56 smithi077 ceph-mon[35095]: pgmap v146: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:03:58.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:03:58 smithi062 ceph-mon[30666]: pgmap v147: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:03:58 smithi107 ceph-mon[35463]: pgmap v147: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:03:58.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:03:58 smithi077 ceph-mon[35095]: pgmap v147: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:00.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:00 smithi062 ceph-mon[30666]: pgmap v148: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:00.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:00 smithi107 ceph-mon[35463]: pgmap v148: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:00.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:00 smithi077 ceph-mon[35095]: pgmap v148: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:02.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:02 smithi062 ceph-mon[30666]: pgmap v149: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:02.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:02 smithi107 ceph-mon[35463]: pgmap v149: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:02.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:02 smithi077 ceph-mon[35095]: pgmap v149: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:04 smithi062 ceph-mon[30666]: pgmap v150: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:04.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:04 smithi107 ceph-mon[35463]: pgmap v150: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:04.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:04 smithi077 ceph-mon[35095]: pgmap v150: 129 pgs: 129 active+clean; 259 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:06.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:06 smithi062 ceph-mon[30666]: pgmap v151: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:04:06.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:06 smithi107 ceph-mon[35463]: pgmap v151: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:04:06.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:06 smithi077 ceph-mon[35095]: pgmap v151: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:04:08.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:08 smithi062 ceph-mon[30666]: pgmap v152: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:04:08.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:08 smithi107 ceph-mon[35463]: pgmap v152: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:04:08.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:08 smithi077 ceph-mon[35095]: pgmap v152: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:04:10.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:10 smithi062 ceph-mon[30666]: pgmap v153: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:04:10.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:10 smithi107 ceph-mon[35463]: pgmap v153: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:04:10.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:10 smithi077 ceph-mon[35095]: pgmap v153: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:04:12.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:12 smithi062 ceph-mon[30666]: pgmap v154: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:04:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:12 smithi107 ceph-mon[35463]: pgmap v154: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:04:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:12 smithi077 ceph-mon[35095]: pgmap v154: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:04:14.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:14 smithi062 ceph-mon[30666]: pgmap v155: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:04:14.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:14 smithi107 ceph-mon[35463]: pgmap v155: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:04:14.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:14 smithi077 ceph-mon[35095]: pgmap v155: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:04:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:16 smithi062 ceph-mon[30666]: pgmap v156: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:04:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:16 smithi107 ceph-mon[35463]: pgmap v156: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:04:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:16 smithi077 ceph-mon[35095]: pgmap v156: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:04:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:18 smithi062 ceph-mon[30666]: pgmap v157: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:04:18.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:18 smithi107 ceph-mon[35463]: pgmap v157: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:04:18.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:18 smithi077 ceph-mon[35095]: pgmap v157: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:04:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:20 smithi062 ceph-mon[30666]: pgmap v158: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:04:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:20 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:20.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:20 smithi107 ceph-mon[35463]: pgmap v158: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:04:20.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:20 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:20 smithi077 ceph-mon[35095]: pgmap v158: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:04:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:20 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:21 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:21 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:21.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:21 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:04:21.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:21 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:21.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:21 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:21.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:21 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:04:21.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:21 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:21.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:21 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:21.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:21 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:04:22.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:22 smithi062 ceph-mon[30666]: pgmap v159: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:04:22.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:22 smithi107 ceph-mon[35463]: pgmap v159: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:04:22.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:22 smithi077 ceph-mon[35095]: pgmap v159: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:04:24.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:24 smithi062 ceph-mon[30666]: pgmap v160: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:04:24.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:24 smithi107 ceph-mon[35463]: pgmap v160: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:04:24.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:24 smithi077 ceph-mon[35095]: pgmap v160: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:04:26.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:26 smithi062 ceph-mon[30666]: pgmap v161: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:04:26.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:26 smithi107 ceph-mon[35463]: pgmap v161: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:04:26.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:26 smithi077 ceph-mon[35095]: pgmap v161: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:04:28.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:27 smithi062 ceph-mon[30666]: pgmap v162: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:27 smithi107 ceph-mon[35463]: pgmap v162: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:28.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:27 smithi077 ceph-mon[35095]: pgmap v162: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:30.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:29 smithi107 ceph-mon[35463]: pgmap v163: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:30.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:29 smithi077 ceph-mon[35095]: pgmap v163: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:30.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:29 smithi062 ceph-mon[30666]: pgmap v163: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:32.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:31 smithi107 ceph-mon[35463]: pgmap v164: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:32.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:31 smithi077 ceph-mon[35095]: pgmap v164: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:32.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:31 smithi062 ceph-mon[30666]: pgmap v164: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:34.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:33 smithi107 ceph-mon[35463]: pgmap v165: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:34.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:33 smithi077 ceph-mon[35095]: pgmap v165: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:34.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:33 smithi062 ceph-mon[30666]: pgmap v165: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:36.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:35 smithi107 ceph-mon[35463]: pgmap v166: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:36.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:35 smithi077 ceph-mon[35095]: pgmap v166: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:36.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:35 smithi062 ceph-mon[30666]: pgmap v166: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:38.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:37 smithi107 ceph-mon[35463]: pgmap v167: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:38.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:37 smithi077 ceph-mon[35095]: pgmap v167: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:38.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:37 smithi062 ceph-mon[30666]: pgmap v167: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:40.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:39 smithi107 ceph-mon[35463]: pgmap v168: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:40.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:39 smithi077 ceph-mon[35095]: pgmap v168: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:40.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:39 smithi062 ceph-mon[30666]: pgmap v168: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:42.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:41 smithi107 ceph-mon[35463]: pgmap v169: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:42.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:41 smithi077 ceph-mon[35095]: pgmap v169: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:42.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:41 smithi062 ceph-mon[30666]: pgmap v169: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:44.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:43 smithi107 ceph-mon[35463]: pgmap v170: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:44.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:43 smithi077 ceph-mon[35095]: pgmap v170: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:44.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:43 smithi062 ceph-mon[30666]: pgmap v170: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:46.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:45 smithi107 ceph-mon[35463]: pgmap v171: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:46.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:45 smithi077 ceph-mon[35095]: pgmap v171: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:46.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:45 smithi062 ceph-mon[30666]: pgmap v171: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:48.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:47 smithi107 ceph-mon[35463]: pgmap v172: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:48.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:47 smithi077 ceph-mon[35095]: pgmap v172: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:48.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:47 smithi062 ceph-mon[30666]: pgmap v172: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:50.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:49 smithi077 ceph-mon[35095]: pgmap v173: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:50.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:49 smithi062 ceph-mon[30666]: pgmap v173: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:50.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:49 smithi107 ceph-mon[35463]: pgmap v173: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:51 smithi077 ceph-mon[35095]: pgmap v174: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:52.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:51 smithi062 ceph-mon[30666]: pgmap v174: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:52.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:51 smithi107 ceph-mon[35463]: pgmap v174: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:53 smithi077 ceph-mon[35095]: pgmap v175: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:54.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:53 smithi062 ceph-mon[30666]: pgmap v175: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:54.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:53 smithi107 ceph-mon[35463]: pgmap v175: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:56.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:55 smithi077 ceph-mon[35095]: pgmap v176: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:55 smithi062 ceph-mon[30666]: pgmap v176: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:56.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:55 smithi107 ceph-mon[35463]: pgmap v176: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:04:58.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:57 smithi062 ceph-mon[30666]: pgmap v177: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:57 smithi107 ceph-mon[35463]: pgmap v177: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:04:58.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:57 smithi077 ceph-mon[35095]: pgmap v177: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:00.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:04:59 smithi062 ceph-mon[30666]: pgmap v178: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:00.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:04:59 smithi107 ceph-mon[35463]: pgmap v178: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:00.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:04:59 smithi077 ceph-mon[35095]: pgmap v178: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:02.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:01 smithi062 ceph-mon[30666]: pgmap v179: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:02.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:01 smithi107 ceph-mon[35463]: pgmap v179: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:02.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:01 smithi077 ceph-mon[35095]: pgmap v179: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:03 smithi062 ceph-mon[30666]: pgmap v180: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:04.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:03 smithi107 ceph-mon[35463]: pgmap v180: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:04.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:03 smithi077 ceph-mon[35095]: pgmap v180: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:06.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:05 smithi062 ceph-mon[30666]: pgmap v181: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:05:06.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:05 smithi107 ceph-mon[35463]: pgmap v181: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:05:06.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:05 smithi077 ceph-mon[35095]: pgmap v181: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:05:08.255 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:07 smithi107 ceph-mon[35463]: pgmap v182: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:05:08.266 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:07 smithi077 ceph-mon[35095]: pgmap v182: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:05:08.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:07 smithi062 ceph-mon[30666]: pgmap v182: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:05:10.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:09 smithi062 ceph-mon[30666]: pgmap v183: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:05:10.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:09 smithi107 ceph-mon[35463]: pgmap v183: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:05:10.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:09 smithi077 ceph-mon[35095]: pgmap v183: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:05:12.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:11 smithi062 ceph-mon[30666]: pgmap v184: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:05:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:11 smithi107 ceph-mon[35463]: pgmap v184: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:05:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:11 smithi077 ceph-mon[35095]: pgmap v184: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:05:14.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:13 smithi062 ceph-mon[30666]: pgmap v185: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:05:14.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:14 smithi107 ceph-mon[35463]: pgmap v185: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:05:14.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:14 smithi077 ceph-mon[35095]: pgmap v185: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-12T02:05:16.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:16 smithi062 ceph-mon[30666]: pgmap v186: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:05:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:16 smithi107 ceph-mon[35463]: pgmap v186: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:05:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:16 smithi077 ceph-mon[35095]: pgmap v186: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T02:05:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:18 smithi062 ceph-mon[30666]: pgmap v187: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:05:18.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:18 smithi107 ceph-mon[35463]: pgmap v187: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:05:18.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:18 smithi077 ceph-mon[35095]: pgmap v187: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:05:20.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:20 smithi062 ceph-mon[30666]: pgmap v188: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:05:20.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:20 smithi107 ceph-mon[35463]: pgmap v188: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:05:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:20 smithi077 ceph-mon[35095]: pgmap v188: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:05:21.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:21 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:21.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:21 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:21.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:21 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:22.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:22 smithi062 ceph-mon[30666]: pgmap v189: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:05:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:22 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:22 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:22 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:05:22.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:22 smithi107 ceph-mon[35463]: pgmap v189: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:05:22.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:22 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:22.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:22 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:22.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:22 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:05:22.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:22 smithi077 ceph-mon[35095]: pgmap v189: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:05:22.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:22 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:22.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:22 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:22.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:22 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:05:24.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:24 smithi062 ceph-mon[30666]: pgmap v190: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:05:24.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:24 smithi107 ceph-mon[35463]: pgmap v190: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:05:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:24 smithi077 ceph-mon[35095]: pgmap v190: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:05:26.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:26 smithi062 ceph-mon[30666]: pgmap v191: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:05:26.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:26 smithi107 ceph-mon[35463]: pgmap v191: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:05:26.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:26 smithi077 ceph-mon[35095]: pgmap v191: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:05:28.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:28 smithi062 ceph-mon[30666]: pgmap v192: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:28.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:28 smithi107 ceph-mon[35463]: pgmap v192: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:28.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:28 smithi077 ceph-mon[35095]: pgmap v192: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:30.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:30 smithi062 ceph-mon[30666]: pgmap v193: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:30 smithi107 ceph-mon[35463]: pgmap v193: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:30.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:30 smithi077 ceph-mon[35095]: pgmap v193: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:32.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:32 smithi062 ceph-mon[30666]: pgmap v194: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:32.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:32 smithi107 ceph-mon[35463]: pgmap v194: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:32.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:32 smithi077 ceph-mon[35095]: pgmap v194: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:34.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:34 smithi062 ceph-mon[30666]: pgmap v195: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:34.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:34 smithi107 ceph-mon[35463]: pgmap v195: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:34.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:34 smithi077 ceph-mon[35095]: pgmap v195: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:36.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:36 smithi062 ceph-mon[30666]: pgmap v196: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:36.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:36 smithi107 ceph-mon[35463]: pgmap v196: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:36.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:36 smithi077 ceph-mon[35095]: pgmap v196: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:38.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:38 smithi062 ceph-mon[30666]: pgmap v197: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:38.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:38 smithi107 ceph-mon[35463]: pgmap v197: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:38.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:38 smithi077 ceph-mon[35095]: pgmap v197: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:40.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:40 smithi062 ceph-mon[30666]: pgmap v198: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:40.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:40 smithi107 ceph-mon[35463]: pgmap v198: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:40.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:40 smithi077 ceph-mon[35095]: pgmap v198: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:42.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:42 smithi062 ceph-mon[30666]: pgmap v199: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:42.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:42 smithi107 ceph-mon[35463]: pgmap v199: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:42.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:42 smithi077 ceph-mon[35095]: pgmap v199: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:44.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:44 smithi062 ceph-mon[30666]: pgmap v200: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:44 smithi107 ceph-mon[35463]: pgmap v200: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:44 smithi077 ceph-mon[35095]: pgmap v200: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:46.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:46 smithi062 ceph-mon[30666]: pgmap v201: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:46.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:46 smithi107 ceph-mon[35463]: pgmap v201: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:46.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:46 smithi077 ceph-mon[35095]: pgmap v201: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:48.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:48 smithi062 ceph-mon[30666]: pgmap v202: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-12T02:05:48.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:48 smithi107 ceph-mon[35463]: pgmap v202: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-12T02:05:48.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:48 smithi077 ceph-mon[35095]: pgmap v202: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-12T02:05:50.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:50 smithi062 ceph-mon[30666]: pgmap v203: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-12T02:05:50.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:50 smithi107 ceph-mon[35463]: pgmap v203: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-12T02:05:50.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:50 smithi077 ceph-mon[35095]: pgmap v203: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-12T02:05:52.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:52 smithi062 ceph-mon[30666]: pgmap v204: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:52.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:52 smithi107 ceph-mon[35463]: pgmap v204: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:52.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:52 smithi077 ceph-mon[35095]: pgmap v204: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:54.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:54 smithi062 ceph-mon[30666]: pgmap v205: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-12T02:05:54.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:54 smithi107 ceph-mon[35463]: pgmap v205: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-12T02:05:54.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:54 smithi077 ceph-mon[35095]: pgmap v205: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-12T02:05:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:56 smithi062 ceph-mon[30666]: pgmap v206: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:56.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:56 smithi107 ceph-mon[35463]: pgmap v206: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:56.471 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:56 smithi077 ceph-mon[35095]: pgmap v206: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:05:58.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:05:58 smithi062 ceph-mon[30666]: pgmap v207: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:05:58 smithi107 ceph-mon[35463]: pgmap v207: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:05:58.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:05:58 smithi077 ceph-mon[35095]: pgmap v207: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:00.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:00 smithi107 ceph-mon[35463]: pgmap v208: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:00.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:00 smithi077 ceph-mon[35095]: pgmap v208: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:00.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:00 smithi062 ceph-mon[30666]: pgmap v208: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:02.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:02 smithi107 ceph-mon[35463]: pgmap v209: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:02.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:02 smithi077 ceph-mon[35095]: pgmap v209: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:02.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:02 smithi062 ceph-mon[30666]: pgmap v209: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:04.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:04 smithi107 ceph-mon[35463]: pgmap v210: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:04.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:04 smithi077 ceph-mon[35095]: pgmap v210: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:04.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:04 smithi062 ceph-mon[30666]: pgmap v210: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:06.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:06 smithi107 ceph-mon[35463]: pgmap v211: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:06:06.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:06 smithi077 ceph-mon[35095]: pgmap v211: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:06:06.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:06 smithi062 ceph-mon[30666]: pgmap v211: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:06:08.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:08 smithi107 ceph-mon[35463]: pgmap v212: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:06:08.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:08 smithi077 ceph-mon[35095]: pgmap v212: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:06:08.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:08 smithi062 ceph-mon[30666]: pgmap v212: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:06:10.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:10 smithi107 ceph-mon[35463]: pgmap v213: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:06:10.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:10 smithi077 ceph-mon[35095]: pgmap v213: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:06:10.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:10 smithi062 ceph-mon[30666]: pgmap v213: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:06:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:12 smithi107 ceph-mon[35463]: pgmap v214: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:06:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:12 smithi107 ceph-mon[35463]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:06:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:12 smithi077 ceph-mon[35095]: pgmap v214: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:06:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:12 smithi077 ceph-mon[35095]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:06:12.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:12 smithi062 ceph-mon[30666]: pgmap v214: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:06:12.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:12 smithi062 ceph-mon[30666]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:06:14.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:14 smithi107 ceph-mon[35463]: pgmap v216: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:06:14.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:14 smithi077 ceph-mon[35095]: pgmap v216: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:06:14.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:14 smithi062 ceph-mon[30666]: pgmap v216: 129 pgs: 129 active+clean; 259 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:06:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:16 smithi107 ceph-mon[35463]: pgmap v217: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:06:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:16 smithi077 ceph-mon[35095]: pgmap v217: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:06:16.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:16 smithi062 ceph-mon[30666]: pgmap v217: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:06:18.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:17 smithi062 ceph-mon[30666]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:06:18.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:17 smithi062 ceph-mon[30666]: pgmap v219: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:06:18.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:17 smithi107 ceph-mon[35463]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:06:18.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:17 smithi107 ceph-mon[35463]: pgmap v219: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:06:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:17 smithi077 ceph-mon[35095]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:06:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:17 smithi077 ceph-mon[35095]: pgmap v219: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:06:20.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:19 smithi107 ceph-mon[35463]: pgmap v220: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-12T02:06:20.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:19 smithi077 ceph-mon[35095]: pgmap v220: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-12T02:06:20.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:19 smithi062 ceph-mon[30666]: pgmap v220: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-12T02:06:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:21 smithi077 ceph-mon[35095]: pgmap v221: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 209 B/s wr, 2 op/s 2024-09-12T02:06:22.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:21 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:22.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:21 smithi062 ceph-mon[30666]: pgmap v221: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 209 B/s wr, 2 op/s 2024-09-12T02:06:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:21 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:22.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:21 smithi107 ceph-mon[35463]: pgmap v221: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 209 B/s wr, 2 op/s 2024-09-12T02:06:22.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:21 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:22 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:22 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:23.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:22 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:06:23.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:22 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:23.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:22 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:23.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:22 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:06:23.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:22 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:23.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:22 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:23.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:22 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:06:24.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:24 smithi107 ceph-mon[35463]: pgmap v222: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:06:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:24 smithi077 ceph-mon[35095]: pgmap v222: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:06:24.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:24 smithi062 ceph-mon[30666]: pgmap v222: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:06:26.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:26 smithi107 ceph-mon[35463]: pgmap v223: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-12T02:06:26.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:26 smithi077 ceph-mon[35095]: pgmap v223: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-12T02:06:26.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:26 smithi062 ceph-mon[30666]: pgmap v223: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-12T02:06:28.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:28 smithi107 ceph-mon[35463]: pgmap v224: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 101 B/s wr, 2 op/s 2024-09-12T02:06:28.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:28 smithi077 ceph-mon[35095]: pgmap v224: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 101 B/s wr, 2 op/s 2024-09-12T02:06:28.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:28 smithi062 ceph-mon[30666]: pgmap v224: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 101 B/s wr, 2 op/s 2024-09-12T02:06:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:30 smithi107 ceph-mon[35463]: pgmap v225: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:06:30.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:30 smithi077 ceph-mon[35095]: pgmap v225: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:06:30.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:30 smithi062 ceph-mon[30666]: pgmap v225: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:06:32.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:32 smithi107 ceph-mon[35463]: pgmap v226: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:06:32.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:32 smithi077 ceph-mon[35095]: pgmap v226: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:06:32.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:32 smithi062 ceph-mon[30666]: pgmap v226: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:06:34.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:34 smithi107 ceph-mon[35463]: pgmap v227: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:34.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:34 smithi077 ceph-mon[35095]: pgmap v227: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:34.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:34 smithi062 ceph-mon[30666]: pgmap v227: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:36.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:36 smithi107 ceph-mon[35463]: pgmap v228: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:36.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:36 smithi077 ceph-mon[35095]: pgmap v228: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:36.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:36 smithi062 ceph-mon[30666]: pgmap v228: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:38.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:38 smithi107 ceph-mon[35463]: pgmap v229: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:38.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:38 smithi077 ceph-mon[35095]: pgmap v229: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:38.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:38 smithi062 ceph-mon[30666]: pgmap v229: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:40.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:40 smithi107 ceph-mon[35463]: pgmap v230: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:40.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:40 smithi077 ceph-mon[35095]: pgmap v230: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:40.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:40 smithi062 ceph-mon[30666]: pgmap v230: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:42.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:42 smithi107 ceph-mon[35463]: pgmap v231: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:42.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:42 smithi077 ceph-mon[35095]: pgmap v231: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:42.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:42 smithi062 ceph-mon[30666]: pgmap v231: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:44 smithi107 ceph-mon[35463]: pgmap v232: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:44 smithi077 ceph-mon[35095]: pgmap v232: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:44.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:44 smithi062 ceph-mon[30666]: pgmap v232: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:46.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:46 smithi107 ceph-mon[35463]: pgmap v233: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:46.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:46 smithi077 ceph-mon[35095]: pgmap v233: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:46.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:46 smithi062 ceph-mon[30666]: pgmap v233: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:48.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:48 smithi107 ceph-mon[35463]: pgmap v234: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:48.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:48 smithi077 ceph-mon[35095]: pgmap v234: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:48.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:48 smithi062 ceph-mon[30666]: pgmap v234: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:50.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:50 smithi107 ceph-mon[35463]: pgmap v235: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:50.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:50 smithi077 ceph-mon[35095]: pgmap v235: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:50.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:50 smithi062 ceph-mon[30666]: pgmap v235: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:52.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:52 smithi107 ceph-mon[35463]: pgmap v236: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:52.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:52 smithi077 ceph-mon[35095]: pgmap v236: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:52.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:52 smithi062 ceph-mon[30666]: pgmap v236: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:54.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:54 smithi107 ceph-mon[35463]: pgmap v237: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:54.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:54 smithi077 ceph-mon[35095]: pgmap v237: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:54.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:54 smithi062 ceph-mon[30666]: pgmap v237: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:56.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:56 smithi107 ceph-mon[35463]: pgmap v238: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:56.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:56 smithi077 ceph-mon[35095]: pgmap v238: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:56.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:56 smithi062 ceph-mon[30666]: pgmap v238: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:06:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:06:58 smithi107 ceph-mon[35463]: pgmap v239: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:58.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:06:58 smithi077 ceph-mon[35095]: pgmap v239: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:06:58.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:06:58 smithi062 ceph-mon[30666]: pgmap v239: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:00.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:00 smithi107 ceph-mon[35463]: pgmap v240: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:00.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:00 smithi077 ceph-mon[35095]: pgmap v240: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:00.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:00 smithi062 ceph-mon[30666]: pgmap v240: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:02.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:02 smithi107 ceph-mon[35463]: pgmap v241: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:02.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:02 smithi077 ceph-mon[35095]: pgmap v241: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:02.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:02 smithi062 ceph-mon[30666]: pgmap v241: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:04.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:04 smithi107 ceph-mon[35463]: pgmap v242: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:04.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:04 smithi077 ceph-mon[35095]: pgmap v242: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:04.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:04 smithi062 ceph-mon[30666]: pgmap v242: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:06.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:06 smithi107 ceph-mon[35463]: pgmap v243: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:07:06.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:06 smithi077 ceph-mon[35095]: pgmap v243: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:07:06.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:06 smithi062 ceph-mon[30666]: pgmap v243: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:07:08.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:08 smithi107 ceph-mon[35463]: pgmap v244: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:07:08.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:08 smithi077 ceph-mon[35095]: pgmap v244: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:07:08.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:08 smithi062 ceph-mon[30666]: pgmap v244: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:07:10.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:10 smithi107 ceph-mon[35463]: pgmap v245: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:07:10.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:10 smithi077 ceph-mon[35095]: pgmap v245: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:07:10.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:10 smithi062 ceph-mon[30666]: pgmap v245: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:07:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:12 smithi077 ceph-mon[35095]: pgmap v246: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:07:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:12 smithi077 ceph-mon[35095]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:07:12.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:12 smithi062 ceph-mon[30666]: pgmap v246: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:07:12.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:12 smithi062 ceph-mon[30666]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:07:12.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:12 smithi107 ceph-mon[35463]: pgmap v246: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:07:12.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:12 smithi107 ceph-mon[35463]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:07:14.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:14 smithi077 ceph-mon[35095]: pgmap v248: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:07:14.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:14 smithi062 ceph-mon[30666]: pgmap v248: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:07:14.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:14 smithi107 ceph-mon[35463]: pgmap v248: 129 pgs: 129 active+clean; 259 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:07:16.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:16 smithi062 ceph-mon[30666]: pgmap v249: 129 pgs: 129 active+clean; 2.2 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:07:16.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:16 smithi107 ceph-mon[35463]: pgmap v249: 129 pgs: 129 active+clean; 2.2 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:07:16.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:16 smithi077 ceph-mon[35095]: pgmap v249: 129 pgs: 129 active+clean; 2.2 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:07:18.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:17 smithi107 ceph-mon[35463]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:07:18.206 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:17 smithi107 ceph-mon[35463]: pgmap v251: 129 pgs: 129 active+clean; 2.2 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:07:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:17 smithi077 ceph-mon[35095]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:07:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:17 smithi077 ceph-mon[35095]: pgmap v251: 129 pgs: 129 active+clean; 2.2 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:07:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:17 smithi062 ceph-mon[30666]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:07:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:17 smithi062 ceph-mon[30666]: pgmap v251: 129 pgs: 129 active+clean; 2.2 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:07:20.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:19 smithi062 ceph-mon[30666]: pgmap v252: 129 pgs: 129 active+clean; 2.2 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-12T02:07:20.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:19 smithi107 ceph-mon[35463]: pgmap v252: 129 pgs: 129 active+clean; 2.2 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-12T02:07:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:19 smithi077 ceph-mon[35095]: pgmap v252: 129 pgs: 129 active+clean; 2.2 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-12T02:07:22.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:21 smithi062 ceph-mon[30666]: pgmap v253: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 210 B/s wr, 2 op/s 2024-09-12T02:07:22.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:21 smithi107 ceph-mon[35463]: pgmap v253: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 210 B/s wr, 2 op/s 2024-09-12T02:07:22.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:21 smithi077 ceph-mon[35095]: pgmap v253: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 210 B/s wr, 2 op/s 2024-09-12T02:07:23.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:22 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:23.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:22 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:23.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:22 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:24.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:23 smithi062 ceph-mon[30666]: pgmap v254: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:07:24.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:23 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:24.244 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:23 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:24.244 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:23 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:07:24.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:23 smithi107 ceph-mon[35463]: pgmap v254: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:07:24.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:23 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:24.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:23 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:24.455 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:23 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:07:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:23 smithi077 ceph-mon[35095]: pgmap v254: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:07:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:23 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:24.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:23 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:24.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:23 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:07:26.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:25 smithi062 ceph-mon[30666]: pgmap v255: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-12T02:07:26.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:25 smithi107 ceph-mon[35463]: pgmap v255: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-12T02:07:26.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:25 smithi077 ceph-mon[35095]: pgmap v255: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-12T02:07:28.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:27 smithi062 ceph-mon[30666]: pgmap v256: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 101 B/s wr, 2 op/s 2024-09-12T02:07:28.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:27 smithi107 ceph-mon[35463]: pgmap v256: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 101 B/s wr, 2 op/s 2024-09-12T02:07:28.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:27 smithi077 ceph-mon[35095]: pgmap v256: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 101 B/s wr, 2 op/s 2024-09-12T02:07:30.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:29 smithi062 ceph-mon[30666]: pgmap v257: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:07:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:29 smithi107 ceph-mon[35463]: pgmap v257: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:07:30.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:29 smithi077 ceph-mon[35095]: pgmap v257: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-12T02:07:32.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:32 smithi062 ceph-mon[30666]: pgmap v258: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:07:32.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:32 smithi107 ceph-mon[35463]: pgmap v258: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:07:32.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:32 smithi077 ceph-mon[35095]: pgmap v258: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:07:34.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:34 smithi062 ceph-mon[30666]: pgmap v259: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:34.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:34 smithi107 ceph-mon[35463]: pgmap v259: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:34.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:34 smithi077 ceph-mon[35095]: pgmap v259: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:36.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:36 smithi062 ceph-mon[30666]: pgmap v260: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:36.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:36 smithi107 ceph-mon[35463]: pgmap v260: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:36.474 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:36 smithi077 ceph-mon[35095]: pgmap v260: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:38.266 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:38 smithi077 ceph-mon[35095]: pgmap v261: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:38.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:38 smithi062 ceph-mon[30666]: pgmap v261: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:38.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:38 smithi107 ceph-mon[35463]: pgmap v261: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:40.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:40 smithi062 ceph-mon[30666]: pgmap v262: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:40.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:40 smithi107 ceph-mon[35463]: pgmap v262: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:40.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:40 smithi077 ceph-mon[35095]: pgmap v262: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:42.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:42 smithi062 ceph-mon[30666]: pgmap v263: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:42.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:42 smithi107 ceph-mon[35463]: pgmap v263: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:42.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:42 smithi077 ceph-mon[35095]: pgmap v263: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:44.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:44 smithi062 ceph-mon[30666]: pgmap v264: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:44 smithi107 ceph-mon[35463]: pgmap v264: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:44 smithi077 ceph-mon[35095]: pgmap v264: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:46.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:46 smithi062 ceph-mon[30666]: pgmap v265: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:46.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:46 smithi107 ceph-mon[35463]: pgmap v265: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:46.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:46 smithi077 ceph-mon[35095]: pgmap v265: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:48.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:48 smithi062 ceph-mon[30666]: pgmap v266: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:48.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:48 smithi107 ceph-mon[35463]: pgmap v266: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:48.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:48 smithi077 ceph-mon[35095]: pgmap v266: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:50.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:50 smithi062 ceph-mon[30666]: pgmap v267: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:50.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:50 smithi107 ceph-mon[35463]: pgmap v267: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:50.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:50 smithi077 ceph-mon[35095]: pgmap v267: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:52.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:52 smithi062 ceph-mon[30666]: pgmap v268: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:52.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:52 smithi107 ceph-mon[35463]: pgmap v268: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:52.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:52 smithi077 ceph-mon[35095]: pgmap v268: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:54.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:54 smithi062 ceph-mon[30666]: pgmap v269: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:54.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:54 smithi107 ceph-mon[35463]: pgmap v269: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:54.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:54 smithi077 ceph-mon[35095]: pgmap v269: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:56.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:56 smithi062 ceph-mon[30666]: pgmap v270: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:56.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:56 smithi107 ceph-mon[35463]: pgmap v270: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:56.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:56 smithi077 ceph-mon[35095]: pgmap v270: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:07:58.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:07:58 smithi062 ceph-mon[30666]: pgmap v271: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:07:58 smithi107 ceph-mon[35463]: pgmap v271: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:07:58.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:07:58 smithi077 ceph-mon[35095]: pgmap v271: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:00.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:00 smithi062 ceph-mon[30666]: pgmap v272: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:00.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:00 smithi107 ceph-mon[35463]: pgmap v272: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:00.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:00 smithi077 ceph-mon[35095]: pgmap v272: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:02.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:02 smithi062 ceph-mon[30666]: pgmap v273: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:02.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:02 smithi107 ceph-mon[35463]: pgmap v273: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:02.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:02 smithi077 ceph-mon[35095]: pgmap v273: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:04 smithi062 ceph-mon[30666]: pgmap v274: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:04.457 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:04 smithi107 ceph-mon[35463]: pgmap v274: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:04.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:04 smithi077 ceph-mon[35095]: pgmap v274: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:06.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:06 smithi062 ceph-mon[30666]: pgmap v275: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:08:06.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:06 smithi107 ceph-mon[35463]: pgmap v275: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:08:06.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:06 smithi077 ceph-mon[35095]: pgmap v275: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:08:07.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:07 smithi062 ceph-mon[30666]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:08:07.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:07 smithi107 ceph-mon[35463]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:08:07.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:07 smithi077 ceph-mon[35095]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:08:08.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:08 smithi062 ceph-mon[30666]: pgmap v277: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:08:08.354 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:08 smithi107 ceph-mon[35463]: pgmap v277: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:08:08.365 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:08 smithi077 ceph-mon[35095]: pgmap v277: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:08:10.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:10 smithi062 ceph-mon[30666]: pgmap v278: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:08:10.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:10 smithi107 ceph-mon[35463]: pgmap v278: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:08:10.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:10 smithi077 ceph-mon[35095]: pgmap v278: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:08:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:12 smithi107 ceph-mon[35463]: pgmap v279: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:08:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:12 smithi107 ceph-mon[35463]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:08:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:12 smithi077 ceph-mon[35095]: pgmap v279: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:08:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:12 smithi077 ceph-mon[35095]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:08:12.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:12 smithi062 ceph-mon[30666]: pgmap v279: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:08:12.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:12 smithi062 ceph-mon[30666]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:08:14.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:14 smithi107 ceph-mon[35463]: pgmap v281: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-12T02:08:14.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:14 smithi077 ceph-mon[35095]: pgmap v281: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-12T02:08:14.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:14 smithi062 ceph-mon[30666]: pgmap v281: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-12T02:08:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:16 smithi107 ceph-mon[35463]: pgmap v282: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 231 B/s wr, 2 op/s 2024-09-12T02:08:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:16 smithi077 ceph-mon[35095]: pgmap v282: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 231 B/s wr, 2 op/s 2024-09-12T02:08:16.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:16 smithi062 ceph-mon[30666]: pgmap v282: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 231 B/s wr, 2 op/s 2024-09-12T02:08:18.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:18 smithi107 ceph-mon[35463]: pgmap v283: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:08:18.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:18 smithi077 ceph-mon[35095]: pgmap v283: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:08:18.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:18 smithi062 ceph-mon[30666]: pgmap v283: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:08:20.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:20 smithi107 ceph-mon[35463]: pgmap v284: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:08:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:20 smithi077 ceph-mon[35095]: pgmap v284: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:08:20.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:20 smithi062 ceph-mon[30666]: pgmap v284: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:08:22.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:22 smithi107 ceph-mon[35463]: pgmap v285: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-12T02:08:22.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:22 smithi077 ceph-mon[35095]: pgmap v285: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-12T02:08:22.591 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:22 smithi062 ceph-mon[30666]: pgmap v285: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-12T02:08:24.394 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:24 smithi062 ceph-mon[30666]: pgmap v286: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 B/s rd, 92 B/s wr, 1 op/s 2024-09-12T02:08:24.394 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:24 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:24.394 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:24 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:24.394 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:24 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:24.394 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:24 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:08:24.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:24 smithi107 ceph-mon[35463]: pgmap v286: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 B/s rd, 92 B/s wr, 1 op/s 2024-09-12T02:08:24.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:24 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:24.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:24 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:24.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:24 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:24.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:24 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:08:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:24 smithi077 ceph-mon[35095]: pgmap v286: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 B/s rd, 92 B/s wr, 1 op/s 2024-09-12T02:08:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:24 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:24 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:24 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:24.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:24 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:08:26.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:26 smithi107 ceph-mon[35463]: pgmap v287: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:08:26.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:26 smithi077 ceph-mon[35095]: pgmap v287: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:08:26.592 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:26 smithi062 ceph-mon[30666]: pgmap v287: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-12T02:08:28.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:27 smithi107 ceph-mon[35463]: pgmap v288: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:28.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:27 smithi077 ceph-mon[35095]: pgmap v288: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:28.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:27 smithi062 ceph-mon[30666]: pgmap v288: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:30.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:29 smithi062 ceph-mon[30666]: pgmap v289: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:30.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:29 smithi107 ceph-mon[35463]: pgmap v289: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:30.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:29 smithi077 ceph-mon[35095]: pgmap v289: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:32.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:31 smithi062 ceph-mon[30666]: pgmap v290: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:32.456 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:31 smithi107 ceph-mon[35463]: pgmap v290: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:32.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:31 smithi077 ceph-mon[35095]: pgmap v290: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:34.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:33 smithi062 ceph-mon[30666]: pgmap v291: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:34.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:33 smithi107 ceph-mon[35463]: pgmap v291: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:34.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:33 smithi077 ceph-mon[35095]: pgmap v291: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:36.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:36 smithi062 ceph-mon[30666]: pgmap v292: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:36.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:36 smithi107 ceph-mon[35463]: pgmap v292: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:36.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:36 smithi077 ceph-mon[35095]: pgmap v292: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:38.256 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:38 smithi107 ceph-mon[35463]: pgmap v293: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:38.266 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:38 smithi077 ceph-mon[35095]: pgmap v293: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:38.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:38 smithi062 ceph-mon[30666]: pgmap v293: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:40.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:40 smithi062 ceph-mon[30666]: pgmap v294: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:40.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:40 smithi107 ceph-mon[35463]: pgmap v294: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:40.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:40 smithi077 ceph-mon[35095]: pgmap v294: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:42.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:42 smithi062 ceph-mon[30666]: pgmap v295: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:42.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:42 smithi107 ceph-mon[35463]: pgmap v295: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:42.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:42 smithi077 ceph-mon[35095]: pgmap v295: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:44.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:44 smithi062 ceph-mon[30666]: pgmap v296: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:44.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:44 smithi107 ceph-mon[35463]: pgmap v296: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:44.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:44 smithi077 ceph-mon[35095]: pgmap v296: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:46.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:46 smithi062 ceph-mon[30666]: pgmap v297: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:46.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:46 smithi107 ceph-mon[35463]: pgmap v297: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:46.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:46 smithi077 ceph-mon[35095]: pgmap v297: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:48.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:48 smithi062 ceph-mon[30666]: pgmap v298: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:48.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:48 smithi107 ceph-mon[35463]: pgmap v298: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:48.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:48 smithi077 ceph-mon[35095]: pgmap v298: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:50.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:50 smithi062 ceph-mon[30666]: pgmap v299: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:50.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:50 smithi107 ceph-mon[35463]: pgmap v299: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:50.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:50 smithi077 ceph-mon[35095]: pgmap v299: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:52.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:52 smithi062 ceph-mon[30666]: pgmap v300: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:52.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:52 smithi107 ceph-mon[35463]: pgmap v300: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:52.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:52 smithi077 ceph-mon[35095]: pgmap v300: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:54.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:54 smithi062 ceph-mon[30666]: pgmap v301: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:54.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:54 smithi107 ceph-mon[35463]: pgmap v301: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:54.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:54 smithi077 ceph-mon[35095]: pgmap v301: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:56.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:56 smithi062 ceph-mon[30666]: pgmap v302: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:56.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:56 smithi107 ceph-mon[35463]: pgmap v302: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:56.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:56 smithi077 ceph-mon[35095]: pgmap v302: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:08:58.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:08:58 smithi062 ceph-mon[30666]: pgmap v303: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:08:58 smithi107 ceph-mon[35463]: pgmap v303: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:08:58.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:08:58 smithi077 ceph-mon[35095]: pgmap v303: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:00.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:00 smithi062 ceph-mon[30666]: pgmap v304: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:00.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:00 smithi107 ceph-mon[35463]: pgmap v304: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:00.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:00 smithi077 ceph-mon[35095]: pgmap v304: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:02.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:02 smithi062 ceph-mon[30666]: pgmap v305: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:09:02.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:02 smithi107 ceph-mon[35463]: pgmap v305: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:09:02.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:02 smithi077 ceph-mon[35095]: pgmap v305: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:09:04.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:04 smithi062 ceph-mon[30666]: pgmap v306: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:04.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:04 smithi107 ceph-mon[35463]: pgmap v306: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:04.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:04 smithi077 ceph-mon[35095]: pgmap v306: 129 pgs: 129 active+clean; 2.2 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:06.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:06 smithi062 ceph-mon[30666]: pgmap v307: 129 pgs: 129 active+clean; 2.2 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:09:06.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:06 smithi107 ceph-mon[35463]: pgmap v307: 129 pgs: 129 active+clean; 2.2 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:09:06.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:06 smithi077 ceph-mon[35095]: pgmap v307: 129 pgs: 129 active+clean; 2.2 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:09:08.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:08 smithi062 ceph-mon[30666]: pgmap v308: 129 pgs: 129 active+clean; 2.2 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:09:08.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:08 smithi107 ceph-mon[35463]: pgmap v308: 129 pgs: 129 active+clean; 2.2 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:09:08.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:08 smithi077 ceph-mon[35095]: pgmap v308: 129 pgs: 129 active+clean; 2.2 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:09:10.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:10 smithi062 ceph-mon[30666]: pgmap v309: 129 pgs: 129 active+clean; 2.2 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:09:10.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:10 smithi107 ceph-mon[35463]: pgmap v309: 129 pgs: 129 active+clean; 2.2 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:09:10.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:10 smithi077 ceph-mon[35095]: pgmap v309: 129 pgs: 129 active+clean; 2.2 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-12T02:09:11.254 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T02:09:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.421+0000 7f1b03200640 1 -- 172.21.15.62:0/467309190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b04104480 msgr2=0x7f1b041109b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.421+0000 7f1b03200640 1 --2- 172.21.15.62:0/467309190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b04104480 0x7f1b041109b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009cd0 tx=0x7f1afc02a8f0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.421+0000 7f1b03200640 1 -- 172.21.15.62:0/467309190 shutdown_connections 2024-09-12T02:09:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.421+0000 7f1b03200640 1 --2- 172.21.15.62:0/467309190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b04104480 0x7f1b041109b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.421+0000 7f1b03200640 1 --2- 172.21.15.62:0/467309190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b04103ae0 0x7f1b04103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.421+0000 7f1b03200640 1 --2- 172.21.15.62:0/467309190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b04109b80 0x7f1b04109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.421+0000 7f1b03200640 1 -- 172.21.15.62:0/467309190 >> 172.21.15.62:0/467309190 conn(0x7f1b040ff7c0 msgr2=0x7f1b04101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.421+0000 7f1b03200640 1 -- 172.21.15.62:0/467309190 shutdown_connections 2024-09-12T02:09:11.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.421+0000 7f1b03200640 1 -- 172.21.15.62:0/467309190 wait complete. 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.422+0000 7f1b03200640 1 Processor -- start 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.422+0000 7f1b03200640 1 -- start start 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.422+0000 7f1b03200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b04103ae0 0x7f1b0419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.422+0000 7f1b03200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b04104480 0x7f1b0419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.422+0000 7f1b03200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b04109b80 0x7f1b0419eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.422+0000 7f1b03200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04113f30 con 0x7f1b04103ae0 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.422+0000 7f1b03200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04113db0 con 0x7f1b04104480 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.422+0000 7f1b03200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1b041140b0 con 0x7f1b04109b80 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1b01e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b04103ae0 0x7f1b0419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1af9400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b04104480 0x7f1b0419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1b01e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b04103ae0 0x7f1b0419a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51426/0 (socket says 172.21.15.62:51426) 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1b01e00640 1 -- 172.21.15.62:0/4245607536 learned_addr learned my addr 172.21.15.62:0/4245607536 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1b02800640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b04109b80 0x7f1b0419eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1b01e00640 1 -- 172.21.15.62:0/4245607536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b04109b80 msgr2=0x7f1b0419eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1b01e00640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b04109b80 0x7f1b0419eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1b01e00640 1 -- 172.21.15.62:0/4245607536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b04104480 msgr2=0x7f1b0419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1b01e00640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b04104480 0x7f1b0419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1b01e00640 1 -- 172.21.15.62:0/4245607536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0419f3d0 con 0x7f1b04103ae0 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.423+0000 7f1b01e00640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b04103ae0 0x7f1b0419a3e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1af400e9f0 tx=0x7f1af400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.424+0000 7f1afb400640 1 -- 172.21.15.62:0/4245607536 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af400cd80 con 0x7f1b04103ae0 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.424+0000 7f1afb400640 1 -- 172.21.15.62:0/4245607536 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1af4010910 con 0x7f1b04103ae0 2024-09-12T02:09:11.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.424+0000 7f1b03200640 1 -- 172.21.15.62:0/4245607536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0419f6c0 con 0x7f1b04103ae0 2024-09-12T02:09:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.424+0000 7f1afb400640 1 -- 172.21.15.62:0/4245607536 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4018990 con 0x7f1b04103ae0 2024-09-12T02:09:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.424+0000 7f1b03200640 1 -- 172.21.15.62:0/4245607536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b041a6f50 con 0x7f1b04103ae0 2024-09-12T02:09:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.425+0000 7f1b03200640 1 -- 172.21.15.62:0/4245607536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b04103f40 con 0x7f1b04103ae0 2024-09-12T02:09:11.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.427+0000 7f1afb400640 1 -- 172.21.15.62:0/4245607536 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1af4010ac0 con 0x7f1b04103ae0 2024-09-12T02:09:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.428+0000 7f1afb400640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f1ae80a2cf0 0x7f1ae80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:11.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.428+0000 7f1afb400640 1 -- 172.21.15.62:0/4245607536 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9613+0+0 (secure 0 0 0) 0x7f1af40cfb80 con 0x7f1b04103ae0 2024-09-12T02:09:11.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.428+0000 7f1af9400640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f1ae80a2cf0 0x7f1ae80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:11.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.429+0000 7f1af9400640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f1ae80a2cf0 0x7f1ae80a51b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1b04109180 tx=0x7f1aec00b390 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:11.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.432+0000 7f1afb400640 1 -- 172.21.15.62:0/4245607536 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1af409bcb0 con 0x7f1b04103ae0 2024-09-12T02:09:11.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.637+0000 7f1b03200640 1 -- 172.21.15.62:0/4245607536 --> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f1b04062630 con 0x7f1ae80a2cf0 2024-09-12T02:09:11.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.646+0000 7f1afb400640 1 -- 172.21.15.62:0/4245607536 <== mgr.25070 v2:172.21.15.62:6800/2226410445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f1b04062630 con 0x7f1ae80a2cf0 2024-09-12T02:09:11.646 INFO:teuthology.orchestra.run.smithi062.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T01:59:09", "first": "2024-09-12T02:00:00", "last": "2024-09-12T02:09:00", "last_pruned": "2024-09-12T02:09:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-12T02:09:11.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.648+0000 7f1b03200640 1 -- 172.21.15.62:0/4245607536 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f1ae80a2cf0 msgr2=0x7f1ae80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:11.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.648+0000 7f1b03200640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f1ae80a2cf0 0x7f1ae80a51b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1b04109180 tx=0x7f1aec00b390 comp rx=0 tx=0).stop 2024-09-12T02:09:11.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.648+0000 7f1b03200640 1 -- 172.21.15.62:0/4245607536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b04103ae0 msgr2=0x7f1b0419a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:11.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.648+0000 7f1b03200640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b04103ae0 0x7f1b0419a3e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1af400e9f0 tx=0x7f1af400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.648+0000 7f1b03200640 1 -- 172.21.15.62:0/4245607536 shutdown_connections 2024-09-12T02:09:11.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.648+0000 7f1b03200640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f1ae80a2cf0 0x7f1ae80a51b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.648+0000 7f1b03200640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b04109b80 0x7f1b0419eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.648+0000 7f1b03200640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b04104480 0x7f1b0419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.648+0000 7f1b03200640 1 --2- 172.21.15.62:0/4245607536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b04103ae0 0x7f1b0419a3e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.648+0000 7f1b03200640 1 -- 172.21.15.62:0/4245607536 >> 172.21.15.62:0/4245607536 conn(0x7f1b040ff7c0 msgr2=0x7f1b04100f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:11.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.649+0000 7f1b03200640 1 -- 172.21.15.62:0/4245607536 shutdown_connections 2024-09-12T02:09:11.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.649+0000 7f1b03200640 1 -- 172.21.15.62:0/4245607536 wait complete. 2024-09-12T02:09:11.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T02:09:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.823+0000 7f4744c00640 1 -- 172.21.15.62:0/2420077931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f474010e150 msgr2=0x7f4740110560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.823+0000 7f4744c00640 1 --2- 172.21.15.62:0/2420077931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f474010e150 0x7f4740110560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4738009ca0 tx=0x7f473802a950 comp rx=0 tx=0).stop 2024-09-12T02:09:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.823+0000 7f4744c00640 1 -- 172.21.15.62:0/2420077931 shutdown_connections 2024-09-12T02:09:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.823+0000 7f4744c00640 1 --2- 172.21.15.62:0/2420077931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f474010e150 0x7f4740110560 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.823+0000 7f4744c00640 1 --2- 172.21.15.62:0/2420077931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4740074ee0 0x7f474010dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.823+0000 7f4744c00640 1 --2- 172.21.15.62:0/2420077931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47400745c0 0x7f47400749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.823+0000 7f4744c00640 1 -- 172.21.15.62:0/2420077931 >> 172.21.15.62:0/2420077931 conn(0x7f47400fd5d0 msgr2=0x7f47400ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.823+0000 7f4744c00640 1 -- 172.21.15.62:0/2420077931 shutdown_connections 2024-09-12T02:09:11.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.823+0000 7f4744c00640 1 -- 172.21.15.62:0/2420077931 wait complete. 2024-09-12T02:09:11.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.824+0000 7f4744c00640 1 Processor -- start 2024-09-12T02:09:11.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.824+0000 7f4744c00640 1 -- start start 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.824+0000 7f4744c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47400745c0 0x7f474019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.824+0000 7f4744c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4740074ee0 0x7f474019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.824+0000 7f4744c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f474010e150 0x7f474019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.824+0000 7f4744c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4740113ed0 con 0x7f47400745c0 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.824+0000 7f4744c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4740113d50 con 0x7f4740074ee0 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.824+0000 7f4744c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4740114050 con 0x7f474010e150 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f473f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47400745c0 0x7f474019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f473f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47400745c0 0x7f474019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46694/0 (socket says 172.21.15.62:46694) 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f473f400640 1 -- 172.21.15.62:0/1124268736 learned_addr learned my addr 172.21.15.62:0/1124268736 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f473fe00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f474010e150 0x7f474019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f4737e00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4740074ee0 0x7f474019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f473f400640 1 -- 172.21.15.62:0/1124268736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f474010e150 msgr2=0x7f474019ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f473f400640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f474010e150 0x7f474019ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f473f400640 1 -- 172.21.15.62:0/1124268736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4740074ee0 msgr2=0x7f474019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f473f400640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4740074ee0 0x7f474019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f473f400640 1 -- 172.21.15.62:0/1124268736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474019f470 con 0x7f47400745c0 2024-09-12T02:09:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.825+0000 7f473f400640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47400745c0 0x7f474019a480 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f473000ea60 tx=0x7f473000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.826+0000 7f473cc00640 1 -- 172.21.15.62:0/1124268736 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473000cde0 con 0x7f47400745c0 2024-09-12T02:09:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.826+0000 7f473cc00640 1 -- 172.21.15.62:0/1124268736 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47300035f0 con 0x7f47400745c0 2024-09-12T02:09:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.826+0000 7f473cc00640 1 -- 172.21.15.62:0/1124268736 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730010670 con 0x7f47400745c0 2024-09-12T02:09:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.826+0000 7f4744c00640 1 -- 172.21.15.62:0/1124268736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f474019f760 con 0x7f47400745c0 2024-09-12T02:09:11.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.826+0000 7f4744c00640 1 -- 172.21.15.62:0/1124268736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47401a6ff0 con 0x7f47400745c0 2024-09-12T02:09:11.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.827+0000 7f4744c00640 1 -- 172.21.15.62:0/1124268736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47400749a0 con 0x7f47400745c0 2024-09-12T02:09:11.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.829+0000 7f473cc00640 1 -- 172.21.15.62:0/1124268736 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f47300037a0 con 0x7f47400745c0 2024-09-12T02:09:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.831+0000 7f473cc00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f47240a2d70 0x7f47240a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.831+0000 7f473cc00640 1 -- 172.21.15.62:0/1124268736 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9613+0+0 (secure 0 0 0) 0x7f47300cfb60 con 0x7f47400745c0 2024-09-12T02:09:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.831+0000 7f4737e00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f47240a2d70 0x7f47240a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:11.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.832+0000 7f4737e00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f47240a2d70 0x7f47240a5230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f474010f570 tx=0x7f472800b410 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:11.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:11.836+0000 7f473cc00640 1 -- 172.21.15.62:0/1124268736 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f473009c2e0 con 0x7f47400745c0 2024-09-12T02:09:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.043+0000 7f4744c00640 1 -- 172.21.15.62:0/1124268736 --> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f4740062630 con 0x7f47240a2d70 2024-09-12T02:09:12.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.051+0000 7f473cc00640 1 -- 172.21.15.62:0/1124268736 <== mgr.25070 v2:172.21.15.62:6800/2226410445 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f4740062630 con 0x7f47240a2d70 2024-09-12T02:09:12.051 INFO:teuthology.orchestra.run.smithi062.stdout:/ 1m 6m3h 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 -- 172.21.15.62:0/1124268736 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f47240a2d70 msgr2=0x7f47240a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f47240a2d70 0x7f47240a5230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f474010f570 tx=0x7f472800b410 comp rx=0 tx=0).stop 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 -- 172.21.15.62:0/1124268736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47400745c0 msgr2=0x7f474019a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47400745c0 0x7f474019a480 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f473000ea60 tx=0x7f473000ef20 comp rx=0 tx=0).stop 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 -- 172.21.15.62:0/1124268736 shutdown_connections 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f47240a2d70 0x7f47240a5230 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f474010e150 0x7f474019ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4740074ee0 0x7f474019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 --2- 172.21.15.62:0/1124268736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47400745c0 0x7f474019a480 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 -- 172.21.15.62:0/1124268736 >> 172.21.15.62:0/1124268736 conn(0x7f47400fd5d0 msgr2=0x7f47400fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 -- 172.21.15.62:0/1124268736 shutdown_connections 2024-09-12T02:09:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.053+0000 7f4744c00640 1 -- 172.21.15.62:0/1124268736 wait complete. 2024-09-12T02:09:12.072 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T02:09:12.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:09:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.241+0000 7fd785400640 1 -- 172.21.15.62:0/3901925314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd780069380 msgr2=0x7fd7800697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.241+0000 7fd785400640 1 --2- 172.21.15.62:0/3901925314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd780069380 0x7fd7800697c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009900 tx=0x7fd76c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.241+0000 7fd785400640 1 -- 172.21.15.62:0/3901925314 shutdown_connections 2024-09-12T02:09:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.241+0000 7fd785400640 1 --2- 172.21.15.62:0/3901925314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd780069d00 0x7fd78010e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.241+0000 7fd785400640 1 --2- 172.21.15.62:0/3901925314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd780069380 0x7fd7800697c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.241+0000 7fd785400640 1 --2- 172.21.15.62:0/3901925314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7801078f0 0x7fd780107cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.241+0000 7fd785400640 1 -- 172.21.15.62:0/3901925314 >> 172.21.15.62:0/3901925314 conn(0x7fd780076550 msgr2=0x7fd780076960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.241+0000 7fd785400640 1 -- 172.21.15.62:0/3901925314 shutdown_connections 2024-09-12T02:09:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.241+0000 7fd785400640 1 -- 172.21.15.62:0/3901925314 wait complete. 2024-09-12T02:09:12.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.242+0000 7fd785400640 1 Processor -- start 2024-09-12T02:09:12.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.242+0000 7fd785400640 1 -- start start 2024-09-12T02:09:12.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.242+0000 7fd785400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd780069380 0x7fd7801981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:12.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.242+0000 7fd785400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd780069d00 0x7fd7801986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:12.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.242+0000 7fd785400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7801078f0 0x7fd78019ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:12.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.242+0000 7fd785400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd780111c90 con 0x7fd780069d00 2024-09-12T02:09:12.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.242+0000 7fd785400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd780111b10 con 0x7fd780069380 2024-09-12T02:09:12.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.242+0000 7fd785400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd780111e10 con 0x7fd7801078f0 2024-09-12T02:09:12.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd780069d00 0x7fd7801986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd780069380 0x7fd7801981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77f400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd780069d00 0x7fd7801986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46724/0 (socket says 172.21.15.62:46724) 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77f400640 1 -- 172.21.15.62:0/3815410458 learned_addr learned my addr 172.21.15.62:0/3815410458 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd780069380 0x7fd7801981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:41250/0 (socket says 172.21.15.62:41250) 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd784a00640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7801078f0 0x7fd78019ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77fe00640 1 -- 172.21.15.62:0/3815410458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7801078f0 msgr2=0x7fd78019ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77fe00640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7801078f0 0x7fd78019ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77fe00640 1 -- 172.21.15.62:0/3815410458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd780069d00 msgr2=0x7fd7801986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77fe00640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd780069d00 0x7fd7801986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77fe00640 1 -- 172.21.15.62:0/3815410458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78019d190 con 0x7fd780069380 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd784a00640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7801078f0 0x7fd78019ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:09:12.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77f400640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd780069d00 0x7fd7801986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:09:12.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.243+0000 7fd77fe00640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd780069380 0x7fd7801981a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd77000e9f0 tx=0x7fd77000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:12.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.244+0000 7fd77cc00640 1 -- 172.21.15.62:0/3815410458 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77000ccc0 con 0x7fd780069380 2024-09-12T02:09:12.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.244+0000 7fd77cc00640 1 -- 172.21.15.62:0/3815410458 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd770010910 con 0x7fd780069380 2024-09-12T02:09:12.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.244+0000 7fd785400640 1 -- 172.21.15.62:0/3815410458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78019d480 con 0x7fd780069380 2024-09-12T02:09:12.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.244+0000 7fd77cc00640 1 -- 172.21.15.62:0/3815410458 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770018960 con 0x7fd780069380 2024-09-12T02:09:12.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.244+0000 7fd785400640 1 -- 172.21.15.62:0/3815410458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7801a4d10 con 0x7fd780069380 2024-09-12T02:09:12.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.245+0000 7fd785400640 1 -- 172.21.15.62:0/3815410458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7800697c0 con 0x7fd780069380 2024-09-12T02:09:12.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.247+0000 7fd77cc00640 1 -- 172.21.15.62:0/3815410458 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd770010ac0 con 0x7fd780069380 2024-09-12T02:09:12.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.248+0000 7fd77cc00640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd7640a2d00 0x7fd7640a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:12.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.248+0000 7fd77cc00640 1 -- 172.21.15.62:0/3815410458 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9613+0+0 (secure 0 0 0) 0x7fd7700cfc00 con 0x7fd780069380 2024-09-12T02:09:12.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.248+0000 7fd77f400640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd7640a2d00 0x7fd7640a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:12.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.249+0000 7fd77f400640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd7640a2d00 0x7fd7640a51c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd76c005770 tx=0x7fd76c005a20 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:12.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.253+0000 7fd77cc00640 1 -- 172.21.15.62:0/3815410458 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd77009bd30 con 0x7fd780069380 2024-09-12T02:09:12.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:12 smithi062 ceph-mon[30666]: pgmap v310: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:09:12.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:12 smithi062 ceph-mon[30666]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:09:12.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.438+0000 7fd785400640 1 -- 172.21.15.62:0/3815410458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7801098e0 con 0x7fd780069380 2024-09-12T02:09:12.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.441+0000 7fd77cc00640 1 -- 172.21.15.62:0/3815410458 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+25561 (secure 0 0 0) 0x7fd7700a0030 con 0x7fd780069380 2024-09-12T02:09:12.441 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:09:12.441 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":102,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T02:09:11.068152+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1859863767":"2024-09-13T01:59:08.747003+0000","172.21.15.62:6800/1859863767":"2024-09-13T01:59:08.747003+0000","172.21.15.62:0/726819260":"2024-09-13T01:59:08.747003+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/2427919776":"2024-09-13T01:59:08.747003+0000","172.21.15.62:0/706736394":"2024-09-13T01:59:08.747003+0000","172.21.15.62:0/2409675195":"2024-09-13T01:59:08.747003+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:09:12.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.442+0000 7fd785400640 1 -- 172.21.15.62:0/3815410458 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd7640a2d00 msgr2=0x7fd7640a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.442+0000 7fd785400640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd7640a2d00 0x7fd7640a51c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd76c005770 tx=0x7fd76c005a20 comp rx=0 tx=0).stop 2024-09-12T02:09:12.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.442+0000 7fd785400640 1 -- 172.21.15.62:0/3815410458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd780069380 msgr2=0x7fd7801981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.442+0000 7fd785400640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd780069380 0x7fd7801981a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd77000e9f0 tx=0x7fd77000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.442+0000 7fd785400640 1 -- 172.21.15.62:0/3815410458 shutdown_connections 2024-09-12T02:09:12.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.442+0000 7fd785400640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd7640a2d00 0x7fd7640a51c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.442+0000 7fd785400640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7801078f0 0x7fd78019ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.442+0000 7fd785400640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd780069d00 0x7fd7801986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.442+0000 7fd785400640 1 --2- 172.21.15.62:0/3815410458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd780069380 0x7fd7801981a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.442+0000 7fd785400640 1 -- 172.21.15.62:0/3815410458 >> 172.21.15.62:0/3815410458 conn(0x7fd780076550 msgr2=0x7fd7800ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:12.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.443+0000 7fd785400640 1 -- 172.21.15.62:0/3815410458 shutdown_connections 2024-09-12T02:09:12.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.443+0000 7fd785400640 1 -- 172.21.15.62:0/3815410458 wait complete. 2024-09-12T02:09:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:12 smithi107 ceph-mon[35463]: pgmap v310: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:09:12.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:12 smithi107 ceph-mon[35463]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:09:12.459 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:51:44.080754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T01:56:36.684589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T01:56:39.370573+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 102, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T01:56:48.359920+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 102, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T02:09:12.460 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:09:12.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:12 smithi077 ceph-mon[35095]: pgmap v310: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-12T02:09:12.465 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:12 smithi077 ceph-mon[35095]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:09:12.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.621+0000 7f3335c00640 1 -- 172.21.15.62:0/3772417770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3330108f40 msgr2=0x7f3330110a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.621+0000 7f3335c00640 1 --2- 172.21.15.62:0/3772417770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3330108f40 0x7f3330110a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3328009ca0 tx=0x7f332802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.621+0000 7f3335c00640 1 -- 172.21.15.62:0/3772417770 shutdown_connections 2024-09-12T02:09:12.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.621+0000 7f3335c00640 1 --2- 172.21.15.62:0/3772417770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3330108f40 0x7f3330110a90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.621+0000 7f3335c00640 1 --2- 172.21.15.62:0/3772417770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33301047a0 0x7f33301087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.621+0000 7f3335c00640 1 --2- 172.21.15.62:0/3772417770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3330103df0 0x7f33301041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.621+0000 7f3335c00640 1 -- 172.21.15.62:0/3772417770 >> 172.21.15.62:0/3772417770 conn(0x7f33300ff840 msgr2=0x7f3330101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:12.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.621+0000 7f3335c00640 1 -- 172.21.15.62:0/3772417770 shutdown_connections 2024-09-12T02:09:12.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.622+0000 7f3335c00640 1 -- 172.21.15.62:0/3772417770 wait complete. 2024-09-12T02:09:12.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.622+0000 7f3335c00640 1 Processor -- start 2024-09-12T02:09:12.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f3335c00640 1 -- start start 2024-09-12T02:09:12.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f3335c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3330103df0 0x7f333019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:12.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f3335c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3330108f40 0x7f333019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:12.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f3335c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f333019ed10 0x7f333019f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:12.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f3335c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3330113fa0 con 0x7f3330103df0 2024-09-12T02:09:12.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f3335c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3330113e20 con 0x7f333019ed10 2024-09-12T02:09:12.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f3335c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3330114120 con 0x7f3330108f40 2024-09-12T02:09:12.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f332fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3330103df0 0x7f333019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:12.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f332fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3330103df0 0x7f333019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46732/0 (socket says 172.21.15.62:46732) 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f332fe00640 1 -- 172.21.15.62:0/3996564319 learned_addr learned my addr 172.21.15.62:0/3996564319 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f3335200640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f333019ed10 0x7f333019f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f332f400640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3330108f40 0x7f333019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f332fe00640 1 -- 172.21.15.62:0/3996564319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3330108f40 msgr2=0x7f333019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f332fe00640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3330108f40 0x7f333019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f332fe00640 1 -- 172.21.15.62:0/3996564319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f333019ed10 msgr2=0x7f333019f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f332fe00640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f333019ed10 0x7f333019f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f332fe00640 1 -- 172.21.15.62:0/3996564319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333019f800 con 0x7f3330103df0 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.623+0000 7f3335200640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f333019ed10 0x7f333019f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.624+0000 7f332f400640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3330108f40 0x7f333019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.624+0000 7f332fe00640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3330103df0 0x7f333019a450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f332000ea60 tx=0x7f332000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:12.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.624+0000 7f332cc00640 1 -- 172.21.15.62:0/3996564319 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332000cde0 con 0x7f3330103df0 2024-09-12T02:09:12.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.624+0000 7f332cc00640 1 -- 172.21.15.62:0/3996564319 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33200035f0 con 0x7f3330103df0 2024-09-12T02:09:12.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.624+0000 7f332cc00640 1 -- 172.21.15.62:0/3996564319 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320010670 con 0x7f3330103df0 2024-09-12T02:09:12.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.624+0000 7f3335c00640 1 -- 172.21.15.62:0/3996564319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333019faf0 con 0x7f3330103df0 2024-09-12T02:09:12.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.624+0000 7f3335c00640 1 -- 172.21.15.62:0/3996564319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33301a7260 con 0x7f3330103df0 2024-09-12T02:09:12.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.625+0000 7f3335c00640 1 -- 172.21.15.62:0/3996564319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33301041d0 con 0x7f3330103df0 2024-09-12T02:09:12.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.627+0000 7f332cc00640 1 -- 172.21.15.62:0/3996564319 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f33200037a0 con 0x7f3330103df0 2024-09-12T02:09:12.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.628+0000 7f332cc00640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f33140a2d80 0x7f33140a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:12.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.629+0000 7f332cc00640 1 -- 172.21.15.62:0/3996564319 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9613+0+0 (secure 0 0 0) 0x7f33200cfcc0 con 0x7f3330103df0 2024-09-12T02:09:12.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.629+0000 7f332f400640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f33140a2d80 0x7f33140a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:12.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.629+0000 7f332f400640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f33140a2d80 0x7f33140a5240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3330100130 tx=0x7f331c005f90 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:12.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.632+0000 7f332cc00640 1 -- 172.21.15.62:0/3996564319 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33200d6080 con 0x7f3330103df0 2024-09-12T02:09:12.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.816+0000 7f3335c00640 1 -- 172.21.15.62:0/3996564319 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f33301047a0 con 0x7f3330103df0 2024-09-12T02:09:12.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.817+0000 7f332cc00640 1 -- 172.21.15.62:0/3996564319 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) ==== 93+0+10 (secure 0 0 0) 0x7f332009c440 con 0x7f3330103df0 2024-09-12T02:09:12.818 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 -- 172.21.15.62:0/3996564319 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f33140a2d80 msgr2=0x7f33140a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f33140a2d80 0x7f33140a5240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3330100130 tx=0x7f331c005f90 comp rx=0 tx=0).stop 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 -- 172.21.15.62:0/3996564319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3330103df0 msgr2=0x7f333019a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3330103df0 0x7f333019a450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f332000ea60 tx=0x7f332000ef20 comp rx=0 tx=0).stop 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 -- 172.21.15.62:0/3996564319 shutdown_connections 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f33140a2d80 0x7f33140a5240 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f333019ed10 0x7f333019f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3330108f40 0x7f333019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 --2- 172.21.15.62:0/3996564319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3330103df0 0x7f333019a450 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 -- 172.21.15.62:0/3996564319 >> 172.21.15.62:0/3996564319 conn(0x7f33300ff840 msgr2=0x7f3330100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 -- 172.21.15.62:0/3996564319 shutdown_connections 2024-09-12T02:09:12.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:12.819+0000 7f3335c00640 1 -- 172.21.15.62:0/3996564319 wait complete. 2024-09-12T02:09:12.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:09:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.000+0000 7f0d82a00640 1 -- 172.21.15.62:0/3294070264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d7c077040 msgr2=0x7f0d7c112400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.000+0000 7f0d82a00640 1 --2- 172.21.15.62:0/3294070264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d7c077040 0x7f0d7c112400 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009900 tx=0x7f0d6402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.000+0000 7f0d82a00640 1 -- 172.21.15.62:0/3294070264 shutdown_connections 2024-09-12T02:09:13.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.000+0000 7f0d82a00640 1 --2- 172.21.15.62:0/3294070264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d7c112940 0x7f0d7c114d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.000+0000 7f0d82a00640 1 --2- 172.21.15.62:0/3294070264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d7c077040 0x7f0d7c112400 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.000+0000 7f0d82a00640 1 --2- 172.21.15.62:0/3294070264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d7c076720 0x7f0d7c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.000+0000 7f0d82a00640 1 -- 172.21.15.62:0/3294070264 >> 172.21.15.62:0/3294070264 conn(0x7f0d7c0ff940 msgr2=0x7f0d7c101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.000+0000 7f0d82a00640 1 -- 172.21.15.62:0/3294070264 shutdown_connections 2024-09-12T02:09:13.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.000+0000 7f0d82a00640 1 -- 172.21.15.62:0/3294070264 wait complete. 2024-09-12T02:09:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.001+0000 7f0d82a00640 1 Processor -- start 2024-09-12T02:09:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.001+0000 7f0d82a00640 1 -- start start 2024-09-12T02:09:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d7c076720 0x7f0d7c1a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d7c077040 0x7f0d7c1a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d7c112940 0x7f0d7c19e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d82a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c118500 con 0x7f0d7c076720 2024-09-12T02:09:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d82a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c118380 con 0x7f0d7c112940 2024-09-12T02:09:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d82a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c118680 con 0x7f0d7c077040 2024-09-12T02:09:13.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d7be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d7c076720 0x7f0d7c1a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d7be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d7c076720 0x7f0d7c1a47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46754/0 (socket says 172.21.15.62:46754) 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d7be00640 1 -- 172.21.15.62:0/2352641992 learned_addr learned my addr 172.21.15.62:0/2352641992 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d80a00640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d7c112940 0x7f0d7c19e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d73400640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d7c077040 0x7f0d7c1a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d7be00640 1 -- 172.21.15.62:0/2352641992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d7c077040 msgr2=0x7f0d7c1a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.002+0000 7f0d7be00640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d7c077040 0x7f0d7c1a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.003+0000 7f0d7be00640 1 -- 172.21.15.62:0/2352641992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d7c112940 msgr2=0x7f0d7c19e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.003+0000 7f0d7be00640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d7c112940 0x7f0d7c19e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.003+0000 7f0d7be00640 1 -- 172.21.15.62:0/2352641992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c19f110 con 0x7f0d7c076720 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.003+0000 7f0d7be00640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d7c076720 0x7f0d7c1a47e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00e9f0 tx=0x7f0d6c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.003+0000 7f0d79600640 1 -- 172.21.15.62:0/2352641992 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00cd80 con 0x7f0d7c076720 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.003+0000 7f0d82a00640 1 -- 172.21.15.62:0/2352641992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c19f400 con 0x7f0d7c076720 2024-09-12T02:09:13.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.003+0000 7f0d79600640 1 -- 172.21.15.62:0/2352641992 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d6c005500 con 0x7f0d7c076720 2024-09-12T02:09:13.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.003+0000 7f0d79600640 1 -- 172.21.15.62:0/2352641992 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c010690 con 0x7f0d7c076720 2024-09-12T02:09:13.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.003+0000 7f0d82a00640 1 -- 172.21.15.62:0/2352641992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c1ab6a0 con 0x7f0d7c076720 2024-09-12T02:09:13.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.004+0000 7f0d82a00640 1 -- 172.21.15.62:0/2352641992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d7c077e60 con 0x7f0d7c076720 2024-09-12T02:09:13.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.006+0000 7f0d79600640 1 -- 172.21.15.62:0/2352641992 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0d6c0046c0 con 0x7f0d7c076720 2024-09-12T02:09:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.007+0000 7f0d79600640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f0d600a2d00 0x7f0d600a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.008+0000 7f0d79600640 1 -- 172.21.15.62:0/2352641992 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9613+0+0 (secure 0 0 0) 0x7f0d6c0cff10 con 0x7f0d7c076720 2024-09-12T02:09:13.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.008+0000 7f0d73400640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f0d600a2d00 0x7f0d600a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.009+0000 7f0d73400640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f0d600a2d00 0x7f0d600a51c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d64000c00 tx=0x7f0d64005b50 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:13.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.010+0000 7f0d79600640 1 -- 172.21.15.62:0/2352641992 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d6c0541b0 con 0x7f0d7c076720 2024-09-12T02:09:13.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:13 smithi062 ceph-mon[30666]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:13.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:13 smithi062 ceph-mon[30666]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:13.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:13 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3815410458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:13.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:13 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3996564319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:09:13.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.197+0000 7f0d82a00640 1 -- 172.21.15.62:0/2352641992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0d7c10dad0 con 0x7f0d7c076720 2024-09-12T02:09:13.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.197+0000 7f0d79600640 1 -- 172.21.15.62:0/2352641992 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) ==== 104+0+11 (secure 0 0 0) 0x7f0d6c09c690 con 0x7f0d7c076720 2024-09-12T02:09:13.198 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2024-09-12T02:09:13.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 -- 172.21.15.62:0/2352641992 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f0d600a2d00 msgr2=0x7f0d600a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f0d600a2d00 0x7f0d600a51c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d64000c00 tx=0x7f0d64005b50 comp rx=0 tx=0).stop 2024-09-12T02:09:13.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 -- 172.21.15.62:0/2352641992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d7c076720 msgr2=0x7f0d7c1a47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d7c076720 0x7f0d7c1a47e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00e9f0 tx=0x7f0d6c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 -- 172.21.15.62:0/2352641992 shutdown_connections 2024-09-12T02:09:13.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f0d600a2d00 0x7f0d600a51c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d7c112940 0x7f0d7c19e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0d7c077040 0x7f0d7c1a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 --2- 172.21.15.62:0/2352641992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d7c076720 0x7f0d7c1a47e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 -- 172.21.15.62:0/2352641992 >> 172.21.15.62:0/2352641992 conn(0x7f0d7c0ff940 msgr2=0x7f0d7c113fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:13.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 -- 172.21.15.62:0/2352641992 shutdown_connections 2024-09-12T02:09:13.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.199+0000 7f0d82a00640 1 -- 172.21.15.62:0/2352641992 wait complete. 2024-09-12T02:09:13.216 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:09:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.376+0000 7ff73f200640 1 -- 172.21.15.62:0/2130077894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740108f40 msgr2=0x7ff740110a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.376+0000 7ff73f200640 1 --2- 172.21.15.62:0/2130077894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740108f40 0x7ff740110a90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff738009ca0 tx=0x7ff73802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.377+0000 7ff73f200640 1 -- 172.21.15.62:0/2130077894 shutdown_connections 2024-09-12T02:09:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.377+0000 7ff73f200640 1 --2- 172.21.15.62:0/2130077894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740108f40 0x7ff740110a90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.377+0000 7ff73f200640 1 --2- 172.21.15.62:0/2130077894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7401047a0 0x7ff7401087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.377+0000 7ff73f200640 1 --2- 172.21.15.62:0/2130077894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff740103df0 0x7ff7401041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.377+0000 7ff73f200640 1 -- 172.21.15.62:0/2130077894 >> 172.21.15.62:0/2130077894 conn(0x7ff7400ff840 msgr2=0x7ff740101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.377+0000 7ff73f200640 1 -- 172.21.15.62:0/2130077894 shutdown_connections 2024-09-12T02:09:13.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.377+0000 7ff73f200640 1 -- 172.21.15.62:0/2130077894 wait complete. 2024-09-12T02:09:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73f200640 1 Processor -- start 2024-09-12T02:09:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73f200640 1 -- start start 2024-09-12T02:09:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73f200640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff740103df0 0x7ff74019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73f200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740108f40 0x7ff74019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74019ede0 0x7ff74019f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73f200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff740113ff0 con 0x7ff740108f40 2024-09-12T02:09:13.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff740113e70 con 0x7ff74019ede0 2024-09-12T02:09:13.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73f200640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff740114170 con 0x7ff740103df0 2024-09-12T02:09:13.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff740103df0 0x7ff74019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74019ede0 0x7ff74019f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73de00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff740103df0 0x7ff74019a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:54520/0 (socket says 172.21.15.62:54520) 2024-09-12T02:09:13.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73de00640 1 -- 172.21.15.62:0/4048387190 learned_addr learned my addr 172.21.15.62:0/4048387190 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:13.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.378+0000 7ff73d400640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740108f40 0x7ff74019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.379+0000 7ff73de00640 1 -- 172.21.15.62:0/4048387190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74019ede0 msgr2=0x7ff74019f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.379+0000 7ff73de00640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74019ede0 0x7ff74019f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.379+0000 7ff73de00640 1 -- 172.21.15.62:0/4048387190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740108f40 msgr2=0x7ff74019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.379+0000 7ff73de00640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740108f40 0x7ff74019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.379+0000 7ff73de00640 1 -- 172.21.15.62:0/4048387190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74019f8d0 con 0x7ff740103df0 2024-09-12T02:09:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.379+0000 7ff73de00640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff740103df0 0x7ff74019a520 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff73000d950 tx=0x7ff73000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.379+0000 7ff736a00640 1 -- 172.21.15.62:0/4048387190 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730017030 con 0x7ff740103df0 2024-09-12T02:09:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.379+0000 7ff736a00640 1 -- 172.21.15.62:0/4048387190 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff730004020 con 0x7ff740103df0 2024-09-12T02:09:13.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.379+0000 7ff73f200640 1 -- 172.21.15.62:0/4048387190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74019fbc0 con 0x7ff740103df0 2024-09-12T02:09:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.379+0000 7ff736a00640 1 -- 172.21.15.62:0/4048387190 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7300047a0 con 0x7ff740103df0 2024-09-12T02:09:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.380+0000 7ff73f200640 1 -- 172.21.15.62:0/4048387190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7401a73b0 con 0x7ff740103df0 2024-09-12T02:09:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.380+0000 7ff73f200640 1 -- 172.21.15.62:0/4048387190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7401041d0 con 0x7ff740103df0 2024-09-12T02:09:13.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.383+0000 7ff736a00640 1 -- 172.21.15.62:0/4048387190 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff7300041d0 con 0x7ff740103df0 2024-09-12T02:09:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.384+0000 7ff736a00640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7ff7240a2d00 0x7ff7240a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.384+0000 7ff736a00640 1 -- 172.21.15.62:0/4048387190 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9613+0+0 (secure 0 0 0) 0x7ff7300cf460 con 0x7ff740103df0 2024-09-12T02:09:13.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.384+0000 7ff73d400640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7ff7240a2d00 0x7ff7240a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.385+0000 7ff73d400640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7ff7240a2d00 0x7ff7240a51c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff7400fffe0 tx=0x7ff72c00b390 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:13.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.386+0000 7ff736a00640 1 -- 172.21.15.62:0/4048387190 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff73009bbe0 con 0x7ff740103df0 2024-09-12T02:09:13.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:13 smithi107 ceph-mon[35463]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:13.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:13 smithi107 ceph-mon[35463]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:13.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:13 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3815410458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:13.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:13 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3996564319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:09:13.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:13 smithi077 ceph-mon[35095]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:13.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:13 smithi077 ceph-mon[35095]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:13.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:13 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3815410458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:13.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:13 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3996564319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:09:13.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.571+0000 7ff73f200640 1 -- 172.21.15.62:0/4048387190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff7401047a0 con 0x7ff740103df0 2024-09-12T02:09:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.572+0000 7ff736a00640 1 -- 172.21.15.62:0/4048387190 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) ==== 100+0+11 (secure 0 0 0) 0x7ff73009b4e0 con 0x7ff740103df0 2024-09-12T02:09:13.572 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2024-09-12T02:09:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.574+0000 7ff73f200640 1 -- 172.21.15.62:0/4048387190 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7ff7240a2d00 msgr2=0x7ff7240a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.574+0000 7ff73f200640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7ff7240a2d00 0x7ff7240a51c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff7400fffe0 tx=0x7ff72c00b390 comp rx=0 tx=0).stop 2024-09-12T02:09:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.574+0000 7ff73f200640 1 -- 172.21.15.62:0/4048387190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff740103df0 msgr2=0x7ff74019a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.574+0000 7ff73f200640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff740103df0 0x7ff74019a520 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff73000d950 tx=0x7ff73000de10 comp rx=0 tx=0).stop 2024-09-12T02:09:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.574+0000 7ff73f200640 1 -- 172.21.15.62:0/4048387190 shutdown_connections 2024-09-12T02:09:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.574+0000 7ff73f200640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7ff7240a2d00 0x7ff7240a51c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.574+0000 7ff73f200640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74019ede0 0x7ff74019f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.574+0000 7ff73f200640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff740108f40 0x7ff74019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.574+0000 7ff73f200640 1 --2- 172.21.15.62:0/4048387190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff740103df0 0x7ff74019a520 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.574+0000 7ff73f200640 1 -- 172.21.15.62:0/4048387190 >> 172.21.15.62:0/4048387190 conn(0x7ff7400ff840 msgr2=0x7ff740101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:13.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.575+0000 7ff73f200640 1 -- 172.21.15.62:0/4048387190 shutdown_connections 2024-09-12T02:09:13.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.575+0000 7ff73f200640 1 -- 172.21.15.62:0/4048387190 wait complete. 2024-09-12T02:09:13.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T02:09:13.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.751+0000 7f3853e00640 1 -- 172.21.15.62:0/4102038781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f384c0745c0 msgr2=0x7f384c0749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.751+0000 7f3853e00640 1 --2- 172.21.15.62:0/4102038781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f384c0745c0 0x7f384c0749a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3840009900 tx=0x7f384002a480 comp rx=0 tx=0).stop 2024-09-12T02:09:13.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.752+0000 7f3853e00640 1 -- 172.21.15.62:0/4102038781 shutdown_connections 2024-09-12T02:09:13.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.752+0000 7f3853e00640 1 --2- 172.21.15.62:0/4102038781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f384c10e320 0x7f384c110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.752+0000 7f3853e00640 1 --2- 172.21.15.62:0/4102038781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f384c074ee0 0x7f384c10dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.752+0000 7f3853e00640 1 --2- 172.21.15.62:0/4102038781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f384c0745c0 0x7f384c0749a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.752+0000 7f3853e00640 1 -- 172.21.15.62:0/4102038781 >> 172.21.15.62:0/4102038781 conn(0x7f384c0fd7c0 msgr2=0x7f384c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:13.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.752+0000 7f3853e00640 1 -- 172.21.15.62:0/4102038781 shutdown_connections 2024-09-12T02:09:13.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.752+0000 7f3853e00640 1 -- 172.21.15.62:0/4102038781 wait complete. 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3853e00640 1 Processor -- start 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3853e00640 1 -- start start 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3853e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f384c0745c0 0x7f384c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3853e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f384c074ee0 0x7f384c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3853e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f384c10e320 0x7f384c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3853e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f384c1140b0 con 0x7f384c0745c0 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3853e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f384c113f30 con 0x7f384c074ee0 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3853e00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f384c114230 con 0x7f384c10e320 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3851400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f384c0745c0 0x7f384c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3851400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f384c0745c0 0x7f384c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46806/0 (socket says 172.21.15.62:46806) 2024-09-12T02:09:13.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.753+0000 7f3851400640 1 -- 172.21.15.62:0/3092261599 learned_addr learned my addr 172.21.15.62:0/3092261599 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f3851e00640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f384c10e320 0x7f384c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f3850a00640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f384c074ee0 0x7f384c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f3851400640 1 -- 172.21.15.62:0/3092261599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f384c10e320 msgr2=0x7f384c19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f3851400640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f384c10e320 0x7f384c19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f3851400640 1 -- 172.21.15.62:0/3092261599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f384c074ee0 msgr2=0x7f384c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f3851400640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f384c074ee0 0x7f384c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f3851400640 1 -- 172.21.15.62:0/3092261599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384c19f6e0 con 0x7f384c0745c0 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f3851400640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f384c0745c0 0x7f384c19a6f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3840006010 tx=0x7f3840004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f384a000640 1 -- 172.21.15.62:0/3092261599 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384003f030 con 0x7f384c0745c0 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f3853e00640 1 -- 172.21.15.62:0/3092261599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384c19f970 con 0x7f384c0745c0 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.754+0000 7f384a000640 1 -- 172.21.15.62:0/3092261599 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3840004440 con 0x7f384c0745c0 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.755+0000 7f3853e00640 1 -- 172.21.15.62:0/3092261599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f384c1a7260 con 0x7f384c0745c0 2024-09-12T02:09:13.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.755+0000 7f384a000640 1 -- 172.21.15.62:0/3092261599 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840049060 con 0x7f384c0745c0 2024-09-12T02:09:13.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.755+0000 7f3853e00640 1 -- 172.21.15.62:0/3092261599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f384c0749a0 con 0x7f384c0745c0 2024-09-12T02:09:13.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.757+0000 7f384a000640 1 -- 172.21.15.62:0/3092261599 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3840042030 con 0x7f384c0745c0 2024-09-12T02:09:13.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.759+0000 7f384a000640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f38340a2d00 0x7f38340a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:13.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.759+0000 7f384a000640 1 -- 172.21.15.62:0/3092261599 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9613+0+0 (secure 0 0 0) 0x7f38400effc0 con 0x7f384c0745c0 2024-09-12T02:09:13.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.759+0000 7f3850a00640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f38340a2d00 0x7f38340a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:13.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.760+0000 7f3850a00640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f38340a2d00 0x7f38340a51c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f384c0ffe50 tx=0x7f3838005f90 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:13.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.763+0000 7f384a000640 1 -- 172.21.15.62:0/3092261599 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38400bc0f0 con 0x7f384c0745c0 2024-09-12T02:09:13.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.953+0000 7f3853e00640 1 -- 172.21.15.62:0/3092261599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f384c1094a0 con 0x7f384c0745c0 2024-09-12T02:09:13.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.954+0000 7f384a000640 1 -- 172.21.15.62:0/3092261599 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v102) ==== 103+0+11 (secure 0 0 0) 0x7f38400c03f0 con 0x7f384c0745c0 2024-09-12T02:09:13.954 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2024-09-12T02:09:13.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 -- 172.21.15.62:0/3092261599 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f38340a2d00 msgr2=0x7f38340a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f38340a2d00 0x7f38340a51c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f384c0ffe50 tx=0x7f3838005f90 comp rx=0 tx=0).stop 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 -- 172.21.15.62:0/3092261599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f384c0745c0 msgr2=0x7f384c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f384c0745c0 0x7f384c19a6f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3840006010 tx=0x7f3840004040 comp rx=0 tx=0).stop 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 -- 172.21.15.62:0/3092261599 shutdown_connections 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f38340a2d00 0x7f38340a51c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f384c10e320 0x7f384c19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f384c074ee0 0x7f384c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 --2- 172.21.15.62:0/3092261599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f384c0745c0 0x7f384c19a6f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 -- 172.21.15.62:0/3092261599 >> 172.21.15.62:0/3092261599 conn(0x7f384c0fd7c0 msgr2=0x7f384c0feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 -- 172.21.15.62:0/3092261599 shutdown_connections 2024-09-12T02:09:13.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:13.956+0000 7f3853e00640 1 -- 172.21.15.62:0/3092261599 wait complete. 2024-09-12T02:09:13.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T02:09:14.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.131+0000 7f25ed000640 1 -- 172.21.15.62:0/4284919154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25e8109b70 msgr2=0x7f25e8109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:14.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.131+0000 7f25ed000640 1 --2- 172.21.15.62:0/4284919154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25e8109b70 0x7f25e8109f50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009930 tx=0x7f25d802a420 comp rx=0 tx=0).stop 2024-09-12T02:09:14.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.131+0000 7f25ed000640 1 -- 172.21.15.62:0/4284919154 shutdown_connections 2024-09-12T02:09:14.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.131+0000 7f25ed000640 1 --2- 172.21.15.62:0/4284919154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25e8104470 0x7f25e81109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:14.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.131+0000 7f25ed000640 1 --2- 172.21.15.62:0/4284919154 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25e8103ad0 0x7f25e8103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:14.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.131+0000 7f25ed000640 1 --2- 172.21.15.62:0/4284919154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25e8109b70 0x7f25e8109f50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:14.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.131+0000 7f25ed000640 1 -- 172.21.15.62:0/4284919154 >> 172.21.15.62:0/4284919154 conn(0x7f25e80ff7d0 msgr2=0x7f25e8101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:14.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.131+0000 7f25ed000640 1 -- 172.21.15.62:0/4284919154 shutdown_connections 2024-09-12T02:09:14.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.131+0000 7f25ed000640 1 -- 172.21.15.62:0/4284919154 wait complete. 2024-09-12T02:09:14.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.132+0000 7f25ed000640 1 Processor -- start 2024-09-12T02:09:14.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.132+0000 7f25ed000640 1 -- start start 2024-09-12T02:09:14.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.132+0000 7f25ed000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25e8103ad0 0x7f25e819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.132+0000 7f25ed000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25e8104470 0x7f25e819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.132+0000 7f25ed000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25e8109b70 0x7f25e819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.132+0000 7f25ed000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f25e8113f70 con 0x7f25e8109b70 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.132+0000 7f25ed000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f25e8113df0 con 0x7f25e8103ad0 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.132+0000 7f25ed000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f25e81140f0 con 0x7f25e8104470 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25e8103ad0 0x7f25e819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25e8103ad0 0x7f25e819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:41334/0 (socket says 172.21.15.62:41334) 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7400640 1 -- 172.21.15.62:0/4065179295 learned_addr learned my addr 172.21.15.62:0/4065179295 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25e8109b70 0x7f25e819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25dfe00640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25e8104470 0x7f25e819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7400640 1 -- 172.21.15.62:0/4065179295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25e8104470 msgr2=0x7f25e819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7400640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25e8104470 0x7f25e819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:14.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7400640 1 -- 172.21.15.62:0/4065179295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25e8109b70 msgr2=0x7f25e819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7400640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25e8109b70 0x7f25e819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7400640 1 -- 172.21.15.62:0/4065179295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e819f450 con 0x7f25e8103ad0 2024-09-12T02:09:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25dfe00640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25e8104470 0x7f25e819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:09:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7e00640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25e8109b70 0x7f25e819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:09:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.133+0000 7f25e7400640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25e8103ad0 0x7f25e819a460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f25d802a940 tx=0x7f25d8003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.134+0000 7f25e4c00640 1 -- 172.21.15.62:0/4065179295 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d803f070 con 0x7f25e8103ad0 2024-09-12T02:09:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.134+0000 7f25e4c00640 1 -- 172.21.15.62:0/4065179295 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25d8031c90 con 0x7f25e8103ad0 2024-09-12T02:09:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.134+0000 7f25e4c00640 1 -- 172.21.15.62:0/4065179295 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d8035030 con 0x7f25e8103ad0 2024-09-12T02:09:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.134+0000 7f25ed000640 1 -- 172.21.15.62:0/4065179295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e819f6e0 con 0x7f25e8103ad0 2024-09-12T02:09:14.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.134+0000 7f25ed000640 1 -- 172.21.15.62:0/4065179295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e81a6fd0 con 0x7f25e8103ad0 2024-09-12T02:09:14.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.135+0000 7f25ed000640 1 -- 172.21.15.62:0/4065179295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e8103f30 con 0x7f25e8103ad0 2024-09-12T02:09:14.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.136+0000 7f25e4c00640 1 -- 172.21.15.62:0/4065179295 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f25d8042070 con 0x7f25e8103ad0 2024-09-12T02:09:14.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.138+0000 7f25e4c00640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f25cc0a2d80 0x7f25cc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:14.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.138+0000 7f25e4c00640 1 -- 172.21.15.62:0/4065179295 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9613+0+0 (secure 0 0 0) 0x7f25d80eff00 con 0x7f25e8103ad0 2024-09-12T02:09:14.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.138+0000 7f25dfe00640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f25cc0a2d80 0x7f25cc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:14.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.139+0000 7f25dfe00640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f25cc0a2d80 0x7f25cc0a5240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f25e8101e40 tx=0x7f25d0005f90 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:14.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.142+0000 7f25e4c00640 1 -- 172.21.15.62:0/4065179295 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25d80bc030 con 0x7f25e8103ad0 2024-09-12T02:09:14.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:14 smithi062 ceph-mon[30666]: pgmap v312: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:09:14.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:14 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2352641992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:09:14.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:14 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4048387190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:09:14.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:14 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3092261599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T02:09:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.374+0000 7f25ed000640 1 -- 172.21.15.62:0/4065179295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f25e810c040 con 0x7f25e8103ad0 2024-09-12T02:09:14.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.383+0000 7f25e4c00640 1 -- 172.21.15.62:0/4065179295 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+740899 (secure 0 0 0) 0x7f25d80c0330 con 0x7f25e8103ad0 2024-09-12T02:09:14.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:09:14.394 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T02:09:14.394 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 26, 2024-09-12T02:09:14.394 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.394 INFO:teuthology.orchestra.run.smithi062.stdout: "active_gid": 25070, 2024-09-12T02:09:14.394 INFO:teuthology.orchestra.run.smithi062.stdout: "active_name": "x", 2024-09-12T02:09:14.394 INFO:teuthology.orchestra.run.smithi062.stdout: "active_addrs": { 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6800", 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2226410445 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:6801", 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2226410445 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.395 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: "active_addr": "172.21.15.62:6801/2226410445", 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: "active_change": "2024-09-12T01:59:08.747262+0000", 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: "available": true, 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: "standbys": [ 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: "gid": 25067, 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "y", 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:09:14.396 INFO:teuthology.orchestra.run.smithi062.stdout: "available_modules": [ 2024-09-12T02:09:14.397 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.397 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "alerts", 2024-09-12T02:09:14.397 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.397 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.397 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.397 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:14.397 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:14.397 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.397 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.398 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.399 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.400 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.401 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.402 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.403 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_destination": { 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_destination", 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.404 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_from_name": { 2024-09-12T02:09:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_from_name", 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "Ceph", 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Email From: name", 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_host": { 2024-09-12T02:09:14.406 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_host", 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SMTP server", 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_password": { 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_password", 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Password to authenticate with", 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.408 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_port": { 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_port", 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "465", 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SMTP port", 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.409 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_sender": { 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_sender", 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:09:14.410 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_ssl": { 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_ssl", 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.411 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_user": { 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_user", 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.412 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "User to authenticate as", 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "balancer", 2024-09-12T02:09:14.413 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "active": { 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "active", 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.414 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "begin_time": { 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "begin_time", 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0000", 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.415 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "begin_weekday": { 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "begin_weekday", 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.416 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "0", 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "6", 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_compat_max_iterations": { 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "25", 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "250", 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_compat_metrics": { 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crush_compat_metrics", 2024-09-12T02:09:14.418 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_compat_step": { 2024-09-12T02:09:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crush_compat_step", 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0.5", 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "0.001", 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "0.999", 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.420 INFO:teuthology.orchestra.run.smithi062.stdout: "end_time": { 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "end_time", 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "2359", 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.421 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "end_weekday": { 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "end_weekday", 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "0", 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "6", 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:14.422 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.423 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.424 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.425 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.426 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.427 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "min_score": { 2024-09-12T02:09:14.428 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "min_score", 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.429 INFO:teuthology.orchestra.run.smithi062.stdout: "mode": { 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mode", 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "upmap", 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-compat", 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "none", 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "read", 2024-09-12T02:09:14.430 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap", 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap-read" 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Balancer mode", 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_ids": { 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pool_ids", 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.431 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:14.432 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.433 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.433 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.433 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:14.433 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.433 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.433 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.436 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap_max_deviation": { 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "upmap_max_deviation", 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.437 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap_max_optimizations": { 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.438 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephadm", 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.439 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "agent_down_multiplier": { 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "agent_down_multiplier", 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "3.0", 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.440 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "agent_refresh_rate": { 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "agent_refresh_rate", 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "20", 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:09:14.441 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: "agent_starting_port": { 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "agent_starting_port", 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "4721", 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.442 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_ptrace": { 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "allow_ptrace", 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.443 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "autotune_interval": { 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "autotune_interval", 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.444 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:09:14.445 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0.7", 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.446 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm_log_destination": { 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephadm_log_destination", 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "file", 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "file,syslog", 2024-09-12T02:09:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: "syslog" 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: "cgroups_split": { 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cgroups_split", 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.448 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "config_checks_enabled": { 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "config_checks_enabled", 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.449 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "config_dashboard": { 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "config_dashboard", 2024-09-12T02:09:14.450 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_alertmanager": { 2024-09-12T02:09:14.451 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_alertmanager", 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.452 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_base": { 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_base", 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_elasticsearch": { 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "elasticsearch container image", 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.454 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_grafana": { 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_grafana", 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.455 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_haproxy": { 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_haproxy", 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.456 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "HAproxy container image", 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_jaeger_agent": { 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.457 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_jaeger_collector": { 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:09:14.458 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_jaeger_query": { 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.459 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Jaeger query container image", 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_keepalived": { 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_keepalived", 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.460 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Keepalived container image", 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_loki": { 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_loki", 2024-09-12T02:09:14.461 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Loki container image", 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_node_exporter": { 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_node_exporter", 2024-09-12T02:09:14.462 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.463 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_nvmeof": { 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_nvmeof", 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Nvme-of container image", 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.464 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_prometheus": { 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_prometheus", 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:14.465 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_promtail": { 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_promtail", 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.466 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Promtail container image", 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_samba": { 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_samba", 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.467 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_snmp_gateway": { 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:09:14.468 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "container_init": { 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_init", 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.469 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "daemon_cache_timeout": { 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:09:14.470 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.471 INFO:teuthology.orchestra.run.smithi062.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "900", 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.472 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "default_registry": { 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "default_registry", 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io", 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:09:14.473 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "device_cache_timeout": { 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_cache_timeout", 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "1800", 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.474 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "device_enhanced_scan": { 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_enhanced_scan", 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.475 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "facts_cache_timeout": { 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "facts_cache_timeout", 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "grafana_dashboards_path": { 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.477 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "host_check_interval": { 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "host_check_interval", 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.478 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "hw_monitoring": { 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "hw_monitoring", 2024-09-12T02:09:14.479 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "inventory_list_all": { 2024-09-12T02:09:14.480 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "inventory_list_all", 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.481 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.482 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: "log_refresh_metadata": { 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_refresh_metadata", 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.484 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.485 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.486 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.487 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.488 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:09:14.489 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "*", 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.490 INFO:teuthology.orchestra.run.smithi062.stdout: "max_count_per_host": { 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_count_per_host", 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.491 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd_draining_count": { 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_osd_draining_count", 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.492 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "migration_current": { 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "migration_current", 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "internal - do not modify", 2024-09-12T02:09:14.493 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "mode": { 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mode", 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "root", 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.494 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm-package", 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "root" 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "oob_default_addr": { 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "oob_default_addr", 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.495 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "169.254.1.1", 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "prometheus_alerts_path": { 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.496 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:09:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:09:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_insecure": { 2024-09-12T02:09:14.498 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_insecure", 2024-09-12T02:09:14.498 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.498 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.498 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.498 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.498 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.498 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.498 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.498 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:09:14.498 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_password": { 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_password", 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.499 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_url": { 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_url", 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.500 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_username": { 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_username", 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.501 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "secure_monitoring_stack": { 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:09:14.502 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "service_discovery_port": { 2024-09-12T02:09:14.503 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "service_discovery_port", 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8765", 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.504 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "ssh_config_file": { 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssh_config_file", 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.505 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "use_agent": { 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "use_agent", 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:09:14.506 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "use_repo_digest": { 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "use_repo_digest", 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.507 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_on_failed_host_check": { 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.508 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_on_stray_daemons": { 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.509 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_on_stray_hosts": { 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.510 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crash", 2024-09-12T02:09:14.511 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.512 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.513 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.514 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.515 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "retain_interval": { 2024-09-12T02:09:14.517 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "retain_interval", 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "31536000", 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.518 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_recent_interval": { 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_recent_interval", 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "1209600", 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "dashboard", 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.520 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.521 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:09:14.522 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:09:14.523 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:09:14.524 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.525 INFO:teuthology.orchestra.run.smithi062.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.527 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.528 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.529 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.530 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.531 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.532 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:09:14.533 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:09:14.534 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:09:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "admin", 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_URL": { 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.538 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "admin", 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.539 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.540 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.541 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:09:14.542 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:09:14.543 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.545 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.546 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.547 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.548 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.549 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.552 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:09:14.553 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:09:14.554 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.555 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.556 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.557 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8", 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.558 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "45", 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.559 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.560 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "admin", 2024-09-12T02:09:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.562 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.563 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.564 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:09:14.565 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:09:14.566 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.567 INFO:teuthology.orchestra.run.smithi062.stdout: "cross_origin_url": { 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cross_origin_url", 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.568 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "crt_file": { 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crt_file", 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.569 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "debug": { 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "debug", 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.570 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "jwt_token_ttl": { 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "jwt_token_ttl", 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "28800", 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.571 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "key_file": { 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "key_file", 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.572 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.573 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.574 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.575 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.576 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.577 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.578 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "motd": { 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "motd", 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.579 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "The message of the day", 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.580 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "server_addr": { 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_addr", 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "::", 2024-09-12T02:09:14.581 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "server_port": { 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_port", 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8080", 2024-09-12T02:09:14.582 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "ssl": { 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssl", 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.583 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "ssl_server_port": { 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssl_server_port", 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.584 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8443", 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_behaviour": { 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_behaviour", 2024-09-12T02:09:14.585 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "redirect", 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "redirect" 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.586 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_error_status_code": { 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "500", 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "400", 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "599", 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.587 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "url_prefix": { 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "url_prefix", 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.588 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "devicehealth", 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: "enable_monitoring": { 2024-09-12T02:09:14.589 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enable_monitoring", 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "monitor device health metrics", 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.590 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.591 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.592 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.593 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.594 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "mark_out_threshold": { 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mark_out_threshold", 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "2419200", 2024-09-12T02:09:14.596 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": { 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pool_name", 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.597 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "device_health_metrics", 2024-09-12T02:09:14.598 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.598 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.598 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.598 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:09:14.598 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.598 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.598 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.598 INFO:teuthology.orchestra.run.smithi062.stdout: "retention_period": { 2024-09-12T02:09:14.598 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "retention_period", 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "15552000", 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.599 INFO:teuthology.orchestra.run.smithi062.stdout: "scrape_frequency": { 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "scrape_frequency", 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "86400", 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.600 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "self_heal": { 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "self_heal", 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.601 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.602 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_threshold": { 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_threshold", 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "7257600", 2024-09-12T02:09:14.603 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "diskprediction_local", 2024-09-12T02:09:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.608 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.609 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "predict_interval": { 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "predict_interval", 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.610 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "86400", 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "predictor_model": { 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "predictor_model", 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.611 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "prophetstor", 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:14.612 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.613 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "influx", 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": false, 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "batch_size": { 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "batch_size", 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5000", 2024-09-12T02:09:14.614 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "database": { 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "database", 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.615 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "ceph", 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": { 2024-09-12T02:09:14.616 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "hostname", 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.617 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "30", 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "5", 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.620 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.621 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.622 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.623 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "password": { 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "password", 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.624 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "port": { 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "port", 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.625 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8086", 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "InfluxDB server port", 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "ssl": { 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssl", 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.626 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "false", 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "threads": { 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "threads", 2024-09-12T02:09:14.627 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "32", 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "username": { 2024-09-12T02:09:14.628 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "username", 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.629 INFO:teuthology.orchestra.run.smithi062.stdout: "verify_ssl": { 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "verify_ssl", 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "true", 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.630 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "insights", 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.631 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.632 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.633 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.634 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.636 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "iostat", 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.637 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.638 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.639 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.640 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.642 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "k8sevents", 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_event_retention_days": { 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "7", 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "config_check_secs": { 2024-09-12T02:09:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "config_check_secs", 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "10", 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.646 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.647 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.648 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.649 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.650 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.651 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "localpool", 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "failure_domain": { 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "failure_domain", 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "host", 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.652 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.653 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.654 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.655 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.656 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.657 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": { 2024-09-12T02:09:14.658 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "min_size", 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "num_rep": { 2024-09-12T02:09:14.659 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "num_rep", 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "3", 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": { 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pg_num", 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "128", 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.661 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "prefix": { 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "prefix", 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.662 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "subtree": { 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "subtree", 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "rack", 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:09:14.663 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mds_autoscaler", 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.664 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.666 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mirroring", 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.670 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.671 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "nfs", 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "orchestrator", 2024-09-12T02:09:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "fail_fs": { 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "fail_fs", 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:09:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "orchestrator": { 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "orchestrator", 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm", 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: "rook", 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: "test_orchestrator" 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Orchestrator backend", 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.690 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "osd_perf_query", 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.691 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.693 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.694 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.695 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.696 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "osd_support", 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.697 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.698 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.698 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.698 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.698 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.698 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.698 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.698 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.698 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.698 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.699 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.700 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.701 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.702 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pg_autoscaler", 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.703 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.704 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.705 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.707 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.708 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.709 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.710 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "threshold": { 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "threshold", 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "3.0", 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1.0", 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "scaling threshold", 2024-09-12T02:09:14.711 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "progress", 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_pg_recovery_event": { 2024-09-12T02:09:14.712 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.713 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": { 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enabled", 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.714 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.715 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.716 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.717 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.719 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "max_completed_events": { 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_completed_events", 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.720 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "50", 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.721 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "prometheus", 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "cache": { 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cache", 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.723 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "exclude_perf_counters": { 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "exclude_perf_counters", 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.724 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.725 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.726 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.727 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.728 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.729 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.730 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_stats_pools": { 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd_stats_pools", 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "300", 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.732 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "scrape_interval": { 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "scrape_interval", 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "15.0", 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.733 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "server_addr": { 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_addr", 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "::", 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:09:14.734 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "server_port": { 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_port", 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "9283", 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.735 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: "stale_cache_strategy": { 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "stale_cache_strategy", 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "log", 2024-09-12T02:09:14.736 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_behaviour": { 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_behaviour", 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "default", 2024-09-12T02:09:14.737 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: "default", 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: "error" 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_error_status_code": { 2024-09-12T02:09:14.738 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "500", 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "400", 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "599", 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.739 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd_support", 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.741 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.742 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.743 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.744 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "max_concurrent_snap_create": { 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.746 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.747 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "trash_purge_schedule": { 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "trash_purge_schedule", 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.748 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "restful", 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: "enable_auth": { 2024-09-12T02:09:14.749 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enable_auth", 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "key_file": { 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "key_file", 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.751 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.752 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.753 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.754 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.755 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.756 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "server_addr": { 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_addr", 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.758 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "server_port": { 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_port", 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.759 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rgw", 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.761 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.762 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.763 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.764 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.765 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rook", 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.766 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.767 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.768 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.769 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.770 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.771 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "storage_class": { 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "storage_class", 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "local", 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.772 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "selftest", 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.773 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.775 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.776 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.777 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "roption1": { 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "roption1", 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.779 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "roption2": { 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "roption2", 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "xyz", 2024-09-12T02:09:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption1": { 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption1", 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.781 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption2": { 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption2", 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.782 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption3": { 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption3", 2024-09-12T02:09:14.783 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.784 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption4": { 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption4", 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.785 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption5": { 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption5", 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.786 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption6": { 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption6", 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.787 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption7": { 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption7", 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "42", 2024-09-12T02:09:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "testkey": { 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "testkey", 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.789 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "testlkey": { 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "testlkey", 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.790 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "testnewline": { 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "testnewline", 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snap_schedule", 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_m_granularity": { 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "allow_m_granularity", 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.793 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:09:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: "dump_on_update": { 2024-09-12T02:09:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "dump_on_update", 2024-09-12T02:09:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.794 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.795 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.795 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.795 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.795 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.795 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.795 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:09:14.795 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.795 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.795 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.796 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.798 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.798 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.798 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.798 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.798 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.798 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.798 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.798 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.798 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.799 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.799 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.799 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.799 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.799 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.799 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.799 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.799 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.800 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.801 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.802 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "stats", 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.803 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.804 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.805 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.806 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.807 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.807 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.807 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.807 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.807 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.807 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.807 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.807 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.807 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.807 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.808 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.809 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "status", 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.810 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.811 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.812 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.813 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.814 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.814 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.814 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.814 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.814 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.814 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.814 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.814 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.814 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.814 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.815 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.817 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.817 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.817 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.817 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "telegraf", 2024-09-12T02:09:14.817 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.817 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.817 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.817 INFO:teuthology.orchestra.run.smithi062.stdout: "address": { 2024-09-12T02:09:14.817 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "address", 2024-09-12T02:09:14.817 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.818 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.818 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.818 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:09:14.818 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.818 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.818 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.818 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.818 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.818 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.818 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "15", 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.819 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.820 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.821 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.822 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.823 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.824 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.824 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.824 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.824 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.824 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.824 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.824 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.824 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.824 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.824 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.826 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "telemetry", 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_basic": { 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_basic", 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.827 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_crash": { 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_crash", 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.828 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_device": { 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_device", 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.829 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.830 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_ident": { 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_ident", 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.831 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_perf": { 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_perf", 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.832 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: "contact": { 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "contact", 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.833 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "description": { 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "description", 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.834 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: "device_url": { 2024-09-12T02:09:14.835 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_url", 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.836 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": { 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enabled", 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.837 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "24", 2024-09-12T02:09:14.838 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "8", 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: "last_opt_revision": { 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "last_opt_revision", 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.839 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.840 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.840 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "1", 2024-09-12T02:09:14.840 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.840 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.840 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.840 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.840 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.840 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.840 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.840 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: "leaderboard": { 2024-09-12T02:09:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "leaderboard", 2024-09-12T02:09:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.841 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.842 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.842 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.842 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.842 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.842 INFO:teuthology.orchestra.run.smithi062.stdout: "leaderboard_description": { 2024-09-12T02:09:14.842 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "leaderboard_description", 2024-09-12T02:09:14.842 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.842 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.842 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.842 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.843 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.843 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.843 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.843 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.843 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.843 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.843 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.843 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.843 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.843 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.844 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.845 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.846 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.847 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.848 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.849 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: "organization": { 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "organization", 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.850 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "proxy": { 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "proxy", 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.851 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.852 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.852 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.852 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.852 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.852 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.852 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.852 INFO:teuthology.orchestra.run.smithi062.stdout: "url": { 2024-09-12T02:09:14.852 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "url", 2024-09-12T02:09:14.852 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.852 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.853 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "test_orchestrator", 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.854 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.855 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.855 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.855 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.855 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.855 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.855 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.855 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.855 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.855 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.855 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.856 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.857 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.858 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.859 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.860 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "volumes", 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.861 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.862 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.863 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.864 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.865 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.866 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "max_concurrent_clones": { 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_concurrent_clones", 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.867 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "4", 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.868 INFO:teuthology.orchestra.run.smithi062.stdout: "periodic_async_work": { 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "periodic_async_work", 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Periodically check for async work", 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.869 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "snapshot_clone_delay": { 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.870 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.872 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix", 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "discovery_interval": { 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "discovery_interval", 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "100", 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.873 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "identifier": { 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "identifier", 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.874 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.877 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.878 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.879 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.880 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.881 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.882 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "zabbix_host": { 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix_host", 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.883 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "zabbix_port": { 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix_port", 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10051", 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.884 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: "zabbix_sender": { 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix_sender", 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.885 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.886 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: "gid": 25093, 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "z", 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: "available_modules": [ 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "alerts", 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.887 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:09:14.888 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.889 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.890 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.891 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.892 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.893 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.894 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_destination": { 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_destination", 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.895 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_from_name": { 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_from_name", 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.896 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "Ceph", 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Email From: name", 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.897 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_host": { 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_host", 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SMTP server", 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.898 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.899 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.899 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_password": { 2024-09-12T02:09:14.899 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_password", 2024-09-12T02:09:14.899 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.899 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.899 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.899 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.899 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Password to authenticate with", 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_port": { 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_port", 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.900 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "465", 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SMTP port", 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_sender": { 2024-09-12T02:09:14.901 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_sender", 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.902 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_ssl": { 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_ssl", 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.903 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_user": { 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_user", 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.904 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "User to authenticate as", 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "balancer", 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "active": { 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "active", 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.906 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.907 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.907 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:09:14.907 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.907 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.907 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.907 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.907 INFO:teuthology.orchestra.run.smithi062.stdout: "begin_time": { 2024-09-12T02:09:14.907 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "begin_time", 2024-09-12T02:09:14.907 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.907 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.908 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.908 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0000", 2024-09-12T02:09:14.908 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.908 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.908 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.908 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:09:14.908 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:14.908 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.908 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "begin_weekday": { 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "begin_weekday", 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "0", 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "6", 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:14.909 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_compat_max_iterations": { 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "25", 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "250", 2024-09-12T02:09:14.910 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_compat_metrics": { 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crush_compat_metrics", 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.911 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_compat_step": { 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crush_compat_step", 2024-09-12T02:09:14.912 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0.5", 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "0.001", 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "0.999", 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.913 INFO:teuthology.orchestra.run.smithi062.stdout: "end_time": { 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "end_time", 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "2359", 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:14.914 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: "end_weekday": { 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "end_weekday", 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "0", 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "6", 2024-09-12T02:09:14.915 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.916 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.917 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.918 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.919 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.919 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.919 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.919 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.919 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.919 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.919 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.919 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.919 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.920 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.920 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.920 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.920 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.920 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.920 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.920 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.920 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.920 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.920 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.921 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "min_score": { 2024-09-12T02:09:14.922 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "min_score", 2024-09-12T02:09:14.923 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.923 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.923 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.923 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:14.923 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.923 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.923 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.923 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: "mode": { 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mode", 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "upmap", 2024-09-12T02:09:14.924 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-compat", 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "none", 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "read", 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap", 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap-read" 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Balancer mode", 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.925 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_ids": { 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pool_ids", 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.926 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.927 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap_max_deviation": { 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "upmap_max_deviation", 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.928 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap_max_optimizations": { 2024-09-12T02:09:14.929 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.930 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephadm", 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: "agent_down_multiplier": { 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "agent_down_multiplier", 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.931 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.932 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.932 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "3.0", 2024-09-12T02:09:14.932 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.932 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.932 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.932 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:09:14.932 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.932 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.932 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.932 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "agent_refresh_rate": { 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "agent_refresh_rate", 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "20", 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.933 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "agent_starting_port": { 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "agent_starting_port", 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "4721", 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.934 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_ptrace": { 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "allow_ptrace", 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.935 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:09:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:09:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: "autotune_interval": { 2024-09-12T02:09:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "autotune_interval", 2024-09-12T02:09:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.936 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.937 INFO:teuthology.orchestra.run.smithi062.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0.7", 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.938 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm_log_destination": { 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephadm_log_destination", 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.939 INFO:teuthology.orchestra.run.smithi062.stdout: "file", 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: "file,syslog", 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: "syslog" 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: "cgroups_split": { 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cgroups_split", 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.940 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.941 INFO:teuthology.orchestra.run.smithi062.stdout: "config_checks_enabled": { 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "config_checks_enabled", 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.942 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: "config_dashboard": { 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "config_dashboard", 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.943 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_alertmanager": { 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_alertmanager", 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.944 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_base": { 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_base", 2024-09-12T02:09:14.945 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.946 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_elasticsearch": { 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "elasticsearch container image", 2024-09-12T02:09:14.947 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_grafana": { 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_grafana", 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.948 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.949 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.949 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:14.949 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.949 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.949 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.949 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.949 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_haproxy": { 2024-09-12T02:09:14.949 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_haproxy", 2024-09-12T02:09:14.949 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.949 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "HAproxy container image", 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_jaeger_agent": { 2024-09-12T02:09:14.950 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:09:14.951 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.951 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.951 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.951 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:09:14.951 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.951 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.951 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.951 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:09:14.951 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.951 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.952 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.952 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.952 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_jaeger_collector": { 2024-09-12T02:09:14.952 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:09:14.952 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.952 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.952 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.952 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:09:14.952 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.952 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_jaeger_query": { 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.953 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Jaeger query container image", 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_keepalived": { 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_keepalived", 2024-09-12T02:09:14.954 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Keepalived container image", 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.955 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_loki": { 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_loki", 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Loki container image", 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.956 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_node_exporter": { 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_node_exporter", 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.957 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_nvmeof": { 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_nvmeof", 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.958 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Nvme-of container image", 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_prometheus": { 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_prometheus", 2024-09-12T02:09:14.959 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.960 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_promtail": { 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_promtail", 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Promtail container image", 2024-09-12T02:09:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_samba": { 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_samba", 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.962 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_snmp_gateway": { 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.963 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "container_init": { 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_init", 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.964 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.965 INFO:teuthology.orchestra.run.smithi062.stdout: "daemon_cache_timeout": { 2024-09-12T02:09:14.966 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:09:14.966 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.966 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.966 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.966 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:14.966 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.966 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.966 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.966 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:09:14.966 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "900", 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: "default_registry": { 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "default_registry", 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.968 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io", 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "device_cache_timeout": { 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_cache_timeout", 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.969 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "1800", 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.970 INFO:teuthology.orchestra.run.smithi062.stdout: "device_enhanced_scan": { 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_enhanced_scan", 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.971 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: "facts_cache_timeout": { 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "facts_cache_timeout", 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.972 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: "grafana_dashboards_path": { 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.973 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "host_check_interval": { 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "host_check_interval", 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:14.974 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.975 INFO:teuthology.orchestra.run.smithi062.stdout: "hw_monitoring": { 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "hw_monitoring", 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.976 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "inventory_list_all": { 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "inventory_list_all", 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.977 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: "log_refresh_metadata": { 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_refresh_metadata", 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.980 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.981 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:14.982 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:14.983 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.984 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "*", 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: "max_count_per_host": { 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_count_per_host", 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.989 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.989 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.989 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:09:14.989 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.989 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.989 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.989 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.989 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd_draining_count": { 2024-09-12T02:09:14.989 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_osd_draining_count", 2024-09-12T02:09:14.989 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.990 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "migration_current": { 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "migration_current", 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "internal - do not modify", 2024-09-12T02:09:14.991 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.992 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.992 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.992 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.992 INFO:teuthology.orchestra.run.smithi062.stdout: "mode": { 2024-09-12T02:09:14.992 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mode", 2024-09-12T02:09:14.992 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.992 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.992 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.992 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "root", 2024-09-12T02:09:14.992 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm-package", 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: "root" 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.993 INFO:teuthology.orchestra.run.smithi062.stdout: "oob_default_addr": { 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "oob_default_addr", 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "169.254.1.1", 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.994 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: "prometheus_alerts_path": { 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.995 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_insecure": { 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_insecure", 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_password": { 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_password", 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.997 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_url": { 2024-09-12T02:09:14.998 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_url", 2024-09-12T02:09:14.999 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:14.999 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:14.999 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:14.999 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:14.999 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:14.999 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:14.999 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:14.999 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:09:14.999 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.000 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.000 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.000 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.000 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_username": { 2024-09-12T02:09:15.000 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_username", 2024-09-12T02:09:15.000 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.000 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.000 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.000 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.000 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "secure_monitoring_stack": { 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.001 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.002 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.002 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.002 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.002 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.002 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:09:15.002 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.002 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.002 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.002 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.002 INFO:teuthology.orchestra.run.smithi062.stdout: "service_discovery_port": { 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "service_discovery_port", 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8765", 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.003 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: "ssh_config_file": { 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssh_config_file", 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.004 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: "use_agent": { 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "use_agent", 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.005 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: "use_repo_digest": { 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "use_repo_digest", 2024-09-12T02:09:15.006 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.007 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_on_failed_host_check": { 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.008 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_on_stray_daemons": { 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.009 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_on_stray_hosts": { 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.010 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crash", 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.012 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.013 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.014 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.015 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.016 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.016 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.016 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.016 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.016 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.016 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.016 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.016 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.016 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.016 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.017 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: "retain_interval": { 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "retain_interval", 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.018 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "31536000", 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_recent_interval": { 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_recent_interval", 2024-09-12T02:09:15.019 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.020 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.020 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.020 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "1209600", 2024-09-12T02:09:15.020 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.020 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.020 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.020 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:09:15.020 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.020 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.020 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "dashboard", 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:09:15.021 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.022 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.023 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.024 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.024 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.024 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.024 INFO:teuthology.orchestra.run.smithi062.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:09:15.024 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:09:15.024 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.024 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.024 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.024 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.024 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.026 INFO:teuthology.orchestra.run.smithi062.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.027 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.028 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.029 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.030 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.030 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.030 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.030 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.030 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.030 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.030 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.030 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:09:15.030 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:09:15.030 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.031 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.032 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.033 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.034 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:09:15.035 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.036 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.036 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.036 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.036 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.036 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.036 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.036 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.036 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.036 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.036 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.037 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.038 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.039 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.040 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.040 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "admin", 2024-09-12T02:09:15.040 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.040 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.040 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.040 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.040 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.040 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.040 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.040 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.041 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_URL": { 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.042 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "admin", 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.047 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.048 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.048 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.048 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.048 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.048 INFO:teuthology.orchestra.run.smithi062.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:09:15.048 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:09:15.048 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.048 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.048 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.048 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:09:15.049 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.050 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.051 INFO:teuthology.orchestra.run.smithi062.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:09:15.051 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:09:15.051 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.051 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.051 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.051 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.051 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.051 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.051 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.051 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.052 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.052 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.052 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.052 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.052 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:09:15.052 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:09:15.052 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.052 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.052 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.052 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:09:15.053 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.054 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.055 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.056 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.057 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.058 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:09:15.059 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.060 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.061 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.062 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.062 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.062 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.062 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:09:15.062 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:09:15.062 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.062 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.062 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.062 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:09:15.062 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.063 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.064 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8", 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.065 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "45", 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.067 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.068 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "admin", 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:09:15.069 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.070 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.071 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.072 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.072 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.072 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.072 INFO:teuthology.orchestra.run.smithi062.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:09:15.072 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:09:15.072 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.072 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.072 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.072 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:15.072 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.073 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:09:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.075 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: "cross_origin_url": { 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cross_origin_url", 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.076 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "crt_file": { 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crt_file", 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.077 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "debug": { 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "debug", 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.078 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: "jwt_token_ttl": { 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "jwt_token_ttl", 2024-09-12T02:09:15.079 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "28800", 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.080 INFO:teuthology.orchestra.run.smithi062.stdout: "key_file": { 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "key_file", 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.081 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.082 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.083 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.084 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.084 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.084 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.084 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.084 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.084 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.084 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.084 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.084 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.084 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.085 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.086 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.087 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: "motd": { 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "motd", 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.088 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "The message of the day", 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.089 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "server_addr": { 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_addr", 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.090 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "::", 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "server_port": { 2024-09-12T02:09:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_port", 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8080", 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.092 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "ssl": { 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssl", 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.093 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "ssl_server_port": { 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssl_server_port", 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8443", 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.094 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_behaviour": { 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_behaviour", 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "redirect", 2024-09-12T02:09:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.096 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.096 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.096 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.096 INFO:teuthology.orchestra.run.smithi062.stdout: "redirect" 2024-09-12T02:09:15.096 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.096 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.096 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.096 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.096 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_error_status_code": { 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "500", 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "400", 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "599", 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.097 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "url_prefix": { 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "url_prefix", 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.098 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.099 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "devicehealth", 2024-09-12T02:09:15.100 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.100 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.100 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.100 INFO:teuthology.orchestra.run.smithi062.stdout: "enable_monitoring": { 2024-09-12T02:09:15.100 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enable_monitoring", 2024-09-12T02:09:15.100 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.100 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.100 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.100 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.100 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "monitor device health metrics", 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.102 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.103 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.104 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.105 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.106 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.107 INFO:teuthology.orchestra.run.smithi062.stdout: "mark_out_threshold": { 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mark_out_threshold", 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "2419200", 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.108 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": { 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pool_name", 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "device_health_metrics", 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:09:15.109 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: "retention_period": { 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "retention_period", 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "15552000", 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.110 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: "scrape_frequency": { 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "scrape_frequency", 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.111 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.112 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "86400", 2024-09-12T02:09:15.112 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.112 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.112 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.112 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:09:15.112 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.112 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.112 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.112 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.112 INFO:teuthology.orchestra.run.smithi062.stdout: "self_heal": { 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "self_heal", 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:09:15.114 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_threshold": { 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_threshold", 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "7257600", 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.115 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "diskprediction_local", 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.116 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.117 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.118 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.119 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.120 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.121 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.121 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.121 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.121 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.121 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.121 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.121 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.121 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.121 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.121 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.122 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: "predict_interval": { 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "predict_interval", 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "86400", 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.123 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: "predictor_model": { 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "predictor_model", 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.124 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "prophetstor", 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:15.125 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.126 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.127 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.127 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.127 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.127 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "influx", 2024-09-12T02:09:15.127 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": false, 2024-09-12T02:09:15.127 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:09:15.127 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.127 INFO:teuthology.orchestra.run.smithi062.stdout: "batch_size": { 2024-09-12T02:09:15.127 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "batch_size", 2024-09-12T02:09:15.127 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5000", 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.129 INFO:teuthology.orchestra.run.smithi062.stdout: "database": { 2024-09-12T02:09:15.129 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "database", 2024-09-12T02:09:15.129 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.129 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.129 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.129 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "ceph", 2024-09-12T02:09:15.129 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.129 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.129 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.129 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": { 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "hostname", 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.130 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.131 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.131 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:09:15.131 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.131 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.131 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.131 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.131 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:15.131 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:15.131 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.131 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "30", 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "5", 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.132 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.134 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.135 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.136 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.137 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "password": { 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "password", 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.139 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: "port": { 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "port", 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.140 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.141 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8086", 2024-09-12T02:09:15.141 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.141 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.141 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.141 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "InfluxDB server port", 2024-09-12T02:09:15.141 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.141 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.141 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.141 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.141 INFO:teuthology.orchestra.run.smithi062.stdout: "ssl": { 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssl", 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "false", 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.142 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "threads": { 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "threads", 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "32", 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:09:15.143 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.144 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.144 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.144 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.144 INFO:teuthology.orchestra.run.smithi062.stdout: "username": { 2024-09-12T02:09:15.144 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "username", 2024-09-12T02:09:15.144 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.144 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.144 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.144 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.144 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "verify_ssl": { 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "verify_ssl", 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.145 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.146 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "true", 2024-09-12T02:09:15.146 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.146 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.146 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.146 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:15.146 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.146 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.146 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.146 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.146 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "insights", 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.147 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.148 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.148 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.148 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.148 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.148 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.148 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.148 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.148 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.148 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.148 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.149 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.150 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.151 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.152 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.153 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "iostat", 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.154 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.155 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.156 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.157 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.158 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.159 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.160 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "k8sevents", 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_event_retention_days": { 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "7", 2024-09-12T02:09:15.161 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: "config_check_secs": { 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "config_check_secs", 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.162 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "10", 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.163 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.164 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.165 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.166 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.167 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.168 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.169 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.170 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.170 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.170 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.170 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.170 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.170 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.170 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "localpool", 2024-09-12T02:09:15.170 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.170 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.170 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "failure_domain": { 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "failure_domain", 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "host", 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:09:15.171 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.172 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.173 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.174 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.175 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.176 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.177 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": { 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "min_size", 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.178 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: "num_rep": { 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "num_rep", 2024-09-12T02:09:15.179 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "3", 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": { 2024-09-12T02:09:15.181 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pg_num", 2024-09-12T02:09:15.181 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.181 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.181 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.181 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "128", 2024-09-12T02:09:15.181 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.181 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.181 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.181 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "prefix": { 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "prefix", 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.182 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "subtree": { 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "subtree", 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.183 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "rack", 2024-09-12T02:09:15.184 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.184 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.184 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.184 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:09:15.184 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:09:15.184 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.184 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.184 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.184 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.184 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mds_autoscaler", 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.185 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.186 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.187 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.188 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.189 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.190 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mirroring", 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.191 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.192 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.193 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.195 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.196 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.196 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.196 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.196 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.196 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.196 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.196 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.196 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.196 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.196 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.197 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.198 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.198 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.198 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.198 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.198 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.198 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.198 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.198 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.198 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "nfs", 2024-09-12T02:09:15.198 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.199 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.200 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.200 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.200 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.200 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.200 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.200 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.200 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.201 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.201 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.201 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.201 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.201 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.201 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.201 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.201 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.201 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.201 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.202 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.203 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.203 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.203 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.203 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.203 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.203 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.203 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.203 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.203 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.203 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.204 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.205 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.205 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.205 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.205 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.205 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.205 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.205 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.205 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.205 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.205 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "orchestrator", 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: "fail_fs": { 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "fail_fs", 2024-09-12T02:09:15.206 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.207 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.208 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.209 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.210 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.211 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.212 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.212 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.212 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.212 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.212 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.212 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.212 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.212 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.212 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.212 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.213 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.214 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.214 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.214 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.214 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.214 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.214 INFO:teuthology.orchestra.run.smithi062.stdout: "orchestrator": { 2024-09-12T02:09:15.214 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "orchestrator", 2024-09-12T02:09:15.214 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.214 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.214 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm", 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: "rook", 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: "test_orchestrator" 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Orchestrator backend", 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.215 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.216 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.216 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.216 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.216 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.216 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.216 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "osd_perf_query", 2024-09-12T02:09:15.216 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.216 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.216 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.216 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.217 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.217 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.217 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.217 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.217 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.217 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.217 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.217 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.217 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.217 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.218 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.219 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.220 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.221 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.222 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.223 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.224 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.225 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.225 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.225 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.225 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.225 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.225 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "osd_support", 2024-09-12T02:09:15.225 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.225 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.225 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.225 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.226 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.227 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.228 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.229 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.229 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.229 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.229 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.229 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.229 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.229 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.229 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.229 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.229 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.230 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.230 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.230 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.230 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.230 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.230 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.230 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.230 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.230 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.230 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.231 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pg_autoscaler", 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.232 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.233 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.234 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.235 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.236 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.238 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.240 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.240 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.240 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.240 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.240 INFO:teuthology.orchestra.run.smithi062.stdout: "threshold": { 2024-09-12T02:09:15.240 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "threshold", 2024-09-12T02:09:15.240 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:15.240 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.240 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.240 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "3.0", 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1.0", 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "scaling threshold", 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "progress", 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_pg_recovery_event": { 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": { 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enabled", 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.243 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.244 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.245 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.245 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.245 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.245 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.245 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.245 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.245 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.245 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.245 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.245 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.246 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.248 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.249 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.250 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: "max_completed_events": { 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_completed_events", 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "50", 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.251 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.252 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "prometheus", 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.253 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "cache": { 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cache", 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.254 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: "exclude_perf_counters": { 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "exclude_perf_counters", 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.255 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.256 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.257 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.258 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.259 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.260 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.261 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.262 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_stats_pools": { 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd_stats_pools", 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.263 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "300", 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.264 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "scrape_interval": { 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "scrape_interval", 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.265 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "15.0", 2024-09-12T02:09:15.266 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.266 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.266 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.266 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.266 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.266 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.266 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.266 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.266 INFO:teuthology.orchestra.run.smithi062.stdout: "server_addr": { 2024-09-12T02:09:15.266 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_addr", 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "::", 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.267 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.268 INFO:teuthology.orchestra.run.smithi062.stdout: "server_port": { 2024-09-12T02:09:15.268 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_port", 2024-09-12T02:09:15.268 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.268 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.268 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.268 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "9283", 2024-09-12T02:09:15.268 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.268 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.268 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.268 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:09:15.269 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.269 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.269 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.269 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.269 INFO:teuthology.orchestra.run.smithi062.stdout: "stale_cache_strategy": { 2024-09-12T02:09:15.269 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "stale_cache_strategy", 2024-09-12T02:09:15.269 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.269 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.269 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "log", 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_behaviour": { 2024-09-12T02:09:15.270 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_behaviour", 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "default", 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: "default", 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: "error" 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.271 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.272 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.272 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.272 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.272 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.272 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_error_status_code": { 2024-09-12T02:09:15.272 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:15.272 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.272 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.272 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.272 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "500", 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "400", 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "599", 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.273 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.274 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd_support", 2024-09-12T02:09:15.274 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.274 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.274 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.274 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.274 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.274 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.274 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.274 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.274 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.275 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.276 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.276 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.276 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.276 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.276 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.276 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.276 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.276 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.276 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.276 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.277 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.278 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.279 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.280 INFO:teuthology.orchestra.run.smithi062.stdout: "max_concurrent_snap_create": { 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.281 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.282 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "trash_purge_schedule": { 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "trash_purge_schedule", 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.283 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.284 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.284 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.284 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.284 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.284 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.284 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.284 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.284 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "restful", 2024-09-12T02:09:15.284 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.284 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.285 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.285 INFO:teuthology.orchestra.run.smithi062.stdout: "enable_auth": { 2024-09-12T02:09:15.285 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enable_auth", 2024-09-12T02:09:15.285 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.285 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.285 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.285 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.285 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.285 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.285 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "key_file": { 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "key_file", 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.286 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.287 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.288 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.289 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.290 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.291 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.292 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "server_addr": { 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_addr", 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.293 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: "server_port": { 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_port", 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.294 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.295 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.296 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.296 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rgw", 2024-09-12T02:09:15.296 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.296 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.296 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.296 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.296 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.296 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.296 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.296 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.297 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.298 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.299 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.300 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.300 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.300 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.300 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.300 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.300 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.300 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.300 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.301 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.302 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rook", 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.303 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.304 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.305 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.306 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.307 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.308 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: "storage_class": { 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "storage_class", 2024-09-12T02:09:15.309 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "local", 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.310 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "selftest", 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.311 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.312 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.313 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.314 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.315 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.316 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: "roption1": { 2024-09-12T02:09:15.317 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "roption1", 2024-09-12T02:09:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: "roption2": { 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "roption2", 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "xyz", 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.319 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption1": { 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption1", 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.320 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption2": { 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption2", 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.321 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.322 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption3": { 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption3", 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.323 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.324 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.324 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption4": { 2024-09-12T02:09:15.324 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption4", 2024-09-12T02:09:15.324 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.324 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.324 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.324 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.324 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.324 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption5": { 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption5", 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.325 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption6": { 2024-09-12T02:09:15.326 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption6", 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.327 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption7": { 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption7", 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "42", 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.328 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: "testkey": { 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "testkey", 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.329 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: "testlkey": { 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "testlkey", 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.331 INFO:teuthology.orchestra.run.smithi062.stdout: "testnewline": { 2024-09-12T02:09:15.332 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "testnewline", 2024-09-12T02:09:15.332 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.332 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.332 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.332 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.332 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.332 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.332 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.332 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snap_schedule", 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.333 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_m_granularity": { 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "allow_m_granularity", 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.334 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "dump_on_update": { 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "dump_on_update", 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:09:15.335 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.336 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.337 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.338 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.339 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.340 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.341 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "stats", 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.342 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.343 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.344 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.345 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.346 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.347 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.348 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "status", 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.349 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.350 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.351 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.352 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.353 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.354 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.355 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "telegraf", 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: "address": { 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "address", 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.356 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:15.357 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "15", 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.358 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.359 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.360 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.361 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.363 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.364 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "telemetry", 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_basic": { 2024-09-12T02:09:15.365 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_basic", 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.366 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_crash": { 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_crash", 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:09:15.367 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_device": { 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_device", 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.368 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_ident": { 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_ident", 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.369 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_perf": { 2024-09-12T02:09:15.370 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_perf", 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.371 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: "contact": { 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "contact", 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.372 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "description": { 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "description", 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.373 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.374 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.374 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.374 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.374 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.374 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.374 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.374 INFO:teuthology.orchestra.run.smithi062.stdout: "device_url": { 2024-09-12T02:09:15.374 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_url", 2024-09-12T02:09:15.374 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.374 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": { 2024-09-12T02:09:15.375 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enabled", 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.376 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.377 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.377 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:15.377 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:15.377 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.377 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.377 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.377 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "24", 2024-09-12T02:09:15.377 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "8", 2024-09-12T02:09:15.377 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.377 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: "last_opt_revision": { 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "last_opt_revision", 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.378 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "1", 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "leaderboard": { 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "leaderboard", 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.379 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.380 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.380 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.380 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.380 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.380 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.380 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.380 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.380 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.380 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.380 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "leaderboard_description": { 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "leaderboard_description", 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.381 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.382 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.383 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.384 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.385 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.386 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.387 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "organization": { 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "organization", 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.388 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: "proxy": { 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "proxy", 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.389 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "url": { 2024-09-12T02:09:15.390 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "url", 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.391 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "test_orchestrator", 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.392 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.394 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.395 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.397 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.398 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "volumes", 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.399 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.400 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.400 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.400 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.400 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.400 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.400 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.400 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.400 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.400 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.400 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.401 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.401 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.401 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.401 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.401 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.401 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.401 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.401 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.402 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.403 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.404 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.405 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: "max_concurrent_clones": { 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_concurrent_clones", 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "4", 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.406 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "periodic_async_work": { 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "periodic_async_work", 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.407 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Periodically check for async work", 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: "snapshot_clone_delay": { 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.408 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:09:15.409 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.410 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix", 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: "discovery_interval": { 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "discovery_interval", 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.411 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "100", 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: "identifier": { 2024-09-12T02:09:15.412 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "identifier", 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.413 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.414 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.415 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.416 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.417 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.418 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.419 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.419 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.419 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.419 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.419 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.419 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.419 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.419 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.419 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.419 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.420 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "zabbix_host": { 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix_host", 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.421 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "zabbix_port": { 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix_port", 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.422 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10051", 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "zabbix_sender": { 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix_sender", 2024-09-12T02:09:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.424 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.425 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.425 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.425 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:15.425 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.425 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.425 INFO:teuthology.orchestra.run.smithi062.stdout: "modules": [ 2024-09-12T02:09:15.425 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm", 2024-09-12T02:09:15.425 INFO:teuthology.orchestra.run.smithi062.stdout: "dashboard", 2024-09-12T02:09:15.425 INFO:teuthology.orchestra.run.smithi062.stdout: "iostat", 2024-09-12T02:09:15.425 INFO:teuthology.orchestra.run.smithi062.stdout: "nfs", 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: "restful", 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: "snap_schedule" 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: "available_modules": [ 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "alerts", 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:15.426 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:09:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.428 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.429 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.430 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.431 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.431 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.431 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.431 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.431 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.431 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.431 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.431 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.431 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.431 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.432 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.433 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_destination": { 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_destination", 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.434 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_from_name": { 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_from_name", 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.435 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "Ceph", 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Email From: name", 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.436 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_host": { 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_host", 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SMTP server", 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.437 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_password": { 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_password", 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.438 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Password to authenticate with", 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_port": { 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_port", 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "465", 2024-09-12T02:09:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SMTP port", 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_sender": { 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_sender", 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.440 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.441 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_ssl": { 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_ssl", 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.442 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.443 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.443 INFO:teuthology.orchestra.run.smithi062.stdout: "smtp_user": { 2024-09-12T02:09:15.443 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "smtp_user", 2024-09-12T02:09:15.443 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.443 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.443 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.443 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.443 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.443 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.443 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "User to authenticate as", 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "balancer", 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.444 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "active": { 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "active", 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:09:15.445 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: "begin_time": { 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "begin_time", 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0000", 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: "begin_weekday": { 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "begin_weekday", 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.447 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "0", 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "6", 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_compat_max_iterations": { 2024-09-12T02:09:15.448 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "25", 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "250", 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.449 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_compat_metrics": { 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crush_compat_metrics", 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:09:15.450 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "crush_compat_step": { 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crush_compat_step", 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0.5", 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "0.001", 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "0.999", 2024-09-12T02:09:15.451 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: "end_time": { 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "end_time", 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.452 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "2359", 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: "end_weekday": { 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "end_weekday", 2024-09-12T02:09:15.453 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "0", 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "6", 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.454 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.455 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.456 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.457 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.458 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.459 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.460 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "min_score": { 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "min_score", 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:09:15.461 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "mode": { 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mode", 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "upmap", 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.462 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: "crush-compat", 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: "none", 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: "read", 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap", 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap-read" 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Balancer mode", 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.463 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_ids": { 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pool_ids", 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:09:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.465 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:09:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap_max_deviation": { 2024-09-12T02:09:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "upmap_max_deviation", 2024-09-12T02:09:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.466 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.467 INFO:teuthology.orchestra.run.smithi062.stdout: "upmap_max_optimizations": { 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.468 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephadm", 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: "agent_down_multiplier": { 2024-09-12T02:09:15.469 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "agent_down_multiplier", 2024-09-12T02:09:15.470 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:15.470 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.470 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.470 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "3.0", 2024-09-12T02:09:15.470 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.470 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.470 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.470 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:09:15.470 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.470 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.471 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.471 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.471 INFO:teuthology.orchestra.run.smithi062.stdout: "agent_refresh_rate": { 2024-09-12T02:09:15.471 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "agent_refresh_rate", 2024-09-12T02:09:15.471 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.471 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.471 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.471 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "20", 2024-09-12T02:09:15.471 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.471 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: "agent_starting_port": { 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "agent_starting_port", 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.472 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.473 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "4721", 2024-09-12T02:09:15.473 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.473 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.473 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.473 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:09:15.473 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.473 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.473 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.473 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.473 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_ptrace": { 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "allow_ptrace", 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.474 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "autotune_interval": { 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "autotune_interval", 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:09:15.475 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0.7", 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.476 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm_log_destination": { 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cephadm_log_destination", 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.477 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "file", 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "file,syslog", 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "syslog" 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.478 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: "cgroups_split": { 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cgroups_split", 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.479 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "config_checks_enabled": { 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "config_checks_enabled", 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.480 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "config_dashboard": { 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "config_dashboard", 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.481 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_alertmanager": { 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_alertmanager", 2024-09-12T02:09:15.482 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.483 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_base": { 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_base", 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.484 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_elasticsearch": { 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.485 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "elasticsearch container image", 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_grafana": { 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_grafana", 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:09:15.486 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_haproxy": { 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_haproxy", 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.487 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "HAproxy container image", 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.488 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_jaeger_agent": { 2024-09-12T02:09:15.489 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:09:15.489 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.489 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.489 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.489 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:09:15.489 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.489 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.489 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.489 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:09:15.489 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_jaeger_collector": { 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.490 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_jaeger_query": { 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.491 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:09:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Jaeger query container image", 2024-09-12T02:09:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_keepalived": { 2024-09-12T02:09:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_keepalived", 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Keepalived container image", 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.493 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_loki": { 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_loki", 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.494 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Loki container image", 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_node_exporter": { 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_node_exporter", 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:09:15.495 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.496 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.496 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.496 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:15.496 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.496 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.496 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.496 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.496 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_nvmeof": { 2024-09-12T02:09:15.496 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_nvmeof", 2024-09-12T02:09:15.496 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Nvme-of container image", 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.497 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_prometheus": { 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_prometheus", 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Prometheus container image", 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.498 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_promtail": { 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_promtail", 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.499 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Promtail container image", 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_samba": { 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_samba", 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:09:15.500 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.501 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.501 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.501 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:09:15.501 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.501 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.501 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.501 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "container_image_snmp_gateway": { 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:09:15.502 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: "container_init": { 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "container_init", 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.503 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:09:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: "daemon_cache_timeout": { 2024-09-12T02:09:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:09:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.504 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "900", 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: "default_registry": { 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "default_registry", 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "docker.io", 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.507 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: "device_cache_timeout": { 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_cache_timeout", 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.508 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "1800", 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "device_enhanced_scan": { 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_enhanced_scan", 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.509 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.510 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.510 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.510 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.510 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.510 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.510 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:09:15.510 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.510 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.510 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.510 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "facts_cache_timeout": { 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "facts_cache_timeout", 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.511 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: "grafana_dashboards_path": { 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.512 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: "host_check_interval": { 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "host_check_interval", 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.513 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: "hw_monitoring": { 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "hw_monitoring", 2024-09-12T02:09:15.514 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.515 INFO:teuthology.orchestra.run.smithi062.stdout: "inventory_list_all": { 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "inventory_list_all", 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.516 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.517 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.518 INFO:teuthology.orchestra.run.smithi062.stdout: "log_refresh_metadata": { 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_refresh_metadata", 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.519 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.520 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.521 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.522 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.523 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.524 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:09:15.525 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "*", 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.526 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "max_count_per_host": { 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_count_per_host", 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:09:15.527 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: "max_osd_draining_count": { 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_osd_draining_count", 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.528 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: "migration_current": { 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "migration_current", 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.529 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "internal - do not modify", 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "mode": { 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mode", 2024-09-12T02:09:15.530 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "root", 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm-package", 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: "root" 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:09:15.531 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "oob_default_addr": { 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "oob_default_addr", 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "169.254.1.1", 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: "prometheus_alerts_path": { 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.533 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_insecure": { 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_insecure", 2024-09-12T02:09:15.534 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.535 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_password": { 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_password", 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.536 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_url": { 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_url", 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.537 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:09:15.538 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.538 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.538 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.538 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.538 INFO:teuthology.orchestra.run.smithi062.stdout: "registry_username": { 2024-09-12T02:09:15.538 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "registry_username", 2024-09-12T02:09:15.538 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.538 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.538 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.538 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: "secure_monitoring_stack": { 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:09:15.539 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "service_discovery_port": { 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "service_discovery_port", 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8765", 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:09:15.541 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "ssh_config_file": { 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssh_config_file", 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.542 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: "use_agent": { 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "use_agent", 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.543 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: "use_repo_digest": { 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "use_repo_digest", 2024-09-12T02:09:15.544 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.545 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_on_failed_host_check": { 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:09:15.546 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.547 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.547 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.547 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.547 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_on_stray_daemons": { 2024-09-12T02:09:15.547 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:09:15.547 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.547 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.547 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.547 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.548 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.548 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.548 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.548 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:09:15.548 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.548 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.548 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.548 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.548 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_on_stray_hosts": { 2024-09-12T02:09:15.548 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.549 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crash", 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.550 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.551 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.552 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.553 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.554 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.555 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: "retain_interval": { 2024-09-12T02:09:15.556 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "retain_interval", 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "31536000", 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.557 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_recent_interval": { 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_recent_interval", 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "1209600", 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:09:15.558 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "dashboard", 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:09:15.559 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:09:15.560 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.560 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.560 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.560 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.560 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.560 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.560 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.560 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.560 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.560 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.561 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.562 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.563 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.564 INFO:teuthology.orchestra.run.smithi062.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.565 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.566 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.567 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.568 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.568 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.568 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.568 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.568 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.568 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.568 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.568 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:09:15.568 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:09:15.568 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.569 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.570 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.571 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:09:15.573 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.574 INFO:teuthology.orchestra.run.smithi062.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.575 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.576 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "admin", 2024-09-12T02:09:15.577 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.578 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_URL": { 2024-09-12T02:09:15.579 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.580 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "admin", 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.581 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.582 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.583 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.584 INFO:teuthology.orchestra.run.smithi062.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.586 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.587 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:09:15.588 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.590 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.591 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.592 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:09:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.597 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.598 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:09:15.599 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.600 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:09:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:09:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.602 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8", 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:09:15.603 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "45", 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.604 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.605 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "admin", 2024-09-12T02:09:15.606 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:09:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:09:15.607 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.608 INFO:teuthology.orchestra.run.smithi062.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.609 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.610 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.611 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.612 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.613 INFO:teuthology.orchestra.run.smithi062.stdout: "cross_origin_url": { 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cross_origin_url", 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.614 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "crt_file": { 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "crt_file", 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.615 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "debug": { 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "debug", 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.616 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "jwt_token_ttl": { 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "jwt_token_ttl", 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.617 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "28800", 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "key_file": { 2024-09-12T02:09:15.618 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "key_file", 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.619 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.620 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.621 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.622 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.623 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.624 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "motd": { 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "motd", 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.626 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "The message of the day", 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.627 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "server_addr": { 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_addr", 2024-09-12T02:09:15.628 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "::", 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.629 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "server_port": { 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_port", 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8080", 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.630 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "ssl": { 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssl", 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.631 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "ssl_server_port": { 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssl_server_port", 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.632 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8443", 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_behaviour": { 2024-09-12T02:09:15.633 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_behaviour", 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "redirect", 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "redirect" 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.634 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_error_status_code": { 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "500", 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "400", 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "599", 2024-09-12T02:09:15.635 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "url_prefix": { 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "url_prefix", 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.636 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.637 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "devicehealth", 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "enable_monitoring": { 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enable_monitoring", 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.638 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "monitor device health metrics", 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.640 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.641 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.642 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.643 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.644 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "mark_out_threshold": { 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mark_out_threshold", 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.645 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "2419200", 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "pool_name": { 2024-09-12T02:09:15.646 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pool_name", 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "device_health_metrics", 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.647 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "retention_period": { 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "retention_period", 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "15552000", 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:09:15.648 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "scrape_frequency": { 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "scrape_frequency", 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "86400", 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.649 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "self_heal": { 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "self_heal", 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.650 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:15.651 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.652 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "warn_threshold": { 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "warn_threshold", 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "7257600", 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:09:15.653 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "diskprediction_local", 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.654 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.655 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.657 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.658 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.659 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.660 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "predict_interval": { 2024-09-12T02:09:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "predict_interval", 2024-09-12T02:09:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.661 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "86400", 2024-09-12T02:09:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: "predictor_model": { 2024-09-12T02:09:15.662 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "predictor_model", 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "prophetstor", 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "600", 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.664 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "influx", 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": false, 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "batch_size": { 2024-09-12T02:09:15.665 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "batch_size", 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5000", 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.666 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "database": { 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "database", 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "ceph", 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:09:15.667 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": { 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "hostname", 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.668 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.669 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "30", 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "5", 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.670 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.671 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.672 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.673 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.674 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "password": { 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "password", 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:09:15.677 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "port": { 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "port", 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "8086", 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.678 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "InfluxDB server port", 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "ssl": { 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ssl", 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "false", 2024-09-12T02:09:15.679 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "threads": { 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "threads", 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.680 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "32", 2024-09-12T02:09:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:09:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.681 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "username": { 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "username", 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.682 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "verify_ssl": { 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "verify_ssl", 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "true", 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.683 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "insights", 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.684 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.685 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.686 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.687 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.688 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.689 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.690 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "iostat", 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.691 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.692 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.693 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.694 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.695 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.696 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.697 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "k8sevents", 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_event_retention_days": { 2024-09-12T02:09:15.698 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "7", 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.699 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "config_check_secs": { 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "config_check_secs", 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "10", 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:09:15.700 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.701 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.702 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.703 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.704 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.706 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.707 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "localpool", 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "failure_domain": { 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "failure_domain", 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "host", 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.708 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.709 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.710 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.711 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.712 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.713 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.714 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.715 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "min_size": { 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "min_size", 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.716 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "num_rep": { 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "num_rep", 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.717 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "3", 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.718 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_num": { 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pg_num", 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "128", 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.719 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "prefix": { 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "prefix", 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.720 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "subtree": { 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "subtree", 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "rack", 2024-09-12T02:09:15.721 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mds_autoscaler", 2024-09-12T02:09:15.722 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.723 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.724 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.725 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.726 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.727 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.728 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mirroring", 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.729 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.730 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.731 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.732 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.733 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.734 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.735 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "nfs", 2024-09-12T02:09:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.736 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.737 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.738 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.739 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.740 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.741 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.742 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "orchestrator", 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.743 INFO:teuthology.orchestra.run.smithi062.stdout: "fail_fs": { 2024-09-12T02:09:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "fail_fs", 2024-09-12T02:09:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:09:15.744 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.746 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.747 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.749 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "orchestrator": { 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "orchestrator", 2024-09-12T02:09:15.751 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "cephadm", 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "rook", 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "test_orchestrator" 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.752 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Orchestrator backend", 2024-09-12T02:09:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "osd_perf_query", 2024-09-12T02:09:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.753 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.754 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.755 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "osd_support", 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.760 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.761 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.762 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.763 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.764 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.765 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.766 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "pg_autoscaler", 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.767 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.768 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.769 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.770 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.771 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.772 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:15.773 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.774 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "threshold": { 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "threshold", 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "3.0", 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1.0", 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "scaling threshold", 2024-09-12T02:09:15.775 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "progress", 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.776 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_pg_recovery_event": { 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.777 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": { 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enabled", 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.778 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.779 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.780 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.781 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.782 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.783 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.784 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "max_completed_events": { 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_completed_events", 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.785 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "50", 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "sleep_interval": { 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "sleep_interval", 2024-09-12T02:09:15.786 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "5", 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.787 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "prometheus", 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "cache": { 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "cache", 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "exclude_perf_counters": { 2024-09-12T02:09:15.789 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "exclude_perf_counters", 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.790 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.791 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.792 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.793 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.794 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.795 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.796 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_stats_pools": { 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd_stats_pools", 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.797 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.798 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "300", 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "scrape_interval": { 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "scrape_interval", 2024-09-12T02:09:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "15.0", 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.800 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "server_addr": { 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_addr", 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "::", 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.801 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: "server_port": { 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_port", 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "9283", 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.802 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "stale_cache_strategy": { 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "stale_cache_strategy", 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "log", 2024-09-12T02:09:15.803 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_behaviour": { 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_behaviour", 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.804 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "default", 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: "default", 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: "error" 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.805 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "standby_error_status_code": { 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "standby_error_status_code", 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "500", 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "400", 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "599", 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.806 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd_support", 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.807 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.808 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.809 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.810 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.811 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.812 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.813 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: "max_concurrent_snap_create": { 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10", 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.814 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.815 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: "trash_purge_schedule": { 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "trash_purge_schedule", 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.816 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.817 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "restful", 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: "enable_auth": { 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enable_auth", 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.818 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: "key_file": { 2024-09-12T02:09:15.819 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "key_file", 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.820 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.821 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.822 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.823 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.824 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.825 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.826 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: "server_addr": { 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_addr", 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.827 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: "server_port": { 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "server_port", 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.828 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.829 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rgw", 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.830 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.831 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.832 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.833 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.834 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.835 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.836 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rook", 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.839 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.840 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.842 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "storage_class": { 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "storage_class", 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.843 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "local", 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.844 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "selftest", 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.845 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.846 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.847 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.848 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.849 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.850 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: "roption1": { 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "roption1", 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.851 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "roption2": { 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "roption2", 2024-09-12T02:09:15.852 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "xyz", 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.853 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption1": { 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption1", 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.854 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption2": { 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption2", 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.855 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption3": { 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption3", 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "float", 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.856 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption4": { 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption4", 2024-09-12T02:09:15.857 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.858 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption5": { 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption5", 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption6": { 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption6", 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.860 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "rwoption7": { 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rwoption7", 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.861 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "1", 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "42", 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: "testkey": { 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "testkey", 2024-09-12T02:09:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.863 INFO:teuthology.orchestra.run.smithi062.stdout: "testlkey": { 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "testlkey", 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.864 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "testnewline": { 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "testnewline", 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.865 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snap_schedule", 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.866 INFO:teuthology.orchestra.run.smithi062.stdout: "allow_m_granularity": { 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "allow_m_granularity", 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: "dump_on_update": { 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "dump_on_update", 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.868 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.869 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.870 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.872 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.873 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.874 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "stats", 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.875 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.876 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.877 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.878 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.879 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.880 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.881 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "status", 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.882 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.883 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.884 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.885 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.886 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.887 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.888 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "telegraf", 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: "address": { 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "address", 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.889 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:15.890 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "15", 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.891 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.892 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.893 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.894 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.895 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.897 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "telemetry", 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_basic": { 2024-09-12T02:09:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_basic", 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.899 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_crash": { 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_crash", 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:09:15.900 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_device": { 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_device", 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.901 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_ident": { 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_ident", 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.902 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "channel_perf": { 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "channel_perf", 2024-09-12T02:09:15.903 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.904 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "contact": { 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "contact", 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.905 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "description": { 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "description", 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.906 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: "device_url": { 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "device_url", 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.907 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": { 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "enabled", 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.908 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:15.909 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "24", 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "8", 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "last_opt_revision": { 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "last_opt_revision", 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "1", 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.911 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "leaderboard": { 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "leaderboard", 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.912 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "leaderboard_description": { 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "leaderboard_description", 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.913 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.915 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.916 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.916 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.916 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.916 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.916 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.916 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.916 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.916 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.916 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.916 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.917 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.918 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.918 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.918 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.918 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.918 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.918 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.918 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.918 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.918 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.918 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.919 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.920 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: "organization": { 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "organization", 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.921 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: "proxy": { 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "proxy", 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.922 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: "url": { 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "url", 2024-09-12T02:09:15.923 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.924 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "test_orchestrator", 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.925 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.926 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.928 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.929 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.930 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.931 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "volumes", 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.932 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.933 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.934 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.935 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.936 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: "max_concurrent_clones": { 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "max_concurrent_clones", 2024-09-12T02:09:15.938 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "4", 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.939 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "periodic_async_work": { 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "periodic_async_work", 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Periodically check for async work", 2024-09-12T02:09:15.940 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: "snapshot_clone_delay": { 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "0", 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.941 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.942 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.942 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:09:15.942 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.942 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.942 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.942 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.942 INFO:teuthology.orchestra.run.smithi062.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:09:15.942 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:09:15.942 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.942 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.943 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.943 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "True", 2024-09-12T02:09:15.943 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.943 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.943 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.943 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:09:15.943 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.943 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.943 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.943 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix", 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: "can_run": true, 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: "error_string": "", 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: "module_options": { 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: "discovery_interval": { 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "discovery_interval", 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "uint", 2024-09-12T02:09:15.944 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "100", 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "identifier": { 2024-09-12T02:09:15.945 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "identifier", 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.946 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "interval": { 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "interval", 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "secs", 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "60", 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.947 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: "log_level": { 2024-09-12T02:09:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_level", 2024-09-12T02:09:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.949 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster": { 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster", 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.950 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_cluster_level": { 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_cluster_level", 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.951 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "info", 2024-09-12T02:09:15.952 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.952 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.952 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [ 2024-09-12T02:09:15.952 INFO:teuthology.orchestra.run.smithi062.stdout: "", 2024-09-12T02:09:15.952 INFO:teuthology.orchestra.run.smithi062.stdout: "critical", 2024-09-12T02:09:15.952 INFO:teuthology.orchestra.run.smithi062.stdout: "debug", 2024-09-12T02:09:15.952 INFO:teuthology.orchestra.run.smithi062.stdout: "error", 2024-09-12T02:09:15.952 INFO:teuthology.orchestra.run.smithi062.stdout: "info", 2024-09-12T02:09:15.952 INFO:teuthology.orchestra.run.smithi062.stdout: "warning" 2024-09-12T02:09:15.952 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: "log_to_file": { 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "log_to_file", 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "bool", 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 1, 2024-09-12T02:09:15.953 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "False", 2024-09-12T02:09:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: "zabbix_host": { 2024-09-12T02:09:15.954 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix_host", 2024-09-12T02:09:15.955 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.955 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.955 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.955 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "", 2024-09-12T02:09:15.955 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.955 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.955 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.955 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.955 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.955 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.956 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.956 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.956 INFO:teuthology.orchestra.run.smithi062.stdout: "zabbix_port": { 2024-09-12T02:09:15.956 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix_port", 2024-09-12T02:09:15.956 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "int", 2024-09-12T02:09:15.956 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.956 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.956 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "10051", 2024-09-12T02:09:15.956 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.956 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.957 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.957 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.957 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.957 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.957 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.957 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.957 INFO:teuthology.orchestra.run.smithi062.stdout: "zabbix_sender": { 2024-09-12T02:09:15.957 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "zabbix_sender", 2024-09-12T02:09:15.957 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "str", 2024-09-12T02:09:15.957 INFO:teuthology.orchestra.run.smithi062.stdout: "level": "advanced", 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: "flags": 0, 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: "min": "", 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: "max": "", 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: "enum_allowed": [], 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: "desc": "", 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: "long_desc": "", 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: "see_also": [] 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.958 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.959 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.959 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.959 INFO:teuthology.orchestra.run.smithi062.stdout: "services": { 2024-09-12T02:09:15.959 INFO:teuthology.orchestra.run.smithi062.stdout: "dashboard": "https://172.21.15.62:8443/" 2024-09-12T02:09:15.959 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.959 INFO:teuthology.orchestra.run.smithi062.stdout: "always_on_modules": { 2024-09-12T02:09:15.959 INFO:teuthology.orchestra.run.smithi062.stdout: "octopus": [ 2024-09-12T02:09:15.959 INFO:teuthology.orchestra.run.smithi062.stdout: "balancer", 2024-09-12T02:09:15.959 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-09-12T02:09:15.959 INFO:teuthology.orchestra.run.smithi062.stdout: "devicehealth", 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: "orchestrator", 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscaler", 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: "progress", 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_support", 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: "status", 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: "telemetry", 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: "volumes" 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: "pacific": [ 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: "balancer", 2024-09-12T02:09:15.960 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: "devicehealth", 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: "orchestrator", 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscaler", 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: "progress", 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_support", 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: "status", 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: "telemetry", 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: "volumes" 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: "quincy": [ 2024-09-12T02:09:15.961 INFO:teuthology.orchestra.run.smithi062.stdout: "balancer", 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: "devicehealth", 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: "orchestrator", 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscaler", 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: "progress", 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_support", 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: "status", 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: "telemetry", 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: "volumes" 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.962 INFO:teuthology.orchestra.run.smithi062.stdout: "reef": [ 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: "balancer", 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: "devicehealth", 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: "orchestrator", 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscaler", 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: "progress", 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_support", 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: "status", 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: "telemetry", 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: "volumes" 2024-09-12T02:09:15.963 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "squid": [ 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "balancer", 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "crash", 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "devicehealth", 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "orchestrator", 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "pg_autoscaler", 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "progress", 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "rbd_support", 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "status", 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "telemetry", 2024-09-12T02:09:15.964 INFO:teuthology.orchestra.run.smithi062.stdout: "volumes" 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: "last_failure_osd_epoch": 95, 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: "active_clients": [ 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "devicehealth", 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:0", 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2265588801 2024-09-12T02:09:15.965 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "libcephsqlite", 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:0", 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 2565431747 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:15.966 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "rbd_support", 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:0", 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 460468651 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.967 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snap_schedule", 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:0", 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 675734673 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "snap_schedule", 2024-09-12T02:09:15.968 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:0", 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 370476011 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "volumes", 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: "addrvec": [ 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T02:09:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v2", 2024-09-12T02:09:15.970 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "172.21.15.62:0", 2024-09-12T02:09:15.970 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 604044935 2024-09-12T02:09:15.970 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.970 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:15.970 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:15.970 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-09-12T02:09:15.970 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T02:09:15.972 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:14 smithi077 ceph-mon[35095]: pgmap v312: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:09:15.972 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:14 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2352641992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:09:15.972 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:14 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4048387190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:09:15.972 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:14 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3092261599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T02:09:15.972 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:15 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4065179295' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:09:15.972 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:14 smithi107 ceph-mon[35463]: pgmap v312: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-12T02:09:15.973 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:14 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2352641992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:09:15.973 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:14 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4048387190' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:09:15.973 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:14 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3092261599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T02:09:15.973 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:15 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4065179295' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:09:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 -- 172.21.15.62:0/4065179295 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f25cc0a2d80 msgr2=0x7f25cc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f25cc0a2d80 0x7f25cc0a5240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f25e8101e40 tx=0x7f25d0005f90 comp rx=0 tx=0).stop 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 -- 172.21.15.62:0/4065179295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25e8103ad0 msgr2=0x7f25e819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25e8103ad0 0x7f25e819a460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f25d802a940 tx=0x7f25d8003b90 comp rx=0 tx=0).stop 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 -- 172.21.15.62:0/4065179295 shutdown_connections 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f25cc0a2d80 0x7f25cc0a5240 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25e8109b70 0x7f25e819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25e8104470 0x7f25e819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 --2- 172.21.15.62:0/4065179295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25e8103ad0 0x7f25e819a460 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 -- 172.21.15.62:0/4065179295 >> 172.21.15.62:0/4065179295 conn(0x7f25e80ff7d0 msgr2=0x7f25e80fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 -- 172.21.15.62:0/4065179295 shutdown_connections 2024-09-12T02:09:15.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:14.391+0000 7f25ed000640 1 -- 172.21.15.62:0/4065179295 wait complete. 2024-09-12T02:09:15.980 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T02:09:15.981 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T02:09:15.981 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:15 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4065179295' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:09:16.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:16 smithi062 ceph-mon[30666]: pgmap v313: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-12T02:09:16.367 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:16.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:16 smithi107 ceph-mon[35463]: pgmap v313: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-12T02:09:16.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:16 smithi077 ceph-mon[35095]: pgmap v313: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-12T02:09:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T02:09:17.011 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:17.011 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:17.011 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:17.011 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:17.011 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:17.011 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.004232222, 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.001089135, 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 222, 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 209, 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 1582656, 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 127712, 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.047993633, 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.016439909, 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.043244776, 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 209, 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.023134805, 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000110692 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:17.014 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 1582656, 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 127712 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 2, 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 158, 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 184944, 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:17.015 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.018795924, 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.012734848, 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.002594153, 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 155, 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.016188409, 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000104441 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 184944 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 0, 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:17.018 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:17.019 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 150008, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 31, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-09-12T02:09:17.020 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 2, 2024-09-12T02:09:17.021 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 220, 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 1548936, 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:17.022 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 220, 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 220, 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 1548936, 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:17.023 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T02:09:17.978 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-12T02:09:17.978 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-12T02:09:17.978 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-12T02:09:17.978 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T02:09:17.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T02:09:18.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:17 smithi107 ceph-mon[35463]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:09:18.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:17 smithi107 ceph-mon[35463]: pgmap v315: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T02:09:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:17 smithi077 ceph-mon[35095]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:09:18.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:17 smithi077 ceph-mon[35095]: pgmap v315: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T02:09:18.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:17 smithi062 ceph-mon[30666]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:09:18.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:17 smithi062 ceph-mon[30666]: pgmap v315: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T02:09:18.356 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:19.068 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T02:09:19.068 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:19.068 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:19.068 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:19.068 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:19.068 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:19.068 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:19.068 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:19.068 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.003293252, 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.000536129, 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:19.069 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 229, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 216, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 1584624, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 131712, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.056848859, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.022544240, 2024-09-12T02:09:19.070 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.049182553, 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 216, 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.024032620, 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000111262 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 1584624, 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 131712 2024-09-12T02:09:19.071 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 2, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 163, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 185824, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.022305502, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.015472421, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.003022326, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:19.072 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 160, 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.013406280, 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000083789 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 185824 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 0, 2024-09-12T02:09:19.073 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:19.074 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:19.075 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 149762, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 32, 2024-09-12T02:09:19.076 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:19.077 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 2, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T02:09:19.078 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 227, 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 1549910, 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 227, 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 227, 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 1549910, 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:19.079 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:19.080 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T02:09:19.859 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-12T02:09:19.860 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-12T02:09:19.860 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-12T02:09:19.860 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T02:09:19.861 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T02:09:20.248 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:20.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:20 smithi062 ceph-mon[30666]: pgmap v316: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 5 op/s 2024-09-12T02:09:20.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:20 smithi107 ceph-mon[35463]: pgmap v316: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 5 op/s 2024-09-12T02:09:20.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:20 smithi077 ceph-mon[35095]: pgmap v316: 129 pgs: 129 active+clean; 2.2 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 5 op/s 2024-09-12T02:09:20.890 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T02:09:20.890 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:20.890 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:20.890 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:20.890 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:20.890 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:20.890 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:20.890 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.003666575, 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.000541588, 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 225, 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 212, 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 1583536, 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 129152, 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:20.892 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.056490151, 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.022465442, 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.048828275, 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 212, 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.022779668, 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000107451 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:20.893 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 1583536, 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 129152 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 2, 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 160, 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 185296, 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:20.894 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.020497269, 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.014111384, 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.002735498, 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 157, 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.020224725, 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000128819 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.895 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 185296 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 0, 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:20.896 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:20.897 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:20.898 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 148994, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 31, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-09-12T02:09:20.899 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:20.900 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:20.900 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:20.900 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:20.900 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:20.900 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 0, 2024-09-12T02:09:20.900 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:20.900 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:20.900 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:20.900 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 2, 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T02:09:20.901 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 223, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 1549390, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 223, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 223, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 1549390, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:20.902 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:20.903 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:20.903 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:20.903 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T02:09:21.613 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-12T02:09:21.614 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-12T02:09:21.614 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-12T02:09:21.614 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T02:09:21.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T02:09:21.997 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:22.326 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:22 smithi062 ceph-mon[30666]: pgmap v317: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 311 B/s wr, 5 op/s 2024-09-12T02:09:22.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:22 smithi107 ceph-mon[35463]: pgmap v317: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 311 B/s wr, 5 op/s 2024-09-12T02:09:22.464 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:22 smithi077 ceph-mon[35095]: pgmap v317: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 311 B/s wr, 5 op/s 2024-09-12T02:09:22.583 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T02:09:22.583 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:22.583 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 227, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 216, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 1582176, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 132544, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.049276515, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.016749459, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.042461068, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 215, 2024-09-12T02:09:22.584 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.016388696, 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000076226 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 1582176, 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 132544 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:22.585 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 2, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 164, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 186000, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.021328130, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.014305804, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.003225840, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 161, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.019149959, 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000118943 2024-09-12T02:09:22.586 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 186000 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_messages": 4, 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages": 4, 2024-09-12T02:09:22.587 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_bytes": 2992, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_bytes": 448, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_total_time": 0.003740257, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_send_time": 0.000081795, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_recv_time": 0.003576524, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 3, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.006154546, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.002051515 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.588 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "cct": { 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "total_workers": 0, 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "unhealthy_workers": 0 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "mempool": { 2024-09-12T02:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:22.590 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:22.591 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_items": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_bytes": 149745, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_anon_items": 31, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:22.592 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_bytes": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_items": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_items": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "pgmap_items": 0, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:22.593 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_co_items": 2, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_1_items": 0, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "unittest_2_items": 0 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 0, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "max": 104857600, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "get_started": 0, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "get": 229, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "get_sum": 1550170, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:22.594 INFO:teuthology.orchestra.run.smithi062.stdout: "get_or_fail_success": 229, 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "take": 0, 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "take_sum": 0, 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "put": 229, 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "put_sum": 1550170, 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "wait": { 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "avgcount": 0, 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "sum": 0.000000000, 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: "avgtime": 0.000000000 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T02:09:22.595 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T02:09:23.330 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-12T02:09:23.330 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-12T02:09:23.330 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-12T02:09:23.330 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T02:09:23.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T02:09:23.588 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:09:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-12T02:09:24.093 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:24.093 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 1173, 2024-09-12T02:09:24.093 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 640, 2024-09-12T02:09:24.093 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 421038, 2024-09-12T02:09:24.093 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 1249939, 2024-09-12T02:09:24.093 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 12, 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 5, 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.130043070, 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.033716168, 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.044948085, 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.046057818, 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 638, 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.126249332, 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000197882 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 805, 2024-09-12T02:09:24.094 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000164474, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000204 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 297488, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 87536 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 410, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 268, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 144409, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 218715, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 10, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 7, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.037990165, 2024-09-12T02:09:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.009872224, 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.014100072, 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.012194034, 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 266, 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.080762164, 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000303617 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 206, 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000051017, 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000247 2024-09-12T02:09:24.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 89440, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 145664 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 1358, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 837, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 2017614, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 662915, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 13, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 6, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.174118952, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.045791160, 2024-09-12T02:09:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.100383794, 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.046991754, 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 836, 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.318919403, 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000381482 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 400, 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000153124, 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000382 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 1676848, 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 480800 2024-09-12T02:09:24.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 1, 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-MDSRank": { 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 469, 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.094039709, 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000200511 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.099 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-PurgeQueue": { 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 86, 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.002946552, 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000034262 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: "request": 182, 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: "reply": 182, 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: "reply_latency": { 2024-09-12T02:09:24.100 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 182, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.149879290, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000823512 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_reply": 0, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "forward": 0, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_complete": 0, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_keys": 0, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_commit": 12, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_split": 0, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_merge": 0, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes": 39, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_top": 2, 2024-09-12T02:09:24.101 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_bottom": 37, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pin_tail": 0, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pinned": 36, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_expired": 0, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_with_caps": 3, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": 4, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "subtrees": 2, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse": 232, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_hit": 224, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_forward": 0, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_discover": 0, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_remote_ino": 0, 2024-09-12T02:09:24.102 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_lock": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "load_cent": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "q": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "exported": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "exported_inodes": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "imported": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "imported_inodes": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_dir_fetch": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_peer_discover": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rfiles": 4, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rbytes": 234, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rsnaps": 6, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:09:24.103 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_set_tag": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_file_inodes": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_revoke": 15, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_grant": 33, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:09:24.104 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps": 109, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps_dirty": 88, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_cap_release": 3, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "process_request_cap_release": 27 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache": { 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update": 0, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update_receipt": 0, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_try_discover": 0, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_send_discover": 0, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_handle_discover": 0, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays": 2, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_delayed": 0, 2024-09-12T02:09:24.105 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:09:24.106 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_created": 6, 2024-09-12T02:09:24.106 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_enqueued": 4, 2024-09-12T02:09:24.106 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_reintegrated": 0, 2024-09-12T02:09:24.106 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_migrated": 0, 2024-09-12T02:09:24.106 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_processing": 0, 2024-09-12T02:09:24.106 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:09:24.106 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_started": 0, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_completed": 0, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_exportdir": 0, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_flush": 0, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragstats": 0, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_inodestats": 0 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log": { 2024-09-12T02:09:24.107 INFO:teuthology.orchestra.run.smithi077.stdout: "evlrg": 0, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "evadd": 236, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "evex": 0, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "evtrm": 0, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "ev": 236, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "evexg": 0, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "evexd": 0, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "segadd": 2, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "segex": 0, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "segtrm": 0, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "seg": 2, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "segmjr": 2, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "segexg": 0, 2024-09-12T02:09:24.108 INFO:teuthology.orchestra.run.smithi077.stdout: "segexd": 0, 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "expos": 4194304, 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "wrpos": 5163778, 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "rdpos": 0, 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "jlat": { 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 199, 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.371185118, 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001865251 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "replayed": 0 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_mem": { 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "ino": 29, 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "ino+": 33, 2024-09-12T02:09:24.109 INFO:teuthology.orchestra.run.smithi077.stdout: "ino-": 4, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "dir": 20, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "dir+": 20, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "dir-": 0, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "dn": 39, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "dn+": 43, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "dn-": 4, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "cap": 4, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "cap+": 26, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "cap-": 22, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "rss": 52632, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "heap": 231712 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.110 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_server": { 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_client_request": 210, 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_server_request": 0, 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_request": 182, 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_session": 35, 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_peer_request": 0, 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "req_create_latency": { 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 8, 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.006562626, 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000820328 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getattr_latency": { 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 115, 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.024199135, 2024-09-12T02:09:24.111 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000210427 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getfilelock_latency": { 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "req_link_latency": { 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookup_latency": { 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 4, 2024-09-12T02:09:24.112 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.001922536, 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000480634 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookuphash_latency": { 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupino_latency": { 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2, 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000609066, 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000304533 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.113 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupname_latency": { 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupparent_latency": { 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupsnap_latency": { 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.115 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lssnap_latency": { 2024-09-12T02:09:24.115 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 10, 2024-09-12T02:09:24.115 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.001824540, 2024-09-12T02:09:24.115 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000182454 2024-09-12T02:09:24.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.115 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mkdir_latency": { 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 8, 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.012211248, 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001526406 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mknod_latency": { 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mksnap_latency": { 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 10, 2024-09-12T02:09:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.041303198, 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.004130319 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: "req_open_latency": { 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 1, 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000306344, 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000306344 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: "req_readdir_latency": { 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2, 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.003080925, 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001540462 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.117 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rename_latency": { 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2, 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.002106837, 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001053418 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "req_renamesnap_latency": { 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "req_snapdiff_latency": { 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.118 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.119 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmdir_latency": { 2024-09-12T02:09:24.119 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2, 2024-09-12T02:09:24.119 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.011470334, 2024-09-12T02:09:24.119 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.005735167 2024-09-12T02:09:24.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.119 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmsnap_latency": { 2024-09-12T02:09:24.119 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 4, 2024-09-12T02:09:24.119 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.013921554, 2024-09-12T02:09:24.119 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.003480388 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmxattr_latency": { 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setattr_latency": { 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2, 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.001790240, 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000895120 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.120 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setdirlayout_latency": { 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setfilelock_latency": { 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setlayout_latency": { 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.121 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setxattr_latency": { 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 8, 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.020970700, 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.002621337 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: "req_symlink_latency": { 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.122 INFO:teuthology.orchestra.run.smithi077.stdout: "req_unlink_latency": { 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 4, 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.007600007, 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001900001 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getvxattr_latency": { 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sessions": { 2024-09-12T02:09:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: "session_count": 2, 2024-09-12T02:09:24.124 INFO:teuthology.orchestra.run.smithi077.stdout: "session_add": 6, 2024-09-12T02:09:24.124 INFO:teuthology.orchestra.run.smithi077.stdout: "session_remove": 4, 2024-09-12T02:09:24.124 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_open": 2, 2024-09-12T02:09:24.124 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_stale": 0, 2024-09-12T02:09:24.124 INFO:teuthology.orchestra.run.smithi077.stdout: "total_load": 27, 2024-09-12T02:09:24.124 INFO:teuthology.orchestra.run.smithi077.stdout: "average_load": 13, 2024-09-12T02:09:24.124 INFO:teuthology.orchestra.run.smithi077.stdout: "avg_session_uptime": 586, 2024-09-12T02:09:24.124 INFO:teuthology.orchestra.run.smithi077.stdout: "mdthresh_evicted": 0 2024-09-12T02:09:24.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.124 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:24.125 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:24.126 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:24.127 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 339856, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 142, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 616, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 7, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 9704, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 196, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:24.128 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 133133, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 1130, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter": { 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "op_active": 0, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "op_laggy": 0, 2024-09-12T02:09:24.129 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send": 865, 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send_bytes": 987188, 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "op_resend": 37, 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "op_reply": 865, 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "op_latency": { 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 865, 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 19.933580623, 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.023044601 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "op_inflight": 0, 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "oplen_avg": { 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 865, 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 913 2024-09-12T02:09:24.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "op": 865, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "op_r": 2, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "op_w": 863, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "op_rmw": 0, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "op_pg": 0, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_stat": 0, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_create": 11, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_read": 2, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_write": 201, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writefull": 32, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writesame": 0, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_append": 0, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_zero": 0, 2024-09-12T02:09:24.131 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_truncate": 0, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_delete": 583, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_mapext": 0, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_sparse_read": 0, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_clonerange": 0, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_getxattr": 0, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_setxattr": 22, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_rmxattr": 0, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_call": 0, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_watch": 0, 2024-09-12T02:09:24.132 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_notify": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_other": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_active": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_send": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_resend": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_ping": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_active": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_send": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_resend": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_active": 0, 2024-09-12T02:09:24.133 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_send": 0, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_resend": 0, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_active": 0, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_send": 0, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_resend": 0, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "command_active": 0, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "command_send": 0, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "command_resend": 0, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "map_epoch": 103, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "map_full": 0, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "map_inc": 19, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_sessions": 12, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_open": 12, 2024-09-12T02:09:24.134 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_close": 0, 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_laggy": 0, 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_wr": 52, 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_rd": 0, 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_del": 10 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "oft": { 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_objs": 1, 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_updates": 0, 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_removes": 0 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "osd-slow-ops": { 2024-09-12T02:09:24.135 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_ops_count": 0 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: "purge_queue": { 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops": 0, 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops_high_water": 65, 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing": 0, 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_high_water": 3, 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed_ops": 71, 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed": 4, 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_item_in_journal": 0 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 2937, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 2267134, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 2937, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2937, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 2267134, 2024-09-12T02:09:24.137 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_bytes": { 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:24.138 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 865, 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 987656, 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 865, 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 987656, 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_ops": { 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 1024, 2024-09-12T02:09:24.139 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-09-12T02:09:24.140 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-09-12T02:09:24.140 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-09-12T02:09:24.140 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:24.140 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:24.140 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 865, 2024-09-12T02:09:24.140 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 865, 2024-09-12T02:09:24.140 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 865, 2024-09-12T02:09:24.140 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 865, 2024-09-12T02:09:24.140 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 4, 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 468, 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:24.141 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 4, 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2, 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 468, 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle-0x56320e4d2960": { 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-09-12T02:09:24.142 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 236, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 969474, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 236, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 199, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 969474, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:24.143 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:24.144 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:24.144 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:24.144 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-12T02:09:24.239 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:24 smithi077 ceph-mon[35095]: pgmap v318: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 5 op/s 2024-09-12T02:09:24.341 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:24 smithi062 ceph-mon[30666]: pgmap v318: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 5 op/s 2024-09-12T02:09:24.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:24 smithi107 ceph-mon[35463]: pgmap v318: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 5 op/s 2024-09-12T02:09:24.901 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-12T02:09:24.902 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-12T02:09:24.902 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-12T02:09:24.902 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T02:09:24.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T02:09:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:25 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:25 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:25.342 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:25 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:25.360 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:25 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:25.360 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:25 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:25.360 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:25 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:25.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:25 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:25.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:25 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:25.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:25 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:25.836 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:09:26.347 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-12T02:09:26.348 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:26.348 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 226, 2024-09-12T02:09:26.348 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 215, 2024-09-12T02:09:26.348 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 1581904, 2024-09-12T02:09:26.348 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 131904, 2024-09-12T02:09:26.349 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:26.349 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:26.349 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.043394307, 2024-09-12T02:09:26.349 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.015280953, 2024-09-12T02:09:26.350 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.040764049, 2024-09-12T02:09:26.350 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:26.350 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:26.350 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 214, 2024-09-12T02:09:26.350 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.013975130, 2024-09-12T02:09:26.351 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000065304 2024-09-12T02:09:26.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.351 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:26.351 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:26.352 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:26.352 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:26.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.352 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 1581904, 2024-09-12T02:09:26.352 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 131904 2024-09-12T02:09:26.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.353 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:26.353 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 2, 2024-09-12T02:09:26.353 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 164, 2024-09-12T02:09:26.353 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:09:26.354 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 186000, 2024-09-12T02:09:26.354 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:26.354 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:26.354 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.011757516, 2024-09-12T02:09:26.354 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.007579054, 2024-09-12T02:09:26.355 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.001765881, 2024-09-12T02:09:26.355 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:26.355 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:26.355 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 161, 2024-09-12T02:09:26.356 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.017293318, 2024-09-12T02:09:26.356 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000107411 2024-09-12T02:09:26.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.357 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:26.357 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:26.357 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:26.357 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:26.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.358 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:26.358 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 186000 2024-09-12T02:09:26.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.359 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:26.359 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 4, 2024-09-12T02:09:26.359 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 4, 2024-09-12T02:09:26.360 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 2992, 2024-09-12T02:09:26.360 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 448, 2024-09-12T02:09:26.360 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:26.360 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.002333348, 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.000037367, 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.002273692, 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 3, 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.004116190, 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001372063 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:26.361 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 0, 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-09-12T02:09:26.362 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:26.363 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 148714, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 30, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 2, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 228, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 1550040, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:26.367 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 228, 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 228, 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 1550040, 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:26.368 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: pgmap v319: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:26 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: pgmap v319: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:09:26.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:26.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:26.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:26 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: pgmap v319: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-12T02:09:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:26.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:26 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.064 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-12T02:09:27.064 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-12T02:09:27.064 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-12T02:09:27.064 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T02:09:27.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T02:09:27.331 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:09:27.719 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi107 to 175.9M 2024-09-12T02:09:27.719 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: Unable to set osd_memory_target on smithi107 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-09-12T02:09:27.719 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.719 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.719 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.719 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.720 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.720 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.720 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.720 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.720 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.720 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.720 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.720 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:27 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi107 to 175.9M 2024-09-12T02:09:27.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: Unable to set osd_memory_target on smithi107 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-09-12T02:09:27.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:27 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-12T02:09:27.843 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:27.843 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.001222368, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.000198043, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:27.844 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:27.845 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 228, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 215, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 1584352, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 131072, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.043880080, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.015684609, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.040593018, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 215, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.018226938, 2024-09-12T02:09:27.846 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000084776 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 1584352, 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 131072 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 2, 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 162, 2024-09-12T02:09:27.847 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 185648, 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.010803103, 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.006999258, 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.001778992, 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 159, 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.014697905, 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000092439 2024-09-12T02:09:27.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 185648 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 0, 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.849 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:27.850 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:27.851 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:27.852 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:27.852 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:27.852 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:27.852 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:27.852 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:27.852 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:27.852 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:27.852 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-09-12T02:09:27.852 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 149057, 2024-09-12T02:09:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 32, 2024-09-12T02:09:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-09-12T02:09:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-09-12T02:09:27.853 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:27.854 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:27.854 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:27.854 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:27.854 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:27.854 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 0, 2024-09-12T02:09:27.854 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:27.854 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:27.854 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:27.854 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 2, 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-09-12T02:09:27.855 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 226, 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 1549780, 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 226, 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 226, 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 1549780, 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:27.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:27.857 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:27.857 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-12T02:09:27.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi107 to 175.9M 2024-09-12T02:09:27.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: Unable to set osd_memory_target on smithi107 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:27.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:27 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:28.538 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-09-12T02:09:28.538 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-09-12T02:09:28.538 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-09-12T02:09:28.538 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T02:09:28.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T02:09:28.780 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:09:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: pgmap v320: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 203 B/s wr, 2 op/s 2024-09-12T02:09:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi062 to 176.4M 2024-09-12T02:09:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: Unable to set osd_memory_target on smithi062 to 185045504: error parsing value: Value '185045504' is below minimum 939524096 2024-09-12T02:09:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:28.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:28.843 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:28 smithi062 ceph-mon[30666]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:28.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: pgmap v320: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 203 B/s wr, 2 op/s 2024-09-12T02:09:28.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi062 to 176.4M 2024-09-12T02:09:28.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: Unable to set osd_memory_target on smithi062 to 185045504: error parsing value: Value '185045504' is below minimum 939524096 2024-09-12T02:09:28.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:28.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:28.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:28 smithi077 ceph-mon[35095]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:28.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: pgmap v320: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 203 B/s wr, 2 op/s 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi062 to 176.4M 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: Unable to set osd_memory_target on smithi062 to 185045504: error parsing value: Value '185045504' is below minimum 939524096 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:28.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:28.955 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:28 smithi107 ceph-mon[35463]: from='mgr.25070 ' entity='mgr.x' 2024-09-12T02:09:29.273 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-12T02:09:29.273 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:29.273 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 233, 2024-09-12T02:09:29.273 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 220, 2024-09-12T02:09:29.273 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 1585712, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 134272, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.044689344, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.014942976, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.043511469, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 220, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.018646341, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000084756 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.274 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 1585712, 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 134272 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 2, 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 166, 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:09:29.275 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 186352, 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.011331942, 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.007337279, 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.001759054, 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 163, 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.020477258, 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000125627 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:29.276 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 186352 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:29.277 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.000303991, 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.000238121, 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:29.278 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 0, 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:29.279 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:29.280 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:29.281 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 148731, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 31, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:29.282 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 2, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-09-12T02:09:29.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 231, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 1550430, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 231, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 231, 2024-09-12T02:09:29.284 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 1550430, 2024-09-12T02:09:29.285 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-09-12T02:09:29.285 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-09-12T02:09:29.285 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-09-12T02:09:29.285 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-09-12T02:09:29.285 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:29.285 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-12T02:09:29.285 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-12T02:09:29.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:29 smithi062 ceph-mon[30666]: Adjusting osd_memory_target on smithi077 to 176.0M 2024-09-12T02:09:29.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:29 smithi062 ceph-mon[30666]: Unable to set osd_memory_target on smithi077 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-12T02:09:29.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:29 smithi107 ceph-mon[35463]: Adjusting osd_memory_target on smithi077 to 176.0M 2024-09-12T02:09:29.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:29 smithi107 ceph-mon[35463]: Unable to set osd_memory_target on smithi077 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-12T02:09:29.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:29 smithi077 ceph-mon[35095]: Adjusting osd_memory_target on smithi077 to 176.0M 2024-09-12T02:09:29.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:29 smithi077 ceph-mon[35095]: Unable to set osd_memory_target on smithi077 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-12T02:09:30.082 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-12T02:09:30.082 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-12T02:09:30.082 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-12T02:09:30.082 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T02:09:30.083 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T02:09:30.340 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:09:30.747 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:30 smithi107 ceph-mon[35463]: pgmap v321: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:09:30.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:30 smithi062 ceph-mon[30666]: pgmap v321: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:09:30.872 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T02:09:30.872 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:30.872 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:30.872 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:30.872 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:30.872 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:30.872 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:30.872 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:30.872 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.001062585, 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.000165310, 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:30.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 2, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 164, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 186000, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.011118001, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.007349097, 2024-09-12T02:09:30.874 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.001588341, 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 161, 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.013440603, 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000083482 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.875 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 186000 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 230, 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 217, 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 1584896, 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 132352, 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.044274357, 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.015361570, 2024-09-12T02:09:30.876 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.042377719, 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 217, 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.018345803, 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000084542 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.877 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 1584896, 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 132352 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 0, 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:30.878 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:30.879 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:30.880 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 148994, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 31, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-09-12T02:09:30.881 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 2, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:30.882 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 228, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 1550040, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 228, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-09-12T02:09:30.883 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 228, 2024-09-12T02:09:30.884 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 1550040, 2024-09-12T02:09:30.884 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-09-12T02:09:30.884 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:30.884 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:30.884 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:30.884 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:30.884 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:30.884 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T02:09:30.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:30 smithi077 ceph-mon[35095]: pgmap v321: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-12T02:09:31.688 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-12T02:09:31.688 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-12T02:09:31.688 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-12T02:09:31.688 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T02:09:31.688 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T02:09:31.951 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:09:32.501 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T02:09:32.501 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:32.501 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 4, 2024-09-12T02:09:32.501 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 4, 2024-09-12T02:09:32.501 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 2992, 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 448, 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.002888574, 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.000034443, 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.002079974, 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 3, 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.003864511, 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.001288170 2024-09-12T02:09:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 2, 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 165, 2024-09-12T02:09:32.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 186176, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.011422784, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.007596281, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.001604913, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 162, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.020620168, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000127284 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 186176 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 227, 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 216, 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 1582176, 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 132544, 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.042960929, 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.015229718, 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.042370202, 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 215, 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.013590066, 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000063209 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:32.506 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 1582176, 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 132544 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 0, 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:32.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:32.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:32.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-09-12T02:09:32.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:32.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:32.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:32.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:32.510 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 148995, 2024-09-12T02:09:32.510 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 31, 2024-09-12T02:09:32.510 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:32.510 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:32.511 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 2, 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-09-12T02:09:32.512 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 229, 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 1550170, 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 229, 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 229, 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 1550170, 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-09-12T02:09:32.513 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:32.514 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:32.514 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:32.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:32.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:32.514 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T02:09:32.703 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:32 smithi107 ceph-mon[35463]: pgmap v322: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:09:32.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:32 smithi062 ceph-mon[30666]: pgmap v322: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:09:32.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:32 smithi077 ceph-mon[35095]: pgmap v322: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-12T02:09:33.171 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-12T02:09:33.171 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-12T02:09:33.171 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-12T02:09:33.171 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T02:09:33.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T02:09:33.417 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:09:34.031 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T02:09:34.031 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:34.031 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 248, 2024-09-12T02:09:34.031 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 234, 2024-09-12T02:09:34.031 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 1607644, 2024-09-12T02:09:34.031 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 134958, 2024-09-12T02:09:34.031 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.045303569, 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.015225946, 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.042904334, 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000055614, 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 234, 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.018478407, 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000078967 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.032 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 1607376, 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 134640 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 1572, 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 1733, 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 1433938, 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 938025, 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 7, 2024-09-12T02:09:34.033 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 5, 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.162448924, 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.055318563, 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.043010286, 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.048341616, 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1730, 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.077626182, 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000044870 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.034 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 438704 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 734, 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 736, 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 181256, 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 233428, 2024-09-12T02:09:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 4, 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.072724645, 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.026585294, 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.015943823, 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.023224810, 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 734, 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.033175572, 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000045198 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:34.036 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 1, 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-MDSRank": { 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-09-12T02:09:34.037 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 3775, 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.105605104, 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000027974 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-PurgeQueue": { 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:34.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "request": 0, 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "reply": 0, 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "reply_latency": { 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_reply": 0, 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "forward": 0, 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_complete": 0, 2024-09-12T02:09:34.039 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_keys": 0, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_commit": 0, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_split": 0, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_merge": 0, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes": 31, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_top": 0, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_bottom": 31, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pin_tail": 0, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pinned": 31, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_expired": 0, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_with_caps": 0, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": 0, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "subtrees": 2, 2024-09-12T02:09:34.040 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_hit": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_forward": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_discover": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_remote_ino": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_lock": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "load_cent": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "q": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "exported": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "exported_inodes": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "imported": 0, 2024-09-12T02:09:34.041 INFO:teuthology.orchestra.run.smithi107.stdout: "imported_inodes": 0, 2024-09-12T02:09:34.042 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_dir_fetch": 0, 2024-09-12T02:09:34.042 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:09:34.042 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_peer_discover": 0, 2024-09-12T02:09:34.042 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rfiles": 4, 2024-09-12T02:09:34.042 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rbytes": 234, 2024-09-12T02:09:34.042 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rsnaps": 6, 2024-09-12T02:09:34.042 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:09:34.042 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_set_tag": 0, 2024-09-12T02:09:34.042 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:09:34.042 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_file_inodes": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:09:34.043 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_cap_release": 0, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "process_request_cap_release": 0 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_cache": { 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update": 0, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update_receipt": 0, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_try_discover": 0, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_send_discover": 0, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_handle_discover": 0, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays": 0, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_delayed": 0, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_created": 0, 2024-09-12T02:09:34.044 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_enqueued": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_reintegrated": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_migrated": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_processing": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_started": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_completed": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_exportdir": 0, 2024-09-12T02:09:34.045 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_flush": 0, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragstats": 0, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_inodestats": 0 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_log": { 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "evlrg": 0, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "evadd": 0, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "evex": 0, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "evtrm": 0, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "ev": 236, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "evexg": 0, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "evexd": 0, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "segadd": 0, 2024-09-12T02:09:34.046 INFO:teuthology.orchestra.run.smithi107.stdout: "segex": 0, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "segtrm": 0, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "seg": 2, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "segmjr": 2, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "segexg": 0, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "segexd": 0, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "expos": 4194304, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "wrpos": 5163778, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "rdpos": 5163642, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "jlat": { 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "replayed": 236 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_mem": { 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "ino": 20, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "ino+": 24, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "ino-": 4, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "dir": 11, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "dir+": 11, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "dir-": 0, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "dn": 31, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "dn+": 31, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "dn-": 0, 2024-09-12T02:09:34.048 INFO:teuthology.orchestra.run.smithi107.stdout: "cap": 0, 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "cap+": 0, 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "cap-": 0, 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "rss": 48476, 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "heap": 215328 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_server": { 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_client_request": 0, 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_server_request": 0, 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_request": 0, 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_session": 0, 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_peer_request": 0, 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "req_create_latency": { 2024-09-12T02:09:34.049 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getattr_latency": { 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getfilelock_latency": { 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.050 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: "req_link_latency": { 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookuphash_latency": { 2024-09-12T02:09:34.051 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupino_latency": { 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupname_latency": { 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupparent_latency": { 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupsnap_latency": { 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lssnap_latency": { 2024-09-12T02:09:34.053 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.054 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.054 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.054 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mkdir_latency": { 2024-09-12T02:09:34.054 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mknod_latency": { 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mksnap_latency": { 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.055 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: "req_open_latency": { 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: "req_readdir_latency": { 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rename_latency": { 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: "req_renamesnap_latency": { 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: "req_snapdiff_latency": { 2024-09-12T02:09:34.057 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmdir_latency": { 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmsnap_latency": { 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.058 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmxattr_latency": { 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setattr_latency": { 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setdirlayout_latency": { 2024-09-12T02:09:34.059 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setlayout_latency": { 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.060 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setxattr_latency": { 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "req_symlink_latency": { 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "req_unlink_latency": { 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.061 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getvxattr_latency": { 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_sessions": { 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: "session_count": 2, 2024-09-12T02:09:34.062 INFO:teuthology.orchestra.run.smithi107.stdout: "session_add": 6, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "session_remove": 4, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_open": 4, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_stale": 0, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "total_load": 0, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "average_load": 0, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "avg_session_uptime": 3330, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "mdthresh_evicted": 0 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:34.063 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:34.064 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:34.065 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 197784, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 64, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-09-12T02:09:34.066 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 9704, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 196, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 92549, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 760, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:34.067 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "objecter": { 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "op_active": 0, 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "op_laggy": 0, 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send": 2305, 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send_bytes": 26, 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "op_resend": 4, 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "op_reply": 2305, 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "op_latency": { 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2305, 2024-09-12T02:09:34.068 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 1.063980726, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000461596 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "op_inflight": 0, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "oplen_avg": { 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2305, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 2306 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "op": 2305, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "op_r": 2305, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "op_w": 0, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "op_rmw": 0, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "op_pg": 0, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_stat": 1458, 2024-09-12T02:09:34.069 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_create": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_read": 844, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_write": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writefull": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writesame": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_append": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_zero": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_truncate": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_delete": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_mapext": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_sparse_read": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_clonerange": 0, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_getxattr": 2, 2024-09-12T02:09:34.070 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_setxattr": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_rmxattr": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_call": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_watch": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_notify": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_other": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_active": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_send": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_resend": 0, 2024-09-12T02:09:34.071 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_ping": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_active": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_send": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_resend": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_active": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_send": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_resend": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_active": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_send": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_resend": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "command_active": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "command_send": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "command_resend": 0, 2024-09-12T02:09:34.072 INFO:teuthology.orchestra.run.smithi107.stdout: "map_epoch": 103, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "map_full": 0, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "map_inc": 11, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_sessions": 6, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_open": 6, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_close": 0, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_laggy": 0, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_wr": 0, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_rd": 2, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_del": 0 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "oft": { 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_objs": 0, 2024-09-12T02:09:34.073 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_updates": 0, 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_removes": 0 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "osd-slow-ops": { 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_ops_count": 0 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "purge_queue": { 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops": 0, 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing": 0, 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_high_water": 0, 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed_ops": 0, 2024-09-12T02:09:34.074 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed": 0, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_item_in_journal": 0 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 2550, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 2977873, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 2550, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-09-12T02:09:34.075 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 2550, 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 2977873, 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_bytes": { 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-09-12T02:09:34.076 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 2305, 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 969484, 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 2305, 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 969484, 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_ops": { 2024-09-12T02:09:34.077 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 1024, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 2305, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 2305, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 2305, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 2305, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.078 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.079 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.079 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:34.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.079 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:09:34.079 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-09-12T02:09:34.079 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-09-12T02:09:34.079 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-09-12T02:09:34.079 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-09-12T02:09:34.079 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-09-12T02:09:34.079 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle-0x55a339216b40": { 2024-09-12T02:09:34.080 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:34.081 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:34.082 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:34.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:34.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:34.082 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T02:09:34.702 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:34 smithi107 ceph-mon[35463]: pgmap v323: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:34.728 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-12T02:09:34.728 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:09:34.728 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:09:34.728 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T02:09:34.728 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T02:09:34.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:34 smithi062 ceph-mon[30666]: pgmap v323: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:34.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:34 smithi077 ceph-mon[35095]: pgmap v323: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:34.973 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:09:35.497 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T02:09:35.497 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:09:35.497 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 0, 2024-09-12T02:09:35.497 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 2, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 0, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 4, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 0, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.000999096, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.000164507, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:35.498 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:09:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:09:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.499 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 235, 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 222, 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 1586256, 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 135552, 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 2, 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 1, 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.045414901, 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.014786459, 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.045460928, 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:35.500 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 222, 2024-09-12T02:09:35.501 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.016544280, 2024-09-12T02:09:35.501 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000074523 2024-09-12T02:09:35.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.501 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:35.501 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:35.501 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:35.501 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:35.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 1586256, 2024-09-12T02:09:35.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 135552 2024-09-12T02:09:35.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.502 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:09:35.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 2, 2024-09-12T02:09:35.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 169, 2024-09-12T02:09:35.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:09:35.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 186880, 2024-09-12T02:09:35.502 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 5, 2024-09-12T02:09:35.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2024-09-12T02:09:35.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.011818301, 2024-09-12T02:09:35.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.007943754, 2024-09-12T02:09:35.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.001448490, 2024-09-12T02:09:35.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:09:35.503 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:09:35.503 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 166, 2024-09-12T02:09:35.503 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.014021630, 2024-09-12T02:09:35.503 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000084467 2024-09-12T02:09:35.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:09:35.504 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:35.504 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:35.504 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:35.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:09:35.504 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 186880 2024-09-12T02:09:35.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.504 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-09-12T02:09:35.505 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 0, 2024-09-12T02:09:35.505 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-09-12T02:09:35.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.505 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-09-12T02:09:35.505 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:09:35.505 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-09-12T02:09:35.505 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:09:35.505 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:09:35.505 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:09:35.506 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:09:35.506 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:09:35.506 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:09:35.506 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:09:35.506 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:09:35.506 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:09:35.506 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:09:35.506 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:09:35.506 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-09-12T02:09:35.507 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 148732, 2024-09-12T02:09:35.508 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 31, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:09:35.509 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 928, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 2, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-09-12T02:09:35.510 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 233, 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 1550690, 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 233, 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 233, 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 1550690, 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:35.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T02:09:35.512 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T02:09:36.220 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-12T02:09:36.220 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-12T02:09:36.220 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-12T02:09:36.221 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:09:36.258 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:09:36.258 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:09:36.258 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:09:36.299 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T02:09:36.299 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:09:36.378 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:09:36.805 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:36.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:36 smithi062 ceph-mon[30666]: pgmap v324: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:09:36.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:36 smithi107 ceph-mon[35463]: pgmap v324: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:09:36.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:36 smithi077 ceph-mon[35095]: pgmap v324: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-12T02:09:37.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.342+0000 7f0786000640 1 -- 172.21.15.62:0/3454442649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07801049c0 msgr2=0x7f0780108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:37.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.342+0000 7f0786000640 1 --2- 172.21.15.62:0/3454442649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07801049c0 0x7f0780108a10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0768009900 tx=0x7f076802a410 comp rx=0 tx=0).stop 2024-09-12T02:09:37.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.342+0000 7f0786000640 1 -- 172.21.15.62:0/3454442649 shutdown_connections 2024-09-12T02:09:37.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.342+0000 7f0786000640 1 --2- 172.21.15.62:0/3454442649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0780109140 0x7f0780110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.342+0000 7f0786000640 1 --2- 172.21.15.62:0/3454442649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07801049c0 0x7f0780108a10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.342+0000 7f0786000640 1 --2- 172.21.15.62:0/3454442649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0780104010 0x7f07801043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.342+0000 7f0786000640 1 -- 172.21.15.62:0/3454442649 >> 172.21.15.62:0/3454442649 conn(0x7f07800ffa50 msgr2=0x7f0780101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.342+0000 7f0786000640 1 -- 172.21.15.62:0/3454442649 shutdown_connections 2024-09-12T02:09:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.342+0000 7f0786000640 1 -- 172.21.15.62:0/3454442649 wait complete. 2024-09-12T02:09:37.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.343+0000 7f0786000640 1 Processor -- start 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.343+0000 7f0786000640 1 -- start start 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f0786000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0780104010 0x7f078019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f0786000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07801049c0 0x7f078019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f0786000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0780109140 0x7f078019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f0786000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0780114190 con 0x7f0780109140 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f0786000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0780114010 con 0x7f0780104010 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f0786000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0780114310 con 0x7f07801049c0 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f077fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0780109140 0x7f078019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f0777e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07801049c0 0x7f078019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f0777e00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07801049c0 0x7f078019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:45314/0 (socket says 172.21.15.62:45314) 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f0777e00640 1 -- 172.21.15.62:0/479822090 learned_addr learned my addr 172.21.15.62:0/479822090 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:37.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f077fe00640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0780109140 0x7f078019efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39702/0 (socket says 172.21.15.62:39702) 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f077f400640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0780104010 0x7f078019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f077fe00640 1 -- 172.21.15.62:0/479822090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07801049c0 msgr2=0x7f078019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f077fe00640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07801049c0 0x7f078019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f077fe00640 1 -- 172.21.15.62:0/479822090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0780104010 msgr2=0x7f078019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f077fe00640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0780104010 0x7f078019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.344+0000 7f077fe00640 1 -- 172.21.15.62:0/479822090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078019f6a0 con 0x7f0780109140 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.345+0000 7f077fe00640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0780109140 0x7f078019efc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f077800e940 tx=0x7f077800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.345+0000 7f077cc00640 1 -- 172.21.15.62:0/479822090 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778004d20 con 0x7f0780109140 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.345+0000 7f0786000640 1 -- 172.21.15.62:0/479822090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078019f990 con 0x7f0780109140 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.345+0000 7f077cc00640 1 -- 172.21.15.62:0/479822090 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0778005020 con 0x7f0780109140 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.345+0000 7f077cc00640 1 -- 172.21.15.62:0/479822090 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077801f060 con 0x7f0780109140 2024-09-12T02:09:37.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.345+0000 7f0786000640 1 -- 172.21.15.62:0/479822090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07801a7270 con 0x7f0780109140 2024-09-12T02:09:37.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.346+0000 7f0786000640 1 -- 172.21.15.62:0/479822090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07801043f0 con 0x7f0780109140 2024-09-12T02:09:37.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.348+0000 7f077cc00640 1 -- 172.21.15.62:0/479822090 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f07780054d0 con 0x7f0780109140 2024-09-12T02:09:37.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.349+0000 7f077cc00640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f07640a2cf0 0x7f07640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:37.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.350+0000 7f077cc00640 1 -- 172.21.15.62:0/479822090 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9525+0+0 (secure 0 0 0) 0x7f07780cf8a0 con 0x7f0780109140 2024-09-12T02:09:37.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.350+0000 7f077f400640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f07640a2cf0 0x7f07640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:37.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.350+0000 7f077f400640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f07640a2cf0 0x7f07640a51b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0770009bd0 tx=0x7f0770005f90 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:37.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.354+0000 7f077cc00640 1 -- 172.21.15.62:0/479822090 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0778016030 con 0x7f0780109140 2024-09-12T02:09:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.550+0000 7f0786000640 1 -- 172.21.15.62:0/479822090 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f078010bdf0 con 0x7f0780109140 2024-09-12T02:09:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.550+0000 7f077cc00640 1 -- 172.21.15.62:0/479822090 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v103) ==== 81+0+940 (secure 0 0 0) 0x7f077809ba20 con 0x7f0780109140 2024-09-12T02:09:37.551 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/1859863767 2024-09-13T01:59:08.747003+0000 2024-09-12T02:09:37.551 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/1859863767 2024-09-13T01:59:08.747003+0000 2024-09-12T02:09:37.551 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/726819260 2024-09-13T01:59:08.747003+0000 2024-09-12T02:09:37.551 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/2854042842 2024-09-13T01:48:53.659705+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/2854042842 2024-09-13T01:48:53.659705+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/91320952 2024-09-13T01:49:21.439435+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/1208654241 2024-09-13T01:48:53.659705+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/934108526 2024-09-13T01:49:21.439435+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/409574397 2024-09-13T01:48:53.659705+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6800/1515578586 2024-09-13T01:49:21.439435+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/3603814798 2024-09-13T01:48:53.659705+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/4054298843 2024-09-13T01:49:21.439435+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:6801/1515578586 2024-09-13T01:49:21.439435+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/2427919776 2024-09-13T01:59:08.747003+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/706736394 2024-09-13T01:59:08.747003+0000 2024-09-12T02:09:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62:0/2409675195 2024-09-13T01:59:08.747003+0000 2024-09-12T02:09:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:listed 16 entries 2024-09-12T02:09:37.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.553+0000 7f0786000640 1 -- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f07640a2cf0 msgr2=0x7f07640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.553+0000 7f0786000640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f07640a2cf0 0x7f07640a51b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0770009bd0 tx=0x7f0770005f90 comp rx=0 tx=0).stop 2024-09-12T02:09:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.553+0000 7f0786000640 1 -- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0780109140 msgr2=0x7f078019efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.553+0000 7f0786000640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0780109140 0x7f078019efc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f077800e940 tx=0x7f077800ee00 comp rx=0 tx=0).stop 2024-09-12T02:09:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.553+0000 7f0786000640 1 -- 172.21.15.62:0/479822090 shutdown_connections 2024-09-12T02:09:37.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.553+0000 7f0786000640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f07640a2cf0 0x7f07640a51b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.553+0000 7f0786000640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0780109140 0x7f078019efc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.553+0000 7f0786000640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07801049c0 0x7f078019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.553+0000 7f0786000640 1 --2- 172.21.15.62:0/479822090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0780104010 0x7f078019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.553+0000 7f0786000640 1 -- 172.21.15.62:0/479822090 >> 172.21.15.62:0/479822090 conn(0x7f07800ffa50 msgr2=0x7f0780100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.554+0000 7f0786000640 1 -- 172.21.15.62:0/479822090 shutdown_connections 2024-09-12T02:09:37.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:37.554+0000 7f0786000640 1 -- 172.21.15.62:0/479822090 wait complete. 2024-09-12T02:09:37.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:37 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/479822090' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:09:37.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:37 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/479822090' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:09:37.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:37 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/479822090' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:09:38.286 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:09:38.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:09:38.287 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:09:38.366 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T02:09:38.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:09:38.367 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:09:38.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:09:38.421 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-09-12T02:09:38.457 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:09:38.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:09:38.458 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:09:38.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:09:38.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-09-12T02:09:38.833 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:38 smithi062 ceph-mon[30666]: pgmap v325: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:38.855 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:38 smithi107 ceph-mon[35463]: pgmap v325: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:38.865 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:38 smithi077 ceph-mon[35095]: pgmap v325: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:38.879 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T02:09:38.889 INFO:tasks.cephadm:Teardown begin 2024-09-12T02:09:38.890 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:09:38.890 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:09:39.271 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.869+0000 7fa839000640 1 -- 172.21.15.62:0/3973136041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa834104010 msgr2=0x7fa8341043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.869+0000 7fa839000640 1 --2- 172.21.15.62:0/3973136041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa834104010 0x7fa8341043f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa824009900 tx=0x7fa82402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.869+0000 7fa839000640 1 -- 172.21.15.62:0/3973136041 shutdown_connections 2024-09-12T02:09:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.869+0000 7fa839000640 1 --2- 172.21.15.62:0/3973136041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa834109140 0x7fa834110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.869+0000 7fa839000640 1 --2- 172.21.15.62:0/3973136041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8341049c0 0x7fa834108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.869+0000 7fa839000640 1 --2- 172.21.15.62:0/3973136041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa834104010 0x7fa8341043f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.869+0000 7fa839000640 1 -- 172.21.15.62:0/3973136041 >> 172.21.15.62:0/3973136041 conn(0x7fa8340ffa50 msgr2=0x7fa834101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.869+0000 7fa839000640 1 -- 172.21.15.62:0/3973136041 shutdown_connections 2024-09-12T02:09:39.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.869+0000 7fa839000640 1 -- 172.21.15.62:0/3973136041 wait complete. 2024-09-12T02:09:39.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.870+0000 7fa839000640 1 Processor -- start 2024-09-12T02:09:39.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.870+0000 7fa839000640 1 -- start start 2024-09-12T02:09:39.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.870+0000 7fa839000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa834104010 0x7fa83419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:39.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.870+0000 7fa839000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8341049c0 0x7fa83419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:39.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.870+0000 7fa839000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa834109140 0x7fa83419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:39.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.870+0000 7fa839000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa834114190 con 0x7fa834109140 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.870+0000 7fa839000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa834114010 con 0x7fa834104010 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.870+0000 7fa839000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa834114310 con 0x7fa8341049c0 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa831e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa834104010 0x7fa83419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa831e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa834104010 0x7fa83419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:32934/0 (socket says 172.21.15.62:32934) 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa82be00640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8341049c0 0x7fa83419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa831e00640 1 -- 172.21.15.62:0/156433894 learned_addr learned my addr 172.21.15.62:0/156433894 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa832800640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa834109140 0x7fa83419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa831e00640 1 -- 172.21.15.62:0/156433894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8341049c0 msgr2=0x7fa83419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa831e00640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8341049c0 0x7fa83419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa831e00640 1 -- 172.21.15.62:0/156433894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa834109140 msgr2=0x7fa83419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa831e00640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa834109140 0x7fa83419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa831e00640 1 -- 172.21.15.62:0/156433894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83419f5b0 con 0x7fa834104010 2024-09-12T02:09:39.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa82be00640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8341049c0 0x7fa83419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:09:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.871+0000 7fa831e00640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa834104010 0x7fa83419a600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa824004770 tx=0x7fa824003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.872+0000 7fa82aa00640 1 -- 172.21.15.62:0/156433894 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82403f070 con 0x7fa834104010 2024-09-12T02:09:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.872+0000 7fa82aa00640 1 -- 172.21.15.62:0/156433894 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa824031ca0 con 0x7fa834104010 2024-09-12T02:09:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.872+0000 7fa839000640 1 -- 172.21.15.62:0/156433894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83419f840 con 0x7fa834104010 2024-09-12T02:09:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.872+0000 7fa82aa00640 1 -- 172.21.15.62:0/156433894 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824035030 con 0x7fa834104010 2024-09-12T02:09:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.872+0000 7fa839000640 1 -- 172.21.15.62:0/156433894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8341a7180 con 0x7fa834104010 2024-09-12T02:09:39.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.873+0000 7fa839000640 1 -- 172.21.15.62:0/156433894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8341043f0 con 0x7fa834104010 2024-09-12T02:09:39.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.875+0000 7fa82aa00640 1 -- 172.21.15.62:0/156433894 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa824042070 con 0x7fa834104010 2024-09-12T02:09:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.876+0000 7fa82aa00640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa8180a2d70 0x7fa8180a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.876+0000 7fa82aa00640 1 -- 172.21.15.62:0/156433894 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9525+0+0 (secure 0 0 0) 0x7fa8240f0420 con 0x7fa834104010 2024-09-12T02:09:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.876+0000 7fa82be00640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa8180a2d70 0x7fa8180a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:39.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.877+0000 7fa82be00640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa8180a2d70 0x7fa8180a5230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa8340ffe70 tx=0x7fa81c005f90 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:39.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:39.878+0000 7fa82aa00640 1 -- 172.21.15.62:0/156433894 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8240bc660 con 0x7fa834104010 2024-09-12T02:09:40.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.099+0000 7fa839000640 1 -- 172.21.15.62:0/156433894 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa83410c320 con 0x7fa834104010 2024-09-12T02:09:40.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.100+0000 7fa82aa00640 1 -- 172.21.15.62:0/156433894 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11851 (secure 0 0 0) 0x7fa8240c0960 con 0x7fa834104010 2024-09-12T02:09:40.101 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:09:40.101 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"btime":"2024-09-12T01:57:25:959947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:56:41.854823+0000","modified":"2024-09-12T01:57:25.905993+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24529":{"gid":24529,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24530]},"id":1}]} 2024-09-12T02:09:40.102 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 -- 172.21.15.62:0/156433894 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa8180a2d70 msgr2=0x7fa8180a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa8180a2d70 0x7fa8180a5230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa8340ffe70 tx=0x7fa81c005f90 comp rx=0 tx=0).stop 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 -- 172.21.15.62:0/156433894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa834104010 msgr2=0x7fa83419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa834104010 0x7fa83419a600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa824004770 tx=0x7fa824003c10 comp rx=0 tx=0).stop 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 -- 172.21.15.62:0/156433894 shutdown_connections 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fa8180a2d70 0x7fa8180a5230 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa834109140 0x7fa83419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8341049c0 0x7fa83419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 --2- 172.21.15.62:0/156433894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa834104010 0x7fa83419a600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 -- 172.21.15.62:0/156433894 >> 172.21.15.62:0/156433894 conn(0x7fa8340ffa50 msgr2=0x7fa834100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:40.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 -- 172.21.15.62:0/156433894 shutdown_connections 2024-09-12T02:09:40.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:40.103+0000 7fa839000640 1 -- 172.21.15.62:0/156433894 wait complete. 2024-09-12T02:09:40.793 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:40 smithi062 ceph-mon[30666]: pgmap v326: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:40.793 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:40 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/156433894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:40.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:09:40.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:40 smithi107 ceph-mon[35463]: pgmap v326: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:40.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:40 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/156433894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:40.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:40 smithi077 ceph-mon[35095]: pgmap v326: 129 pgs: 129 active+clean; 2.2 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-12T02:09:40.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:40 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/156433894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:41.209 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:41.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.795+0000 7f29c8a00640 1 -- 172.21.15.62:0/2135945547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c4112a30 msgr2=0x7f29c4114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:41.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.795+0000 7f29c8a00640 1 --2- 172.21.15.62:0/2135945547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c4112a30 0x7f29c4114e20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009ca0 tx=0x7f29bc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:09:41.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.795+0000 7f29c8a00640 1 -- 172.21.15.62:0/2135945547 shutdown_connections 2024-09-12T02:09:41.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.795+0000 7f29c8a00640 1 --2- 172.21.15.62:0/2135945547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c4112a30 0x7f29c4114e20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:41.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.795+0000 7f29c8a00640 1 --2- 172.21.15.62:0/2135945547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29c4077040 0x7f29c41124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:41.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.795+0000 7f29c8a00640 1 --2- 172.21.15.62:0/2135945547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29c4076720 0x7f29c4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:41.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.795+0000 7f29c8a00640 1 -- 172.21.15.62:0/2135945547 >> 172.21.15.62:0/2135945547 conn(0x7f29c40ffa90 msgr2=0x7f29c4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:41.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.795+0000 7f29c8a00640 1 -- 172.21.15.62:0/2135945547 shutdown_connections 2024-09-12T02:09:41.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.795+0000 7f29c8a00640 1 -- 172.21.15.62:0/2135945547 wait complete. 2024-09-12T02:09:41.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.796+0000 7f29c8a00640 1 Processor -- start 2024-09-12T02:09:41.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.796+0000 7f29c8a00640 1 -- start start 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c8a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c4076720 0x7f29c41a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c8a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29c4077040 0x7f29c41a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c8a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29c4112a30 0x7f29c419e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c8a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f29c4118580 con 0x7f29c4076720 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c8a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29c4118400 con 0x7f29c4112a30 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c8a00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f29c4118700 con 0x7f29c4077040 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c2800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29c4112a30 0x7f29c419e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c4076720 0x7f29c41a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c2800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29c4112a30 0x7f29c419e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:50310/0 (socket says 172.21.15.62:50310) 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c2800640 1 -- 172.21.15.62:0/4220160823 learned_addr learned my addr 172.21.15.62:0/4220160823 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:41.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c1400640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29c4077040 0x7f29c41a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c2800640 1 -- 172.21.15.62:0/4220160823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29c4077040 msgr2=0x7f29c41a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c2800640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29c4077040 0x7f29c41a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c2800640 1 -- 172.21.15.62:0/4220160823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c4076720 msgr2=0x7f29c41a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c2800640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c4076720 0x7f29c41a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c2800640 1 -- 172.21.15.62:0/4220160823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c419efe0 con 0x7f29c4112a30 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c1400640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29c4077040 0x7f29c41a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.797+0000 7f29c1e00640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c4076720 0x7f29c41a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.798+0000 7f29c2800640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29c4112a30 0x7f29c419e840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f29bc02ade0 tx=0x7f29bc0319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.798+0000 7f29baa00640 1 -- 172.21.15.62:0/4220160823 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc003c30 con 0x7f29c4112a30 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.798+0000 7f29c8a00640 1 -- 172.21.15.62:0/4220160823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c419f270 con 0x7f29c4112a30 2024-09-12T02:09:41.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.798+0000 7f29baa00640 1 -- 172.21.15.62:0/4220160823 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29bc003dd0 con 0x7f29c4112a30 2024-09-12T02:09:41.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.798+0000 7f29baa00640 1 -- 172.21.15.62:0/4220160823 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc02fd60 con 0x7f29c4112a30 2024-09-12T02:09:41.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.798+0000 7f29c8a00640 1 -- 172.21.15.62:0/4220160823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c41ab520 con 0x7f29c4112a30 2024-09-12T02:09:41.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.799+0000 7f29c8a00640 1 -- 172.21.15.62:0/4220160823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c4077e60 con 0x7f29c4112a30 2024-09-12T02:09:41.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.801+0000 7f29baa00640 1 -- 172.21.15.62:0/4220160823 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f29bc004b40 con 0x7f29c4112a30 2024-09-12T02:09:41.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.802+0000 7f29baa00640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f29a80a2cf0 0x7f29a80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:41.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.803+0000 7f29baa00640 1 -- 172.21.15.62:0/4220160823 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9525+0+0 (secure 0 0 0) 0x7f29bc0f0ca0 con 0x7f29c4112a30 2024-09-12T02:09:41.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.803+0000 7f29c1e00640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f29a80a2cf0 0x7f29a80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:41.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.803+0000 7f29c1e00640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f29a80a2cf0 0x7f29a80a51b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f29b4005fd0 tx=0x7f29b400b390 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:41.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:41.804+0000 7f29baa00640 1 -- 172.21.15.62:0/4220160823 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29bc0bd610 con 0x7f29c4112a30 2024-09-12T02:09:42.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.026+0000 7f29c8a00640 1 -- 172.21.15.62:0/4220160823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29c410d630 con 0x7f29c4112a30 2024-09-12T02:09:42.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.027+0000 7f29baa00640 1 -- 172.21.15.62:0/4220160823 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11851 (secure 0 0 0) 0x7f29bc0bcf10 con 0x7f29c4112a30 2024-09-12T02:09:42.028 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:09:42.028 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"btime":"2024-09-12T01:57:25:959947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/2380166524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6836","nonce":2380166524},{"type":"v1","addr":"172.21.15.62:6837","nonce":2380166524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14481,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6839/3993694747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6838","nonce":3993694747},{"type":"v1","addr":"172.21.15.62:6839","nonce":3993694747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/2149975547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2149975547},{"type":"v1","addr":"172.21.15.77:6833","nonce":2149975547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2717043895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":2717043895},{"type":"v1","addr":"172.21.15.62:6835","nonce":2717043895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6833/1286528646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1286528646},{"type":"v1","addr":"172.21.15.107:6833","nonce":1286528646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24479,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2003629503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2003629503},{"type":"v1","addr":"172.21.15.77:6835","nonce":2003629503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1577534280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1577534280},{"type":"v1","addr":"172.21.15.77:6837","nonce":1577534280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3488072304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3488072304},{"type":"v1","addr":"172.21.15.107:6835","nonce":3488072304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2432202684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":2432202684},{"type":"v1","addr":"172.21.15.107:6837","nonce":2432202684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6841/886174121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6840","nonce":886174121},{"type":"v1","addr":"172.21.15.62:6841","nonce":886174121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:56:41.854823+0000","modified":"2024-09-12T01:57:25.905993+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24530},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24529":{"gid":24529,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/4011311424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":4011311424},{"type":"v1","addr":"172.21.15.107:6839","nonce":4011311424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24530":{"gid":24530,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6839/1365701824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1365701824},{"type":"v1","addr":"172.21.15.77:6839","nonce":1365701824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24530,"qdb_cluster":[24530]},"id":1}]} 2024-09-12T02:09:42.029 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 21 2024-09-12T02:09:42.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 -- 172.21.15.62:0/4220160823 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f29a80a2cf0 msgr2=0x7f29a80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:42.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f29a80a2cf0 0x7f29a80a51b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f29b4005fd0 tx=0x7f29b400b390 comp rx=0 tx=0).stop 2024-09-12T02:09:42.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 -- 172.21.15.62:0/4220160823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29c4112a30 msgr2=0x7f29c419e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:42.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29c4112a30 0x7f29c419e840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f29bc02ade0 tx=0x7f29bc0319f0 comp rx=0 tx=0).stop 2024-09-12T02:09:42.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 -- 172.21.15.62:0/4220160823 shutdown_connections 2024-09-12T02:09:42.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f29a80a2cf0 0x7f29a80a51b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:42.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29c4112a30 0x7f29c419e840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:42.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29c4077040 0x7f29c41a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:42.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 --2- 172.21.15.62:0/4220160823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29c4076720 0x7f29c41a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:42.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 -- 172.21.15.62:0/4220160823 >> 172.21.15.62:0/4220160823 conn(0x7f29c40ffa90 msgr2=0x7f29c4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:42.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 -- 172.21.15.62:0/4220160823 shutdown_connections 2024-09-12T02:09:42.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:42.030+0000 7f29c8a00640 1 -- 172.21.15.62:0/4220160823 wait complete. 2024-09-12T02:09:42.752 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:42 smithi062 ceph-mon[30666]: pgmap v327: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:09:42.752 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:42 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4220160823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:42.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:09:42.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:42 smithi107 ceph-mon[35463]: pgmap v327: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:09:42.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:42 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4220160823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:42.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:42 smithi077 ceph-mon[35095]: pgmap v327: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:09:42.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:42 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4220160823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:09:43.166 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.668+0000 7f6982c00640 1 -- 172.21.15.62:0/2923209555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697c109120 msgr2=0x7f697c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.668+0000 7f6982c00640 1 --2- 172.21.15.62:0/2923209555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697c109120 0x7f697c110ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6974009ca0 tx=0x7f697402a8b0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.668+0000 7f6982c00640 1 -- 172.21.15.62:0/2923209555 shutdown_connections 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.668+0000 7f6982c00640 1 --2- 172.21.15.62:0/2923209555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697c109120 0x7f697c110ca0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.668+0000 7f6982c00640 1 --2- 172.21.15.62:0/2923209555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f697c1049a0 0x7f697c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.668+0000 7f6982c00640 1 --2- 172.21.15.62:0/2923209555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f697c103ff0 0x7f697c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.668+0000 7f6982c00640 1 -- 172.21.15.62:0/2923209555 >> 172.21.15.62:0/2923209555 conn(0x7f697c0ffa90 msgr2=0x7f697c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.668+0000 7f6982c00640 1 -- 172.21.15.62:0/2923209555 shutdown_connections 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.668+0000 7f6982c00640 1 -- 172.21.15.62:0/2923209555 wait complete. 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.669+0000 7f6982c00640 1 Processor -- start 2024-09-12T02:09:43.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.669+0000 7f6982c00640 1 -- start start 2024-09-12T02:09:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.669+0000 7f6982c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f697c103ff0 0x7f697c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.669+0000 7f6982c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697c1049a0 0x7f697c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.669+0000 7f6982c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f697c109120 0x7f697c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.669+0000 7f6982c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f697c1141a0 con 0x7f697c1049a0 2024-09-12T02:09:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f6982c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f697c114020 con 0x7f697c109120 2024-09-12T02:09:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f6982c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f697c114320 con 0x7f697c103ff0 2024-09-12T02:09:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f697be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f697c103ff0 0x7f697c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f697be00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f697c103ff0 0x7f697c19a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:45566/0 (socket says 172.21.15.62:45566) 2024-09-12T02:09:43.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f697be00640 1 -- 172.21.15.62:0/3445706508 learned_addr learned my addr 172.21.15.62:0/3445706508 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f697b400640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697c1049a0 0x7f697c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f6980c00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f697c109120 0x7f697c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f697be00640 1 -- 172.21.15.62:0/3445706508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f697c109120 msgr2=0x7f697c19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f697be00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f697c109120 0x7f697c19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f697be00640 1 -- 172.21.15.62:0/3445706508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697c1049a0 msgr2=0x7f697c19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f697be00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697c1049a0 0x7f697c19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.670+0000 7f697be00640 1 -- 172.21.15.62:0/3445706508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c19f570 con 0x7f697c103ff0 2024-09-12T02:09:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.671+0000 7f697be00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f697c103ff0 0x7f697c19a5c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f696c00e9f0 tx=0x7f696c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.671+0000 7f6978c00640 1 -- 172.21.15.62:0/3445706508 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c00cd80 con 0x7f697c103ff0 2024-09-12T02:09:43.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.671+0000 7f6978c00640 1 -- 172.21.15.62:0/3445706508 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f696c005500 con 0x7f697c103ff0 2024-09-12T02:09:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.671+0000 7f6982c00640 1 -- 172.21.15.62:0/3445706508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697c19f860 con 0x7f697c103ff0 2024-09-12T02:09:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.671+0000 7f6978c00640 1 -- 172.21.15.62:0/3445706508 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c010690 con 0x7f697c103ff0 2024-09-12T02:09:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.671+0000 7f6982c00640 1 -- 172.21.15.62:0/3445706508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f697c1a7140 con 0x7f697c103ff0 2024-09-12T02:09:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.672+0000 7f6982c00640 1 -- 172.21.15.62:0/3445706508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697c1043d0 con 0x7f697c103ff0 2024-09-12T02:09:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.674+0000 7f6978c00640 1 -- 172.21.15.62:0/3445706508 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f696c0046c0 con 0x7f697c103ff0 2024-09-12T02:09:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.675+0000 7f6978c00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f69600a2cf0 0x7f69600a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.675+0000 7f6978c00640 1 -- 172.21.15.62:0/3445706508 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9525+0+0 (secure 0 0 0) 0x7f696c0cfc60 con 0x7f697c103ff0 2024-09-12T02:09:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.675+0000 7f697b400640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f69600a2cf0 0x7f69600a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.676+0000 7f697b400640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f69600a2cf0 0x7f69600a51b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69680095f0 tx=0x7f6968005f90 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:43.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.678+0000 7f6978c00640 1 -- 172.21.15.62:0/3445706508 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f696c09c430 con 0x7f697c103ff0 2024-09-12T02:09:43.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.865+0000 7f6982c00640 1 -- 172.21.15.62:0/3445706508 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f697c19b920 con 0x7f697c103ff0 2024-09-12T02:09:43.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.867+0000 7f6978c00640 1 -- 172.21.15.62:0/3445706508 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+25426 (secure 0 0 0) 0x7f696c09bd30 con 0x7f697c103ff0 2024-09-12T02:09:43.868 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T02:09:43.868 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":103,"fsid":"f18ee350-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:48:25.739472+0000","modified":"2024-09-12T02:09:16.880942+0000","last_up_change":"2024-09-12T01:55:46.275916+0000","last_in_change":"2024-09-12T01:55:23.568148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:51:44.080754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:56:36.684589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:56:39.370573+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T01:56:48.359920+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20d96bd8-b481-4413-8fa6-bf7ce632c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6803","nonce":2091859274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6805","nonce":2091859274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6809","nonce":2091859274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2091859274},{"type":"v1","addr":"172.21.15.62:6807","nonce":2091859274}]},"public_addr":"172.21.15.62:6803/2091859274","cluster_addr":"172.21.15.62:6805/2091859274","heartbeat_back_addr":"172.21.15.62:6809/2091859274","heartbeat_front_addr":"172.21.15.62:6807/2091859274","state":["exists","up"]},{"osd":1,"uuid":"00fd72ef-fa59-4e8b-a2a2-18771c177672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6801","nonce":2738000605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6803","nonce":2738000605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6807","nonce":2738000605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2738000605},{"type":"v1","addr":"172.21.15.77:6805","nonce":2738000605}]},"public_addr":"172.21.15.77:6801/2738000605","cluster_addr":"172.21.15.77:6803/2738000605","heartbeat_back_addr":"172.21.15.77:6807/2738000605","heartbeat_front_addr":"172.21.15.77:6805/2738000605","state":["exists","up"]},{"osd":2,"uuid":"8177e19a-60ca-40e1-a2b1-e7aef2bfdef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6801","nonce":1089319427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6803","nonce":1089319427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6807","nonce":1089319427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1089319427},{"type":"v1","addr":"172.21.15.107:6805","nonce":1089319427}]},"public_addr":"172.21.15.107:6801/1089319427","cluster_addr":"172.21.15.107:6803/1089319427","heartbeat_back_addr":"172.21.15.107:6807/1089319427","heartbeat_front_addr":"172.21.15.107:6805/1089319427","state":["exists","up"]},{"osd":3,"uuid":"5c620376-fea1-40d0-b6e6-ba93bb6485ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6811","nonce":1756749723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6813","nonce":1756749723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6817","nonce":1756749723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1756749723},{"type":"v1","addr":"172.21.15.62:6815","nonce":1756749723}]},"public_addr":"172.21.15.62:6811/1756749723","cluster_addr":"172.21.15.62:6813/1756749723","heartbeat_back_addr":"172.21.15.62:6817/1756749723","heartbeat_front_addr":"172.21.15.62:6815/1756749723","state":["exists","up"]},{"osd":4,"uuid":"8bf123c0-af2f-48cb-a299-10aca3199c26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6809","nonce":1516569462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6811","nonce":1516569462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6815","nonce":1516569462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1516569462},{"type":"v1","addr":"172.21.15.77:6813","nonce":1516569462}]},"public_addr":"172.21.15.77:6809/1516569462","cluster_addr":"172.21.15.77:6811/1516569462","heartbeat_back_addr":"172.21.15.77:6815/1516569462","heartbeat_front_addr":"172.21.15.77:6813/1516569462","state":["exists","up"]},{"osd":5,"uuid":"a80c7a20-45c7-4e5c-8291-77a5e55959aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6809","nonce":2023940642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6811","nonce":2023940642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6815","nonce":2023940642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":2023940642},{"type":"v1","addr":"172.21.15.107:6813","nonce":2023940642}]},"public_addr":"172.21.15.107:6809/2023940642","cluster_addr":"172.21.15.107:6811/2023940642","heartbeat_back_addr":"172.21.15.107:6815/2023940642","heartbeat_front_addr":"172.21.15.107:6813/2023940642","state":["exists","up"]},{"osd":6,"uuid":"6b148e87-4039-458c-a49c-2b632348cdf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6819","nonce":2615132641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6821","nonce":2615132641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6825","nonce":2615132641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":2615132641},{"type":"v1","addr":"172.21.15.62:6823","nonce":2615132641}]},"public_addr":"172.21.15.62:6819/2615132641","cluster_addr":"172.21.15.62:6821/2615132641","heartbeat_back_addr":"172.21.15.62:6825/2615132641","heartbeat_front_addr":"172.21.15.62:6823/2615132641","state":["exists","up"]},{"osd":7,"uuid":"dde7bf9d-fe60-486c-9cf5-bcba5af89a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6817","nonce":1202278855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6819","nonce":1202278855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6823","nonce":1202278855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1202278855},{"type":"v1","addr":"172.21.15.77:6821","nonce":1202278855}]},"public_addr":"172.21.15.77:6817/1202278855","cluster_addr":"172.21.15.77:6819/1202278855","heartbeat_back_addr":"172.21.15.77:6823/1202278855","heartbeat_front_addr":"172.21.15.77:6821/1202278855","state":["exists","up"]},{"osd":8,"uuid":"c0e12f4a-e01f-494b-ab17-24e5c1cfbfdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6817","nonce":3632359823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6819","nonce":3632359823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6823","nonce":3632359823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3632359823},{"type":"v1","addr":"172.21.15.107:6821","nonce":3632359823}]},"public_addr":"172.21.15.107:6817/3632359823","cluster_addr":"172.21.15.107:6819/3632359823","heartbeat_back_addr":"172.21.15.107:6823/3632359823","heartbeat_front_addr":"172.21.15.107:6821/3632359823","state":["exists","up"]},{"osd":9,"uuid":"0cc19007-e92e-4135-8154-2556a77daf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6827","nonce":2067861247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6829","nonce":2067861247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6833","nonce":2067861247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":2067861247},{"type":"v1","addr":"172.21.15.62:6831","nonce":2067861247}]},"public_addr":"172.21.15.62:6827/2067861247","cluster_addr":"172.21.15.62:6829/2067861247","heartbeat_back_addr":"172.21.15.62:6833/2067861247","heartbeat_front_addr":"172.21.15.62:6831/2067861247","state":["exists","up"]},{"osd":10,"uuid":"1f714105-925d-4bfe-9ec9-066ee4ea1632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6825","nonce":454508594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6827","nonce":454508594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6831","nonce":454508594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":454508594},{"type":"v1","addr":"172.21.15.77:6829","nonce":454508594}]},"public_addr":"172.21.15.77:6825/454508594","cluster_addr":"172.21.15.77:6827/454508594","heartbeat_back_addr":"172.21.15.77:6831/454508594","heartbeat_front_addr":"172.21.15.77:6829/454508594","state":["exists","up"]},{"osd":11,"uuid":"136b8ea9-0ba2-453f-bcd4-2f2a0a058fff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6825","nonce":2990277085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6827","nonce":2990277085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6831","nonce":2990277085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":2990277085},{"type":"v1","addr":"172.21.15.107:6829","nonce":2990277085}]},"public_addr":"172.21.15.107:6825/2990277085","cluster_addr":"172.21.15.107:6827/2990277085","heartbeat_back_addr":"172.21.15.107:6831/2990277085","heartbeat_front_addr":"172.21.15.107:6829/2990277085","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:50.200756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:16.329041+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:41.043358+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:11.838145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:36.839745+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:02.808801+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:31.706275+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:57.998922+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:23.101162+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:52.628667+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:19.502576+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:55:45.083133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6801/1859863767":"2024-09-13T01:59:08.747003+0000","172.21.15.62:6800/1859863767":"2024-09-13T01:59:08.747003+0000","172.21.15.62:0/726819260":"2024-09-13T01:59:08.747003+0000","172.21.15.62:6800/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6801/2854042842":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/91320952":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/1208654241":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/934108526":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/409574397":"2024-09-13T01:48:53.659705+0000","172.21.15.62:6800/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/3603814798":"2024-09-13T01:48:53.659705+0000","172.21.15.62:0/4054298843":"2024-09-13T01:49:21.439435+0000","172.21.15.62:6801/1515578586":"2024-09-13T01:49:21.439435+0000","172.21.15.62:0/2427919776":"2024-09-13T01:59:08.747003+0000","172.21.15.62:0/706736394":"2024-09-13T01:59:08.747003+0000","172.21.15.62:0/2409675195":"2024-09-13T01:59:08.747003+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:09:43.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.869+0000 7f6982c00640 1 -- 172.21.15.62:0/3445706508 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f69600a2cf0 msgr2=0x7f69600a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:43.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.869+0000 7f6982c00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f69600a2cf0 0x7f69600a51b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69680095f0 tx=0x7f6968005f90 comp rx=0 tx=0).stop 2024-09-12T02:09:43.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.869+0000 7f6982c00640 1 -- 172.21.15.62:0/3445706508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f697c103ff0 msgr2=0x7f697c19a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:43.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.869+0000 7f6982c00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f697c103ff0 0x7f697c19a5c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f696c00e9f0 tx=0x7f696c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.869+0000 7f6982c00640 1 -- 172.21.15.62:0/3445706508 shutdown_connections 2024-09-12T02:09:43.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.869+0000 7f6982c00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f69600a2cf0 0x7f69600a51b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.869+0000 7f6982c00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f697c109120 0x7f697c19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.869+0000 7f6982c00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f697c1049a0 0x7f697c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.869+0000 7f6982c00640 1 --2- 172.21.15.62:0/3445706508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f697c103ff0 0x7f697c19a5c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:43.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.869+0000 7f6982c00640 1 -- 172.21.15.62:0/3445706508 >> 172.21.15.62:0/3445706508 conn(0x7f697c0ffa90 msgr2=0x7f697c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:43.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.870+0000 7f6982c00640 1 -- 172.21.15.62:0/3445706508 shutdown_connections 2024-09-12T02:09:43.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:43.870+0000 7f6982c00640 1 -- 172.21.15.62:0/3445706508 wait complete. 2024-09-12T02:09:44.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T02:09:44.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:44 smithi062 ceph-mon[30666]: pgmap v328: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:09:44.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:44 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3445706508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:44.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:44 smithi107 ceph-mon[35463]: pgmap v328: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:09:44.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:44 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3445706508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:44.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:44 smithi077 ceph-mon[35095]: pgmap v328: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:09:44.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:44 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3445706508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:09:44.981 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:45.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.537+0000 7f676a400640 1 -- 172.21.15.62:0/3066245940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6764103ff0 msgr2=0x7f67641043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:45.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.537+0000 7f676a400640 1 --2- 172.21.15.62:0/3066245940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6764103ff0 0x7f67641043d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6754009900 tx=0x7f675402a410 comp rx=0 tx=0).stop 2024-09-12T02:09:45.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.537+0000 7f676a400640 1 -- 172.21.15.62:0/3066245940 shutdown_connections 2024-09-12T02:09:45.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.537+0000 7f676a400640 1 --2- 172.21.15.62:0/3066245940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6764109120 0x7f6764110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:45.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.537+0000 7f676a400640 1 --2- 172.21.15.62:0/3066245940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67641049a0 0x7f67641089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:45.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.537+0000 7f676a400640 1 --2- 172.21.15.62:0/3066245940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6764103ff0 0x7f67641043d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:45.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.537+0000 7f676a400640 1 -- 172.21.15.62:0/3066245940 >> 172.21.15.62:0/3066245940 conn(0x7f67640ffa90 msgr2=0x7f6764101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:45.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.537+0000 7f676a400640 1 -- 172.21.15.62:0/3066245940 shutdown_connections 2024-09-12T02:09:45.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.537+0000 7f676a400640 1 -- 172.21.15.62:0/3066245940 wait complete. 2024-09-12T02:09:45.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.538+0000 7f676a400640 1 Processor -- start 2024-09-12T02:09:45.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.538+0000 7f676a400640 1 -- start start 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.538+0000 7f676a400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6764103ff0 0x7f676419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.538+0000 7f676a400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67641049a0 0x7f676419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.538+0000 7f676a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6764109120 0x7f676419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.538+0000 7f676a400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6764114140 con 0x7f6764103ff0 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.538+0000 7f676a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6764113fc0 con 0x7f6764109120 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.538+0000 7f676a400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f67641142c0 con 0x7f67641049a0 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.539+0000 7f6763400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6764103ff0 0x7f676419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.539+0000 7f6763400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6764103ff0 0x7f676419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36648/0 (socket says 172.21.15.62:36648) 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.539+0000 7f6763400640 1 -- 172.21.15.62:0/2338250394 learned_addr learned my addr 172.21.15.62:0/2338250394 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.539+0000 7f675be00640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67641049a0 0x7f676419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.539+0000 7f6763e00640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6764109120 0x7f676419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:45.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.539+0000 7f6763400640 1 -- 172.21.15.62:0/2338250394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67641049a0 msgr2=0x7f676419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.539+0000 7f6763400640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67641049a0 0x7f676419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.539+0000 7f6763400640 1 -- 172.21.15.62:0/2338250394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6764109120 msgr2=0x7f676419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.539+0000 7f6763400640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6764109120 0x7f676419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.539+0000 7f6763400640 1 -- 172.21.15.62:0/2338250394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676419f670 con 0x7f6764103ff0 2024-09-12T02:09:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.540+0000 7f6763400640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6764103ff0 0x7f676419a6c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6754006010 tx=0x7f6754004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.540+0000 7f6760c00640 1 -- 172.21.15.62:0/2338250394 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675403f030 con 0x7f6764103ff0 2024-09-12T02:09:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.540+0000 7f6760c00640 1 -- 172.21.15.62:0/2338250394 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6754004440 con 0x7f6764103ff0 2024-09-12T02:09:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.540+0000 7f6760c00640 1 -- 172.21.15.62:0/2338250394 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754035070 con 0x7f6764103ff0 2024-09-12T02:09:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.540+0000 7f676a400640 1 -- 172.21.15.62:0/2338250394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676419f900 con 0x7f6764103ff0 2024-09-12T02:09:45.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.540+0000 7f676a400640 1 -- 172.21.15.62:0/2338250394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676419fd90 con 0x7f6764103ff0 2024-09-12T02:09:45.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.541+0000 7f676a400640 1 -- 172.21.15.62:0/2338250394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67641043d0 con 0x7f6764103ff0 2024-09-12T02:09:45.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.543+0000 7f6760c00640 1 -- 172.21.15.62:0/2338250394 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6754042030 con 0x7f6764103ff0 2024-09-12T02:09:45.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.544+0000 7f6760c00640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f67480a2d70 0x7f67480a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:45.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.544+0000 7f6760c00640 1 -- 172.21.15.62:0/2338250394 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9525+0+0 (secure 0 0 0) 0x7f67540ef850 con 0x7f6764103ff0 2024-09-12T02:09:45.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.545+0000 7f675be00640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f67480a2d70 0x7f67480a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:45.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.545+0000 7f675be00640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f67480a2d70 0x7f67480a5230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6764100020 tx=0x7f674c005f90 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:45.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.549+0000 7f6760c00640 1 -- 172.21.15.62:0/2338250394 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f67540bb9d0 con 0x7f6764103ff0 2024-09-12T02:09:45.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.776+0000 7f676a400640 1 -- 172.21.15.62:0/2338250394 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f676410c360 con 0x7f6764103ff0 2024-09-12T02:09:45.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.779+0000 7f6760c00640 1 -- 172.21.15.62:0/2338250394 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7f67540bfcd0 con 0x7f6764103ff0 2024-09-12T02:09:45.785 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:09:45.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.782+0000 7f676a400640 1 -- 172.21.15.62:0/2338250394 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f67480a2d70 msgr2=0x7f67480a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:45.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.782+0000 7f676a400640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f67480a2d70 0x7f67480a5230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6764100020 tx=0x7f674c005f90 comp rx=0 tx=0).stop 2024-09-12T02:09:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.782+0000 7f676a400640 1 -- 172.21.15.62:0/2338250394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6764103ff0 msgr2=0x7f676419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.782+0000 7f676a400640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6764103ff0 0x7f676419a6c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6754006010 tx=0x7f6754004040 comp rx=0 tx=0).stop 2024-09-12T02:09:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.782+0000 7f676a400640 1 -- 172.21.15.62:0/2338250394 shutdown_connections 2024-09-12T02:09:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.782+0000 7f676a400640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f67480a2d70 0x7f67480a5230 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.782+0000 7f676a400640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6764109120 0x7f676419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.783+0000 7f676a400640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f67641049a0 0x7f676419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.783+0000 7f676a400640 1 --2- 172.21.15.62:0/2338250394 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6764103ff0 0x7f676419a6c0 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6754006010 tx=0x7f6754004040 comp rx=0 tx=0).stop 2024-09-12T02:09:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.783+0000 7f676a400640 1 -- 172.21.15.62:0/2338250394 >> 172.21.15.62:0/2338250394 conn(0x7f67640ffa90 msgr2=0x7f6764100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.783+0000 7f676a400640 1 -- 172.21.15.62:0/2338250394 shutdown_connections 2024-09-12T02:09:45.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:45.784+0000 7f676a400640 1 -- 172.21.15.62:0/2338250394 wait complete. 2024-09-12T02:09:46.095 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:45 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a[30662]: 2024-09-12T02:09:45.777+0000 7f59e0a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:09:46.205 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 02:09:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i[65848]: ignoring --setuser ceph since I am not root 2024-09-12T02:09:46.205 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 02:09:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i[65848]: ignoring --setgroup ceph since I am not root 2024-09-12T02:09:46.205 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 02:09:45 smithi107 ceph-mds[65852]: -- 172.21.15.107:0/4285020215 <== mon.1 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b91ae1f860 con 0x55b91adfd400 2024-09-12T02:09:46.205 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 02:09:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i[65848]: starting mds.i at 2024-09-12T02:09:46.214 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 02:09:45 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b[65305]: ignoring --setuser ceph since I am not root 2024-09-12T02:09:46.214 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 02:09:45 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b[65305]: ignoring --setgroup ceph since I am not root 2024-09-12T02:09:46.214 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 02:09:45 smithi077 ceph-mds[65309]: -- 172.21.15.77:0/1209923399 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557309aa5860 con 0x557309a83000 2024-09-12T02:09:46.214 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 02:09:45 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b[65305]: starting mds.b at 2024-09-12T02:09:46.526 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:09:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:46 smithi062 ceph-mon[30666]: pgmap v329: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:09:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:46 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2338250394' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:09:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:46 smithi062 ceph-mon[30666]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:09:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:46 smithi062 ceph-mon[30666]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:09:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:46 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/2338250394' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:09:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:46 smithi062 ceph-mon[30666]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:09:46.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:46 smithi062 ceph-mon[30666]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-12T02:09:46.908 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:46.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:46 smithi107 ceph-mon[35463]: pgmap v329: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:09:46.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:46 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2338250394' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:09:46.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:46 smithi107 ceph-mon[35463]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:09:46.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:46 smithi107 ceph-mon[35463]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:09:46.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:46 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/2338250394' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:09:46.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:46 smithi107 ceph-mon[35463]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:09:46.954 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:46 smithi107 ceph-mon[35463]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-12T02:09:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:46 smithi077 ceph-mon[35095]: pgmap v329: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-12T02:09:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:46 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2338250394' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:09:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:46 smithi077 ceph-mon[35095]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:09:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:46 smithi077 ceph-mon[35095]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:09:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:46 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/2338250394' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:09:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:46 smithi077 ceph-mon[35095]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:09:46.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:46 smithi077 ceph-mon[35095]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-12T02:09:47.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.480+0000 7efc55000640 1 -- 172.21.15.62:0/2498156846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc501019c0 msgr2=0x7efc50101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:47.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.480+0000 7efc55000640 1 --2- 172.21.15.62:0/2498156846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc501019c0 0x7efc50101e20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009930 tx=0x7efc3c02a420 comp rx=0 tx=0).stop 2024-09-12T02:09:47.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.480+0000 7efc55000640 1 -- 172.21.15.62:0/2498156846 shutdown_connections 2024-09-12T02:09:47.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.480+0000 7efc55000640 1 --2- 172.21.15.62:0/2498156846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc50102360 0x7efc5010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:47.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.480+0000 7efc55000640 1 --2- 172.21.15.62:0/2498156846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc501019c0 0x7efc50101e20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:47.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.480+0000 7efc55000640 1 --2- 172.21.15.62:0/2498156846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc501079c0 0x7efc50107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:47.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.480+0000 7efc55000640 1 -- 172.21.15.62:0/2498156846 >> 172.21.15.62:0/2498156846 conn(0x7efc500fd740 msgr2=0x7efc500ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:47.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.480+0000 7efc55000640 1 -- 172.21.15.62:0/2498156846 shutdown_connections 2024-09-12T02:09:47.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.480+0000 7efc55000640 1 -- 172.21.15.62:0/2498156846 wait complete. 2024-09-12T02:09:47.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.481+0000 7efc55000640 1 Processor -- start 2024-09-12T02:09:47.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.481+0000 7efc55000640 1 -- start start 2024-09-12T02:09:47.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc55000640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc501019c0 0x7efc501982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:47.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc55000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc50102360 0x7efc50198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc55000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc501079c0 0x7efc5019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc55000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc50111e10 con 0x7efc50102360 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc55000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc50111c90 con 0x7efc501079c0 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc55000640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efc50111f90 con 0x7efc501019c0 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc4f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc501019c0 0x7efc501982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc4ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc50102360 0x7efc50198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc4f400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc501019c0 0x7efc501982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:45618/0 (socket says 172.21.15.62:45618) 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc4f400640 1 -- 172.21.15.62:0/4208004482 learned_addr learned my addr 172.21.15.62:0/4208004482 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.482+0000 7efc4fe00640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc501079c0 0x7efc5019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc4f400640 1 -- 172.21.15.62:0/4208004482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc501079c0 msgr2=0x7efc5019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc4f400640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc501079c0 0x7efc5019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc4f400640 1 -- 172.21.15.62:0/4208004482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc50102360 msgr2=0x7efc50198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:47.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc4f400640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc50102360 0x7efc50198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc4f400640 1 -- 172.21.15.62:0/4208004482 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5019d2a0 con 0x7efc501019c0 2024-09-12T02:09:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc4ea00640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc50102360 0x7efc50198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:09:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc4f400640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc501019c0 0x7efc501982f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efc4000d950 tx=0x7efc4000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:47.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc47e00640 1 -- 172.21.15.62:0/4208004482 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40017030 con 0x7efc501019c0 2024-09-12T02:09:47.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc47e00640 1 -- 172.21.15.62:0/4208004482 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc40004020 con 0x7efc501019c0 2024-09-12T02:09:47.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc55000640 1 -- 172.21.15.62:0/4208004482 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5019d590 con 0x7efc501019c0 2024-09-12T02:09:47.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.483+0000 7efc47e00640 1 -- 172.21.15.62:0/4208004482 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc400047a0 con 0x7efc501019c0 2024-09-12T02:09:47.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.484+0000 7efc55000640 1 -- 172.21.15.62:0/4208004482 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc501a4e70 con 0x7efc501019c0 2024-09-12T02:09:47.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.485+0000 7efc55000640 1 -- 172.21.15.62:0/4208004482 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc50101e20 con 0x7efc501019c0 2024-09-12T02:09:47.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.487+0000 7efc47e00640 1 -- 172.21.15.62:0/4208004482 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7efc400041d0 con 0x7efc501019c0 2024-09-12T02:09:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.488+0000 7efc47e00640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7efc340a2d70 0x7efc340a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.488+0000 7efc47e00640 1 -- 172.21.15.62:0/4208004482 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9523+0+0 (secure 0 0 0) 0x7efc400cf320 con 0x7efc501019c0 2024-09-12T02:09:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.488+0000 7efc4ea00640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7efc340a2d70 0x7efc340a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:47.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.489+0000 7efc4ea00640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7efc340a2d70 0x7efc340a5230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc3c006010 tx=0x7efc3c031510 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:47.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.490+0000 7efc47e00640 1 -- 172.21.15.62:0/4208004482 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc4009bb70 con 0x7efc501019c0 2024-09-12T02:09:47.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.715+0000 7efc55000640 1 -- 172.21.15.62:0/4208004482 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7efc5002d7c0 con 0x7efc501019c0 2024-09-12T02:09:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.794+0000 7efc47e00640 1 -- 172.21.15.62:0/4208004482 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7efc4009b470 con 0x7efc501019c0 2024-09-12T02:09:47.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.796+0000 7efc55000640 1 -- 172.21.15.62:0/4208004482 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7efc340a2d70 msgr2=0x7efc340a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:47.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.796+0000 7efc55000640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7efc340a2d70 0x7efc340a5230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc3c006010 tx=0x7efc3c031510 comp rx=0 tx=0).stop 2024-09-12T02:09:47.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.796+0000 7efc55000640 1 -- 172.21.15.62:0/4208004482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc501019c0 msgr2=0x7efc501982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.796+0000 7efc55000640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc501019c0 0x7efc501982f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efc4000d950 tx=0x7efc4000de10 comp rx=0 tx=0).stop 2024-09-12T02:09:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.797+0000 7efc55000640 1 -- 172.21.15.62:0/4208004482 shutdown_connections 2024-09-12T02:09:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.797+0000 7efc55000640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7efc340a2d70 0x7efc340a5230 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.797+0000 7efc55000640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc501079c0 0x7efc5019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.797+0000 7efc55000640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc50102360 0x7efc50198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.797+0000 7efc55000640 1 --2- 172.21.15.62:0/4208004482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc501019c0 0x7efc501982f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.797+0000 7efc55000640 1 -- 172.21.15.62:0/4208004482 >> 172.21.15.62:0/4208004482 conn(0x7efc500fd740 msgr2=0x7efc500fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.797+0000 7efc55000640 1 -- 172.21.15.62:0/4208004482 shutdown_connections 2024-09-12T02:09:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:47.797+0000 7efc55000640 1 -- 172.21.15.62:0/4208004482 wait complete. 2024-09-12T02:09:48.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:47 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.107:6838/2458620237,v1:172.21.15.107:6839/2458620237] up:boot 2024-09-12T02:09:48.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:47 smithi062 ceph-mon[30666]: mds.? [v2:172.21.15.77:6838/4231974331,v1:172.21.15.77:6839/4231974331] up:boot 2024-09-12T02:09:48.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:47 smithi062 ceph-mon[30666]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-12T02:09:48.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:47 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:09:48.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:47 smithi062 ceph-mon[30666]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:09:48.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:47 smithi062 ceph-mon[30666]: pgmap v331: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-12T02:09:48.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:47 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/4208004482' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:09:48.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:47 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:09:48.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:47 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.107:6838/2458620237,v1:172.21.15.107:6839/2458620237] up:boot 2024-09-12T02:09:48.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:47 smithi107 ceph-mon[35463]: mds.? [v2:172.21.15.77:6838/4231974331,v1:172.21.15.77:6839/4231974331] up:boot 2024-09-12T02:09:48.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:47 smithi107 ceph-mon[35463]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-12T02:09:48.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:47 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:09:48.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:47 smithi107 ceph-mon[35463]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:09:48.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:47 smithi107 ceph-mon[35463]: pgmap v331: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-12T02:09:48.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:47 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/4208004482' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:09:48.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:47 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:09:48.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:47 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.107:6838/2458620237,v1:172.21.15.107:6839/2458620237] up:boot 2024-09-12T02:09:48.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:47 smithi077 ceph-mon[35095]: mds.? [v2:172.21.15.77:6838/4231974331,v1:172.21.15.77:6839/4231974331] up:boot 2024-09-12T02:09:48.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:47 smithi077 ceph-mon[35095]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-12T02:09:48.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:47 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:09:48.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:47 smithi077 ceph-mon[35095]: from='mgr.25070 172.21.15.62:0/3230023020' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:09:48.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:47 smithi077 ceph-mon[35095]: pgmap v331: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-12T02:09:48.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:47 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/4208004482' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:09:48.215 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:47 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:09:48.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:09:48.925 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:49.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:48 smithi062 ceph-mon[30666]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:09:49.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:48 smithi062 ceph-mon[30666]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:09:49.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:48 smithi062 ceph-mon[30666]: Cluster is now healthy 2024-09-12T02:09:49.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:48 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:09:49.065 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:48 smithi062 ceph-mon[30666]: fsmap 12 up:standby 2024-09-12T02:09:49.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:48 smithi107 ceph-mon[35463]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:09:49.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:48 smithi107 ceph-mon[35463]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:09:49.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:48 smithi107 ceph-mon[35463]: Cluster is now healthy 2024-09-12T02:09:49.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:48 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:09:49.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:48 smithi107 ceph-mon[35463]: fsmap 12 up:standby 2024-09-12T02:09:49.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:48 smithi077 ceph-mon[35095]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:09:49.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:48 smithi077 ceph-mon[35095]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:09:49.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:48 smithi077 ceph-mon[35095]: Cluster is now healthy 2024-09-12T02:09:49.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:48 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:09:49.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:48 smithi077 ceph-mon[35095]: fsmap 12 up:standby 2024-09-12T02:09:49.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.509+0000 7f7d55c00640 1 -- 172.21.15.62:0/1841661947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d50106f00 msgr2=0x7f7d5010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:49.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.509+0000 7f7d55c00640 1 --2- 172.21.15.62:0/1841661947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d50106f00 0x7f7d5010ea80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009ca0 tx=0x7f7d4802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:09:49.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.509+0000 7f7d55c00640 1 -- 172.21.15.62:0/1841661947 shutdown_connections 2024-09-12T02:09:49.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.509+0000 7f7d55c00640 1 --2- 172.21.15.62:0/1841661947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d50106f00 0x7f7d5010ea80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:49.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.509+0000 7f7d55c00640 1 --2- 172.21.15.62:0/1841661947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d50102780 0x7f7d501067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:49.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.509+0000 7f7d55c00640 1 --2- 172.21.15.62:0/1841661947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d50101dd0 0x7f7d501021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:49.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.509+0000 7f7d55c00640 1 -- 172.21.15.62:0/1841661947 >> 172.21.15.62:0/1841661947 conn(0x7f7d500fd8b0 msgr2=0x7f7d500ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:49.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.509+0000 7f7d55c00640 1 -- 172.21.15.62:0/1841661947 shutdown_connections 2024-09-12T02:09:49.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.510+0000 7f7d55c00640 1 -- 172.21.15.62:0/1841661947 wait complete. 2024-09-12T02:09:49.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.511+0000 7f7d55c00640 1 Processor -- start 2024-09-12T02:09:49.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.511+0000 7f7d55c00640 1 -- start start 2024-09-12T02:09:49.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.511+0000 7f7d55c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d50101dd0 0x7f7d501983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.511+0000 7f7d55c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d50102780 0x7f7d50198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d55c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d50106f00 0x7f7d5019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d55c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7d50111fb0 con 0x7f7d50102780 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d55c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d50111e30 con 0x7f7d50101dd0 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d55c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7d50112130 con 0x7f7d50106f00 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d46000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d50102780 0x7f7d50198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d4ea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d50101dd0 0x7f7d501983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d4ea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d50101dd0 0x7f7d501983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:50374/0 (socket says 172.21.15.62:50374) 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d4ea00640 1 -- 172.21.15.62:0/3228070314 learned_addr learned my addr 172.21.15.62:0/3228070314 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d4f400640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d50106f00 0x7f7d5019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:49.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d46000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d50102780 0x7f7d50198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36678/0 (socket says 172.21.15.62:36678) 2024-09-12T02:09:49.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d4ea00640 1 -- 172.21.15.62:0/3228070314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d50106f00 msgr2=0x7f7d5019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:49.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d4ea00640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d50106f00 0x7f7d5019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:49.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d4ea00640 1 -- 172.21.15.62:0/3228070314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d50102780 msgr2=0x7f7d50198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:49.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d4ea00640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d50102780 0x7f7d50198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:49.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.512+0000 7f7d4ea00640 1 -- 172.21.15.62:0/3228070314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5019d380 con 0x7f7d50101dd0 2024-09-12T02:09:49.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.513+0000 7f7d4ea00640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d50101dd0 0x7f7d501983d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000d950 tx=0x7f7d4000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:49.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.513+0000 7f7d47e00640 1 -- 172.21.15.62:0/3228070314 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40017030 con 0x7f7d50101dd0 2024-09-12T02:09:49.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.513+0000 7f7d55c00640 1 -- 172.21.15.62:0/3228070314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5019d670 con 0x7f7d50101dd0 2024-09-12T02:09:49.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.513+0000 7f7d47e00640 1 -- 172.21.15.62:0/3228070314 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d40004020 con 0x7f7d50101dd0 2024-09-12T02:09:49.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.513+0000 7f7d47e00640 1 -- 172.21.15.62:0/3228070314 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d400047a0 con 0x7f7d50101dd0 2024-09-12T02:09:49.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.513+0000 7f7d55c00640 1 -- 172.21.15.62:0/3228070314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d50074420 con 0x7f7d50101dd0 2024-09-12T02:09:49.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.514+0000 7f7d55c00640 1 -- 172.21.15.62:0/3228070314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d501021b0 con 0x7f7d50101dd0 2024-09-12T02:09:49.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.516+0000 7f7d47e00640 1 -- 172.21.15.62:0/3228070314 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7d400041d0 con 0x7f7d50101dd0 2024-09-12T02:09:49.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.518+0000 7f7d47e00640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f7d340a2d70 0x7f7d340a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:49.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.519+0000 7f7d47e00640 1 -- 172.21.15.62:0/3228070314 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9523+0+0 (secure 0 0 0) 0x7f7d400cf1a0 con 0x7f7d50101dd0 2024-09-12T02:09:49.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.519+0000 7f7d46000640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f7d340a2d70 0x7f7d340a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:49.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.519+0000 7f7d46000640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f7d340a2d70 0x7f7d340a5230 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d501088d0 tx=0x7f7d38012040 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:49.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.522+0000 7f7d47e00640 1 -- 172.21.15.62:0/3228070314 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d4009b970 con 0x7f7d50101dd0 2024-09-12T02:09:49.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.710+0000 7f7d55c00640 1 -- 172.21.15.62:0/3228070314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7d50199730 con 0x7f7d50101dd0 2024-09-12T02:09:49.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.805+0000 7f7d47e00640 1 -- 172.21.15.62:0/3228070314 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7f7d4009b270 con 0x7f7d50101dd0 2024-09-12T02:09:49.806 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:09:49.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.809+0000 7f7d55c00640 1 -- 172.21.15.62:0/3228070314 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f7d340a2d70 msgr2=0x7f7d340a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:49.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.809+0000 7f7d55c00640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f7d340a2d70 0x7f7d340a5230 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d501088d0 tx=0x7f7d38012040 comp rx=0 tx=0).stop 2024-09-12T02:09:49.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.809+0000 7f7d55c00640 1 -- 172.21.15.62:0/3228070314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d50101dd0 msgr2=0x7f7d501983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:49.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.809+0000 7f7d55c00640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d50101dd0 0x7f7d501983d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000d950 tx=0x7f7d4000de10 comp rx=0 tx=0).stop 2024-09-12T02:09:49.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.809+0000 7f7d55c00640 1 -- 172.21.15.62:0/3228070314 shutdown_connections 2024-09-12T02:09:49.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.809+0000 7f7d55c00640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7f7d340a2d70 0x7f7d340a5230 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:49.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.809+0000 7f7d55c00640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d50106f00 0x7f7d5019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:49.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.809+0000 7f7d55c00640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d50102780 0x7f7d50198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:49.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.809+0000 7f7d55c00640 1 --2- 172.21.15.62:0/3228070314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d50101dd0 0x7f7d501983d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:49.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.809+0000 7f7d55c00640 1 -- 172.21.15.62:0/3228070314 >> 172.21.15.62:0/3228070314 conn(0x7f7d500fd8b0 msgr2=0x7f7d500febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:49.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.810+0000 7f7d55c00640 1 -- 172.21.15.62:0/3228070314 shutdown_connections 2024-09-12T02:09:49.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:49.810+0000 7f7d55c00640 1 -- 172.21.15.62:0/3228070314 wait complete. 2024-09-12T02:09:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:49 smithi077 ceph-mon[35095]: pgmap v332: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-12T02:09:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:49 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/3228070314' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:49.965 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:49 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:50.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:49 smithi062 ceph-mon[30666]: pgmap v332: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-12T02:09:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:49 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/3228070314' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:50.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:49 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:50.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:49 smithi107 ceph-mon[35463]: pgmap v332: 129 pgs: 129 active+clean; 2.2 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-12T02:09:50.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:49 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/3228070314' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:50.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:49 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:50.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:09:50.952 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:51.091 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:50 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:51.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:50 smithi062 ceph-mon[30666]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:09:51.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:50 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:51.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:50 smithi107 ceph-mon[35463]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:09:51.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:50 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:51.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:50 smithi077 ceph-mon[35095]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:09:51.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.560+0000 7fd5c9c00640 1 -- 172.21.15.62:0/1869882631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c4103ff0 msgr2=0x7fd5c41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:51.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.560+0000 7fd5c9c00640 1 --2- 172.21.15.62:0/1869882631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c4103ff0 0x7fd5c41043d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009860 tx=0x7fd5b402a340 comp rx=0 tx=0).stop 2024-09-12T02:09:51.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.560+0000 7fd5c9c00640 1 -- 172.21.15.62:0/1869882631 shutdown_connections 2024-09-12T02:09:51.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.560+0000 7fd5c9c00640 1 --2- 172.21.15.62:0/1869882631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5c4109120 0x7fd5c4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:51.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.560+0000 7fd5c9c00640 1 --2- 172.21.15.62:0/1869882631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c41049a0 0x7fd5c41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:51.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.560+0000 7fd5c9c00640 1 --2- 172.21.15.62:0/1869882631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c4103ff0 0x7fd5c41043d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:51.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.560+0000 7fd5c9c00640 1 -- 172.21.15.62:0/1869882631 >> 172.21.15.62:0/1869882631 conn(0x7fd5c40ffa90 msgr2=0x7fd5c4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:51.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.560+0000 7fd5c9c00640 1 -- 172.21.15.62:0/1869882631 shutdown_connections 2024-09-12T02:09:51.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.560+0000 7fd5c9c00640 1 -- 172.21.15.62:0/1869882631 wait complete. 2024-09-12T02:09:51.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.561+0000 7fd5c9c00640 1 Processor -- start 2024-09-12T02:09:51.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.562+0000 7fd5c9c00640 1 -- start start 2024-09-12T02:09:51.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.562+0000 7fd5c9c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c4103ff0 0x7fd5c419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:51.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.562+0000 7fd5c9c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c41049a0 0x7fd5c419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:51.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.562+0000 7fd5c9c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5c4109120 0x7fd5c419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:51.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.562+0000 7fd5c9c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4114140 con 0x7fd5c4109120 2024-09-12T02:09:51.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.562+0000 7fd5c9c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4113fc0 con 0x7fd5c41049a0 2024-09-12T02:09:51.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.562+0000 7fd5c9c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41142c0 con 0x7fd5c4103ff0 2024-09-12T02:09:51.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.562+0000 7fd5ba000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c41049a0 0x7fd5c419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:51.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.562+0000 7fd5c2a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c4103ff0 0x7fd5c419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:51.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5c2a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c4103ff0 0x7fd5c419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.62:45660/0 (socket says 172.21.15.62:45660) 2024-09-12T02:09:51.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5ba000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c41049a0 0x7fd5c419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:50390/0 (socket says 172.21.15.62:50390) 2024-09-12T02:09:51.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5c2a00640 1 -- 172.21.15.62:0/612412777 learned_addr learned my addr 172.21.15.62:0/612412777 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5c3400640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5c4109120 0x7fd5c419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5c2a00640 1 -- 172.21.15.62:0/612412777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c41049a0 msgr2=0x7fd5c419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5c2a00640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c41049a0 0x7fd5c419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5c2a00640 1 -- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5c4109120 msgr2=0x7fd5c419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5c2a00640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5c4109120 0x7fd5c419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5c2a00640 1 -- 172.21.15.62:0/612412777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c419f5d0 con 0x7fd5c4103ff0 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5c3400640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5c4109120 0x7fd5c419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5c2a00640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c4103ff0 0x7fd5c419a620 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4035040 tx=0x7fd5b4033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.563+0000 7fd5bbe00640 1 -- 172.21.15.62:0/612412777 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b403f020 con 0x7fd5c4103ff0 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.564+0000 7fd5bbe00640 1 -- 172.21.15.62:0/612412777 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5b4032770 con 0x7fd5c4103ff0 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.564+0000 7fd5c9c00640 1 -- 172.21.15.62:0/612412777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c419f860 con 0x7fd5c4103ff0 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.564+0000 7fd5bbe00640 1 -- 172.21.15.62:0/612412777 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4037040 con 0x7fd5c4103ff0 2024-09-12T02:09:51.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.564+0000 7fd5c9c00640 1 -- 172.21.15.62:0/612412777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c41a71a0 con 0x7fd5c4103ff0 2024-09-12T02:09:51.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.565+0000 7fd5c9c00640 1 -- 172.21.15.62:0/612412777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c41054d0 con 0x7fd5c4103ff0 2024-09-12T02:09:51.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.567+0000 7fd5bbe00640 1 -- 172.21.15.62:0/612412777 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd5b4042020 con 0x7fd5c4103ff0 2024-09-12T02:09:51.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.568+0000 7fd5bbe00640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd5a80a2cf0 0x7fd5a80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:51.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.568+0000 7fd5bbe00640 1 -- 172.21.15.62:0/612412777 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8969+0+0 (secure 0 0 0) 0x7fd5b40efb40 con 0x7fd5c4103ff0 2024-09-12T02:09:51.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.568+0000 7fd5ba000640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd5a80a2cf0 0x7fd5a80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:51.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.569+0000 7fd5ba000640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd5a80a2cf0 0x7fd5a80a51b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40fff20 tx=0x7fd5ac005f90 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:51.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.570+0000 7fd5bbe00640 1 -- 172.21.15.62:0/612412777 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5b4049020 con 0x7fd5c4103ff0 2024-09-12T02:09:51.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.757+0000 7fd5c9c00640 1 -- 172.21.15.62:0/612412777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd5c410c300 con 0x7fd5c4103ff0 2024-09-12T02:09:51.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.812+0000 7fd5bbe00640 1 -- 172.21.15.62:0/612412777 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7fd5b40bc650 con 0x7fd5c4103ff0 2024-09-12T02:09:51.815 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2024-09-12T02:09:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.818+0000 7fd5c9c00640 1 -- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd5a80a2cf0 msgr2=0x7fd5a80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.818+0000 7fd5c9c00640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd5a80a2cf0 0x7fd5a80a51b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40fff20 tx=0x7fd5ac005f90 comp rx=0 tx=0).stop 2024-09-12T02:09:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.818+0000 7fd5c9c00640 1 -- 172.21.15.62:0/612412777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c4103ff0 msgr2=0x7fd5c419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.818+0000 7fd5c9c00640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c4103ff0 0x7fd5c419a620 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4035040 tx=0x7fd5b4033d90 comp rx=0 tx=0).stop 2024-09-12T02:09:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.818+0000 7fd5c9c00640 1 -- 172.21.15.62:0/612412777 shutdown_connections 2024-09-12T02:09:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.818+0000 7fd5c9c00640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fd5a80a2cf0 0x7fd5a80a51b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.818+0000 7fd5c9c00640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd5c4109120 0x7fd5c419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.818+0000 7fd5c9c00640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c41049a0 0x7fd5c419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.818+0000 7fd5c9c00640 1 --2- 172.21.15.62:0/612412777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c4103ff0 0x7fd5c419a620 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.818+0000 7fd5c9c00640 1 -- 172.21.15.62:0/612412777 >> 172.21.15.62:0/612412777 conn(0x7fd5c40ffa90 msgr2=0x7fd5c4100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:51.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.819+0000 7fd5c9c00640 1 -- 172.21.15.62:0/612412777 shutdown_connections 2024-09-12T02:09:51.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:51.819+0000 7fd5c9c00640 1 -- 172.21.15.62:0/612412777 wait complete. 2024-09-12T02:09:52.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:51 smithi062 ceph-mon[30666]: pgmap v334: 97 pgs: 97 active+clean; 577 KiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:52.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:51 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/612412777' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:52.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:51 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:52.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:51 smithi107 ceph-mon[35463]: pgmap v334: 97 pgs: 97 active+clean; 577 KiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:52.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:51 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/612412777' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:52.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:51 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:51 smithi077 ceph-mon[35095]: pgmap v334: 97 pgs: 97 active+clean; 577 KiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:51 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/612412777' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:52.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:51 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:52.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid f18ee350-70a8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T02:09:52.940 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:53.078 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:52 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:53.079 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:52 smithi062 ceph-mon[30666]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:09:53.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:52 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:53.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:52 smithi107 ceph-mon[35463]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:09:53.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:52 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:53.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:52 smithi077 ceph-mon[35095]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:09:53.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.510+0000 7fc329c00640 1 -- 172.21.15.62:0/917618273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc324074f40 msgr2=0x7fc32410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:53.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.510+0000 7fc329c00640 1 --2- 172.21.15.62:0/917618273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc324074f40 0x7fc32410de80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009900 tx=0x7fc30c02a480 comp rx=0 tx=0).stop 2024-09-12T02:09:53.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.511+0000 7fc329c00640 1 -- 172.21.15.62:0/917618273 shutdown_connections 2024-09-12T02:09:53.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.511+0000 7fc329c00640 1 --2- 172.21.15.62:0/917618273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc32410e3c0 0x7fc324110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.511+0000 7fc329c00640 1 --2- 172.21.15.62:0/917618273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc324074f40 0x7fc32410de80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.511+0000 7fc329c00640 1 --2- 172.21.15.62:0/917618273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc324074620 0x7fc324074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.511+0000 7fc329c00640 1 -- 172.21.15.62:0/917618273 >> 172.21.15.62:0/917618273 conn(0x7fc3240fd8c0 msgr2=0x7fc3240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:53.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.511+0000 7fc329c00640 1 -- 172.21.15.62:0/917618273 shutdown_connections 2024-09-12T02:09:53.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.511+0000 7fc329c00640 1 -- 172.21.15.62:0/917618273 wait complete. 2024-09-12T02:09:53.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.512+0000 7fc329c00640 1 Processor -- start 2024-09-12T02:09:53.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.512+0000 7fc329c00640 1 -- start start 2024-09-12T02:09:53.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.512+0000 7fc329c00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc324074620 0x7fc32419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:53.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.512+0000 7fc329c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc324074f40 0x7fc32419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:53.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.512+0000 7fc329c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc32410e3c0 0x7fc32419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:53.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.512+0000 7fc329c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc3241141b0 con 0x7fc32410e3c0 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.512+0000 7fc329c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc324114030 con 0x7fc324074f40 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.512+0000 7fc329c00640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc324114330 con 0x7fc324074620 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc31a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc324074f40 0x7fc32419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc322a00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc324074620 0x7fc32419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc31a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc324074f40 0x7fc32419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.62:51154/0 (socket says 172.21.15.62:51154) 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc31a000640 1 -- 172.21.15.62:0/619727335 learned_addr learned my addr 172.21.15.62:0/619727335 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc323400640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc32410e3c0 0x7fc32419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc322a00640 1 -- 172.21.15.62:0/619727335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc324074f40 msgr2=0x7fc32419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc322a00640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc324074f40 0x7fc32419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc322a00640 1 -- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc32410e3c0 msgr2=0x7fc32419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc322a00640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc32410e3c0 0x7fc32419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc322a00640 1 -- 172.21.15.62:0/619727335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32419f640 con 0x7fc324074620 2024-09-12T02:09:53.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc323400640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc32410e3c0 0x7fc32419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:09:53.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.513+0000 7fc322a00640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc324074620 0x7fc32419a690 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc31400e9f0 tx=0x7fc31400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:53.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.514+0000 7fc31be00640 1 -- 172.21.15.62:0/619727335 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31400ccc0 con 0x7fc324074620 2024-09-12T02:09:53.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.514+0000 7fc329c00640 1 -- 172.21.15.62:0/619727335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32419f930 con 0x7fc324074620 2024-09-12T02:09:53.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.514+0000 7fc31be00640 1 -- 172.21.15.62:0/619727335 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc314005020 con 0x7fc324074620 2024-09-12T02:09:53.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.514+0000 7fc31be00640 1 -- 172.21.15.62:0/619727335 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3140049e0 con 0x7fc324074620 2024-09-12T02:09:53.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.514+0000 7fc329c00640 1 -- 172.21.15.62:0/619727335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3241a7210 con 0x7fc324074620 2024-09-12T02:09:53.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.515+0000 7fc329c00640 1 -- 172.21.15.62:0/619727335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc324074a00 con 0x7fc324074620 2024-09-12T02:09:53.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.517+0000 7fc31be00640 1 -- 172.21.15.62:0/619727335 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc314005560 con 0x7fc324074620 2024-09-12T02:09:53.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.518+0000 7fc31be00640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fc3080a2cf0 0x7fc3080a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:53.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.518+0000 7fc31be00640 1 -- 172.21.15.62:0/619727335 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8410+0+0 (secure 0 0 0) 0x7fc3140cf500 con 0x7fc324074620 2024-09-12T02:09:53.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.518+0000 7fc31a000640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fc3080a2cf0 0x7fc3080a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:53.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.519+0000 7fc31a000640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fc3080a2cf0 0x7fc3080a51b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0096c0 tx=0x7fc30c0046c0 comp rx=0 tx=0).ready entity=mgr.25070 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:53.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.520+0000 7fc31be00640 1 -- 172.21.15.62:0/619727335 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3140051d0 con 0x7fc324074620 2024-09-12T02:09:53.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.705+0000 7fc329c00640 1 -- 172.21.15.62:0/619727335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc32419b9f0 con 0x7fc324074620 2024-09-12T02:09:53.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.819+0000 7fc31be00640 1 -- 172.21.15.62:0/619727335 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v107) ==== 178+0+0 (secure 0 0 0) 0x7fc32419b9f0 con 0x7fc324074620 2024-09-12T02:09:53.821 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data_ec' removed 2024-09-12T02:09:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.823+0000 7fc329c00640 1 -- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fc3080a2cf0 msgr2=0x7fc3080a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.823+0000 7fc329c00640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fc3080a2cf0 0x7fc3080a51b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0096c0 tx=0x7fc30c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.823+0000 7fc329c00640 1 -- 172.21.15.62:0/619727335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc324074620 msgr2=0x7fc32419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.823+0000 7fc329c00640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc324074620 0x7fc32419a690 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc31400e9f0 tx=0x7fc31400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.824+0000 7fc329c00640 1 -- 172.21.15.62:0/619727335 shutdown_connections 2024-09-12T02:09:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.824+0000 7fc329c00640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:6800/2226410445,v1:172.21.15.62:6801/2226410445] conn(0x7fc3080a2cf0 0x7fc3080a51b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.824+0000 7fc329c00640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc32410e3c0 0x7fc32419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.824+0000 7fc329c00640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc324074f40 0x7fc32419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.824+0000 7fc329c00640 1 --2- 172.21.15.62:0/619727335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc324074620 0x7fc32419a690 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.824+0000 7fc329c00640 1 -- 172.21.15.62:0/619727335 >> 172.21.15.62:0/619727335 conn(0x7fc3240fd8c0 msgr2=0x7fc3240fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.824+0000 7fc329c00640 1 -- 172.21.15.62:0/619727335 shutdown_connections 2024-09-12T02:09:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T02:09:53.824+0000 7fc329c00640 1 -- 172.21.15.62:0/619727335 wait complete. 2024-09-12T02:09:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:53 smithi062 ceph-mon[30666]: pgmap v336: 33 pgs: 33 active+clean; 577 KiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:53 smithi062 ceph-mon[30666]: from='client.? 172.21.15.62:0/619727335' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:54.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:53 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:54.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:53 smithi107 ceph-mon[35463]: pgmap v336: 33 pgs: 33 active+clean; 577 KiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:54.203 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:53 smithi107 ceph-mon[35463]: from='client.? 172.21.15.62:0/619727335' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:54.204 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:53 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:53 smithi077 ceph-mon[35095]: pgmap v336: 33 pgs: 33 active+clean; 577 KiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:09:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:53 smithi077 ceph-mon[35095]: from='client.? 172.21.15.62:0/619727335' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:54.214 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:53 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:09:54.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:09:54.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:09:54.655 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:09:54.689 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T02:09:54.689 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:09:54.724 DEBUG:teuthology.orchestra.run.smithi077:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:09:54.742 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:09:54.760 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T02:09:54.761 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T02:09:54.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:09:54.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:54 smithi107 ceph-mon[35463]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:54.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:54 smithi107 ceph-mon[35463]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:09:54.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:54 smithi077 ceph-mon[35095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:54.964 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:54 smithi077 ceph-mon[35095]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:09:55.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:54 smithi062 ceph-mon[30666]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:09:55.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:54 smithi062 ceph-mon[30666]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:09:55.092 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:54 smithi062 systemd[1]: Stopping Ceph mon.a for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:09:55.552 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:55 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a[30662]: 2024-09-12T02:09:55.214+0000 7f59e7800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:09:55.552 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:55 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a[30662]: 2024-09-12T02:09:55.214+0000 7f59e7800640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T02:09:55.552 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:55 smithi062 podman[90287]: 2024-09-12 02:09:55.358698489 +0000 UTC m=+0.304087530 container died 39307ccb1c721dc1c14918c03b07102d1bd1601bc2c174b6d996e36b36f5a4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:09:55.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:55 smithi062 podman[90287]: 2024-09-12 02:09:55.778813649 +0000 UTC m=+0.724202688 container cleanup 39307ccb1c721dc1c14918c03b07102d1bd1601bc2c174b6d996e36b36f5a4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True) 2024-09-12T02:09:55.842 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:55 smithi062 bash[90287]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:09:56.302 INFO:journalctl@ceph.mon.a.smithi062.stdout:Sep 12 02:09:56 smithi062 podman[90299]: 2024-09-12 02:09:56.01408833 +0000 UTC m=+0.638914529 container remove 39307ccb1c721dc1c14918c03b07102d1bd1601bc2c174b6d996e36b36f5a4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:09:56.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T02:09:56.415 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:09:56.416 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T02:09:56.416 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T02:09:56.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.b 2024-09-12T02:09:56.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:56 smithi077 systemd[1]: Stopping Ceph mon.b for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:09:57.125 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:56 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-b[35091]: 2024-09-12T02:09:56.723+0000 7f3c3f7db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:09:57.125 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:56 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-b[35091]: 2024-09-12T02:09:56.723+0000 7f3c3f7db640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:09:57.125 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:56 smithi077 podman[70797]: 2024-09-12 02:09:56.80575105 +0000 UTC m=+0.191937352 container died fb80326a66f4b18dcb20ddcf0ec8ac3ce6a5a9d6e6a96d5487d3aa23b1781624 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True) 2024-09-12T02:09:57.458 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:57 smithi077 podman[70797]: 2024-09-12 02:09:57.224356736 +0000 UTC m=+0.610543050 container cleanup fb80326a66f4b18dcb20ddcf0ec8ac3ce6a5a9d6e6a96d5487d3aa23b1781624 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T02:09:57.459 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:57 smithi077 bash[70797]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-b 2024-09-12T02:09:57.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T02:09:57.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:57 smithi077 podman[70808]: 2024-09-12 02:09:57.45925942 +0000 UTC m=+0.652652482 container remove fb80326a66f4b18dcb20ddcf0ec8ac3ce6a5a9d6e6a96d5487d3aa23b1781624 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:09:57.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:57 smithi077 systemd[1]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-12T02:09:57.714 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:57 smithi077 systemd[1]: Stopped Ceph mon.b for f18ee350-70a8-11ef-bcea-c7b262605968. 2024-09-12T02:09:57.715 INFO:journalctl@ceph.mon.b.smithi077.stdout:Sep 12 02:09:57 smithi077 systemd[1]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.b.service: Consumed 13.470s CPU time. 2024-09-12T02:09:57.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:09:57.759 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T02:09:57.759 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T02:09:57.759 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.c 2024-09-12T02:09:58.079 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:57 smithi107 systemd[1]: Stopping Ceph mon.c for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:09:58.453 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:58 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-c[35459]: 2024-09-12T02:09:58.078+0000 7f9483c5c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:09:58.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:58 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-c[35459]: 2024-09-12T02:09:58.078+0000 7f9483c5c640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:09:58.454 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:58 smithi107 podman[71527]: 2024-09-12 02:09:58.323803119 +0000 UTC m=+0.360381558 container died b08c8381ddeff5d3bbedf103b130352118aafc161d1be98a872343e9a7a4c4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T02:09:58.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:58 smithi107 podman[71527]: 2024-09-12 02:09:58.72934123 +0000 UTC m=+0.765919672 container cleanup b08c8381ddeff5d3bbedf103b130352118aafc161d1be98a872343e9a7a4c4e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T02:09:58.953 INFO:journalctl@ceph.mon.c.smithi107.stdout:Sep 12 02:09:58 smithi107 bash[71527]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mon-c 2024-09-12T02:09:59.147 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T02:09:59.187 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:09:59.188 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T02:09:59.188 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T02:09:59.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:09:59.591 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:09:59 smithi062 systemd[1]: Stopping Ceph mgr.x for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:10:00.053 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:09:59 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T02:09:59.627+0000 7f2bca400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:00.053 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:09:59 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x[30889]: 2024-09-12T02:09:59.627+0000 7f2bca400640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-12T02:10:00.053 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:09:59 smithi062 podman[90409]: 2024-09-12 02:09:59.711572016 +0000 UTC m=+0.228051094 container stop d0e9031ef5e832ac715a713aab084b1b45a264780cded574a5994971167ba33d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T02:10:00.053 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:09:59 smithi062 podman[90409]: 2024-09-12 02:09:59.737430405 +0000 UTC m=+0.253909487 container died d0e9031ef5e832ac715a713aab084b1b45a264780cded574a5994971167ba33d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:10:00.342 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:10:00 smithi062 podman[90409]: 2024-09-12 02:10:00.226960592 +0000 UTC m=+0.743439663 container cleanup d0e9031ef5e832ac715a713aab084b1b45a264780cded574a5994971167ba33d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T02:10:00.342 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:10:00 smithi062 bash[90409]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x 2024-09-12T02:10:00.698 INFO:journalctl@ceph.mgr.x.smithi062.stdout:Sep 12 02:10:00 smithi062 podman[90421]: 2024-09-12 02:10:00.428892195 +0000 UTC m=+0.700318631 container remove d0e9031ef5e832ac715a713aab084b1b45a264780cded574a5994971167ba33d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T02:10:00.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T02:10:00.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:00.801 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T02:10:00.801 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T02:10:00.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.y 2024-09-12T02:10:01.133 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 02:10:00 smithi077 systemd[1]: Stopping Ceph mgr.y for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:10:01.439 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 02:10:01 smithi077 podman[70919]: 2024-09-12 02:10:01.133686513 +0000 UTC m=+0.141063632 container died e399527f2314668c9698e1f2717f1a8f5d0d0fc9688b16ad9779a0f4520efd81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T02:10:01.714 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 02:10:01 smithi077 podman[70919]: 2024-09-12 02:10:01.546640841 +0000 UTC m=+0.554017945 container cleanup e399527f2314668c9698e1f2717f1a8f5d0d0fc9688b16ad9779a0f4520efd81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T02:10:01.714 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Sep 12 02:10:01 smithi077 bash[70919]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-y 2024-09-12T02:10:01.936 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T02:10:01.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:01.972 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T02:10:01.972 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T02:10:01.973 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.z 2024-09-12T02:10:02.305 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 02:10:02 smithi107 systemd[1]: Stopping Ceph mgr.z for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:10:02.601 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 02:10:02 smithi107 podman[71654]: 2024-09-12 02:10:02.305204608 +0000 UTC m=+0.144661674 container died f38e15141b9569c18f6731d2bb2e23f99650fdcce647e627cafc1fedf51e19e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:10:02.953 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 02:10:02 smithi107 podman[71654]: 2024-09-12 02:10:02.701673804 +0000 UTC m=+0.541130822 container cleanup f38e15141b9569c18f6731d2bb2e23f99650fdcce647e627cafc1fedf51e19e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T02:10:02.954 INFO:journalctl@ceph.mgr.z.smithi107.stdout:Sep 12 02:10:02 smithi107 bash[71654]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mgr-z 2024-09-12T02:10:03.127 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T02:10:03.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:03.162 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T02:10:03.162 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T02:10:03.162 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.0 2024-09-12T02:10:03.585 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:03 smithi062 systemd[1]: Stopping Ceph osd.0 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:10:03.841 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0[44542]: 2024-09-12T02:10:03.585+0000 7f78af400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:03.842 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0[44542]: 2024-09-12T02:10:03.585+0000 7f78af400640 -1 osd.0 107 *** Got signal Terminated *** 2024-09-12T02:10:03.842 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0[44542]: 2024-09-12T02:10:03.585+0000 7f78af400640 -1 osd.0 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:09.341 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:09 smithi062 podman[90531]: 2024-09-12 02:10:09.025997101 +0000 UTC m=+5.565173689 container died 5952e09d58b68adb9a0c6978af13e6a08ba4b647a969a0b670e5ef41bfaa4495 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T02:10:09.676 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:09 smithi062 podman[90531]: 2024-09-12 02:10:09.457722336 +0000 UTC m=+5.996898923 container cleanup 5952e09d58b68adb9a0c6978af13e6a08ba4b647a969a0b670e5ef41bfaa4495 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T02:10:09.676 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:09 smithi062 bash[90531]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0 2024-09-12T02:10:10.091 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:09 smithi062 podman[90550]: 2024-09-12 02:10:09.67617192 +0000 UTC m=+0.642469965 container remove 5952e09d58b68adb9a0c6978af13e6a08ba4b647a969a0b670e5ef41bfaa4495 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:10:10.563 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:10 smithi062 podman[90637]: 2024-09-12 02:10:10.121435453 +0000 UTC m=+0.027036200 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:10.563 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:10 smithi062 podman[90637]: 2024-09-12 02:10:10.252050491 +0000 UTC m=+0.157651216 container create 3359d28752f0693e939d0ee97bf13c9f078ad11235658476ee81d49612ae5885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:10.563 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:10 smithi062 podman[90637]: 2024-09-12 02:10:10.563557766 +0000 UTC m=+0.469158523 container init 3359d28752f0693e939d0ee97bf13c9f078ad11235658476ee81d49612ae5885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T02:10:10.834 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:10 smithi062 podman[90637]: 2024-09-12 02:10:10.570845633 +0000 UTC m=+0.476446361 container start 3359d28752f0693e939d0ee97bf13c9f078ad11235658476ee81d49612ae5885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T02:10:10.834 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:10 smithi062 podman[90637]: 2024-09-12 02:10:10.713338232 +0000 UTC m=+0.618938971 container attach 3359d28752f0693e939d0ee97bf13c9f078ad11235658476ee81d49612ae5885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T02:10:11.092 INFO:journalctl@ceph.osd.0.smithi062.stdout:Sep 12 02:10:10 smithi062 podman[90637]: 2024-09-12 02:10:10.835012011 +0000 UTC m=+0.740612747 container died 3359d28752f0693e939d0ee97bf13c9f078ad11235658476ee81d49612ae5885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:11.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T02:10:11.646 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:11.646 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T02:10:11.646 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T02:10:11.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.1 2024-09-12T02:10:11.960 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:11 smithi077 systemd[1]: Stopping Ceph osd.1 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:10:12.214 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:11 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1[39548]: 2024-09-12T02:10:11.959+0000 7febd343b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:12.214 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:11 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1[39548]: 2024-09-12T02:10:11.959+0000 7febd343b640 -1 osd.1 107 *** Got signal Terminated *** 2024-09-12T02:10:12.214 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:11 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1[39548]: 2024-09-12T02:10:11.959+0000 7febd343b640 -1 osd.1 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:17.715 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:17 smithi077 podman[71051]: 2024-09-12 02:10:17.444954514 +0000 UTC m=+5.600544454 container died 7d433f223e48d871dbf9e8e843802dc2db4466d3a7607db4bd034c3e724ea3a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:18.111 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:17 smithi077 podman[71051]: 2024-09-12 02:10:17.860185818 +0000 UTC m=+6.015775807 container cleanup 7d433f223e48d871dbf9e8e843802dc2db4466d3a7607db4bd034c3e724ea3a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:10:18.111 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:17 smithi077 bash[71051]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1 2024-09-12T02:10:18.464 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:18 smithi077 podman[71070]: 2024-09-12 02:10:18.111661969 +0000 UTC m=+0.664417152 container remove 7d433f223e48d871dbf9e8e843802dc2db4466d3a7607db4bd034c3e724ea3a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:10:18.798 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:18 smithi077 podman[71155]: 2024-09-12 02:10:18.429551126 +0000 UTC m=+0.015582794 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:18.799 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:18 smithi077 podman[71155]: 2024-09-12 02:10:18.554260523 +0000 UTC m=+0.140292184 container create 6213bb4bb9ea776431590d65b1d3caee87787e506a4028ebf6faa4f78a254e98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:10:19.214 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:18 smithi077 podman[71155]: 2024-09-12 02:10:18.798852444 +0000 UTC m=+0.384884117 container init 6213bb4bb9ea776431590d65b1d3caee87787e506a4028ebf6faa4f78a254e98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True) 2024-09-12T02:10:19.214 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:18 smithi077 podman[71155]: 2024-09-12 02:10:18.802589099 +0000 UTC m=+0.388620771 container start 6213bb4bb9ea776431590d65b1d3caee87787e506a4028ebf6faa4f78a254e98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T02:10:19.215 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:18 smithi077 podman[71155]: 2024-09-12 02:10:18.890329473 +0000 UTC m=+0.476361148 container attach 6213bb4bb9ea776431590d65b1d3caee87787e506a4028ebf6faa4f78a254e98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T02:10:19.215 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 12 02:10:19 smithi077 podman[71178]: 2024-09-12 02:10:19.018886536 +0000 UTC m=+0.016350047 container died 6213bb4bb9ea776431590d65b1d3caee87787e506a4028ebf6faa4f78a254e98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T02:10:19.706 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T02:10:19.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:19.749 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T02:10:19.749 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T02:10:19.749 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.2 2024-09-12T02:10:20.081 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:19 smithi107 systemd[1]: Stopping Ceph osd.2 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:10:20.453 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2[40436]: 2024-09-12T02:10:20.080+0000 7ff1c8128640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:20.453 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2[40436]: 2024-09-12T02:10:20.080+0000 7ff1c8128640 -1 osd.2 107 *** Got signal Terminated *** 2024-09-12T02:10:20.454 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2[40436]: 2024-09-12T02:10:20.080+0000 7ff1c8128640 -1 osd.2 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:25.697 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:25 smithi107 podman[71794]: 2024-09-12 02:10:25.400132785 +0000 UTC m=+5.450320848 container died 681e4ceb24dc79bb7fe07bad7364c716638a4b7bafbf041dde1e038db6dc30f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-12T02:10:25.953 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:25 smithi107 podman[71794]: 2024-09-12 02:10:25.795985188 +0000 UTC m=+5.846173238 container cleanup 681e4ceb24dc79bb7fe07bad7364c716638a4b7bafbf041dde1e038db6dc30f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T02:10:25.954 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:25 smithi107 bash[71794]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2 2024-09-12T02:10:26.406 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:26 smithi107 podman[71811]: 2024-09-12 02:10:26.055862587 +0000 UTC m=+0.647702162 container remove 681e4ceb24dc79bb7fe07bad7364c716638a4b7bafbf041dde1e038db6dc30f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T02:10:26.703 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:26 smithi107 podman[71899]: 2024-09-12 02:10:26.310045846 +0000 UTC m=+0.015715720 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:26.703 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:26 smithi107 podman[71899]: 2024-09-12 02:10:26.414805473 +0000 UTC m=+0.120475337 container create e9c58cb1ebb6a1c0b43ed0ed5eea73a3b94a14c20e473544a1dc3c9380c89a96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:10:26.704 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:26 smithi107 podman[71899]: 2024-09-12 02:10:26.642261352 +0000 UTC m=+0.347931219 container init e9c58cb1ebb6a1c0b43ed0ed5eea73a3b94a14c20e473544a1dc3c9380c89a96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:10:26.704 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:26 smithi107 podman[71899]: 2024-09-12 02:10:26.645566119 +0000 UTC m=+0.351235987 container start e9c58cb1ebb6a1c0b43ed0ed5eea73a3b94a14c20e473544a1dc3c9380c89a96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T02:10:27.195 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:26 smithi107 podman[71899]: 2024-09-12 02:10:26.758981144 +0000 UTC m=+0.464651029 container attach e9c58cb1ebb6a1c0b43ed0ed5eea73a3b94a14c20e473544a1dc3c9380c89a96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:10:27.195 INFO:journalctl@ceph.osd.2.smithi107.stdout:Sep 12 02:10:26 smithi107 podman[71899]: 2024-09-12 02:10:26.835167371 +0000 UTC m=+0.540837242 container died e9c58cb1ebb6a1c0b43ed0ed5eea73a3b94a14c20e473544a1dc3c9380c89a96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T02:10:27.512 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T02:10:27.553 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:27.553 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T02:10:27.553 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T02:10:27.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.3 2024-09-12T02:10:27.948 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:27 smithi062 systemd[1]: Stopping Ceph osd.3 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:10:28.341 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:27 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3[51461]: 2024-09-12T02:10:27.948+0000 7f762a000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:28.342 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:27 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3[51461]: 2024-09-12T02:10:27.948+0000 7f762a000640 -1 osd.3 107 *** Got signal Terminated *** 2024-09-12T02:10:28.342 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:27 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3[51461]: 2024-09-12T02:10:27.948+0000 7f762a000640 -1 osd.3 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:30.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:30 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:30.304+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:30.953 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:30 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:30.631+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:31.591 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:31 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3[51461]: 2024-09-12T02:10:31.109+0000 7f7620a00640 -1 osd.3 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.245924+0000 front 2024-09-12T02:10:05.245840+0000 (oldest deadline 2024-09-12T02:10:30.545996+0000) 2024-09-12T02:10:31.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:31 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:31.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:31.953 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:31 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:31.677+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:31.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:31 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:31.464+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:32.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:31 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:31.771+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:32.591 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:32 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3[51461]: 2024-09-12T02:10:32.144+0000 7f7620a00640 -1 osd.3 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.245924+0000 front 2024-09-12T02:10:05.245840+0000 (oldest deadline 2024-09-12T02:10:30.545996+0000) 2024-09-12T02:10:32.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:32 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:32.272+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:32.953 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:32.687+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:32.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:32.491+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:33.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:32 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:32.728+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:33.697 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:33 smithi062 podman[90739]: 2024-09-12 02:10:33.371055122 +0000 UTC m=+5.534301681 container died ebadf660d2fb8686080dd4e68c0f5587cda62f9f16a999fa3262f684698b34e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T02:10:33.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:33 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:33.298+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:33.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:33 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:33.518+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:33.954 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:33 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:33.674+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:34.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:33 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:33.716+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:34.092 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:33 smithi062 podman[90739]: 2024-09-12 02:10:33.833589292 +0000 UTC m=+5.996835838 container cleanup ebadf660d2fb8686080dd4e68c0f5587cda62f9f16a999fa3262f684698b34e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T02:10:34.092 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:33 smithi062 bash[90739]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3 2024-09-12T02:10:34.591 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:34 smithi062 podman[90768]: 2024-09-12 02:10:34.163989133 +0000 UTC m=+0.787579709 container remove ebadf660d2fb8686080dd4e68c0f5587cda62f9f16a999fa3262f684698b34e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T02:10:34.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:34 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:34.345+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:34.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:34 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:34.485+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:34.954 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:34 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:34.642+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:35.076 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:34 smithi062 podman[90850]: 2024-09-12 02:10:34.659622199 +0000 UTC m=+0.026971006 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:35.076 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:34 smithi062 podman[90850]: 2024-09-12 02:10:34.773332243 +0000 UTC m=+0.140681034 container create 3523fc7c02b474e4d2b8bfe81a3a2a3a4a8289f1ecbcd9ab876aaf1c3bcc4f9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:10:35.076 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:35 smithi062 podman[90850]: 2024-09-12 02:10:35.076221616 +0000 UTC m=+0.443570408 container init 3523fc7c02b474e4d2b8bfe81a3a2a3a4a8289f1ecbcd9ab876aaf1c3bcc4f9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:10:35.076 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:34 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:34.703+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:35.341 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:35 smithi062 podman[90850]: 2024-09-12 02:10:35.084020471 +0000 UTC m=+0.451369263 container start 3523fc7c02b474e4d2b8bfe81a3a2a3a4a8289f1ecbcd9ab876aaf1c3bcc4f9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:10:35.342 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:35 smithi062 podman[90850]: 2024-09-12 02:10:35.192587768 +0000 UTC m=+0.559936570 container attach 3523fc7c02b474e4d2b8bfe81a3a2a3a4a8289f1ecbcd9ab876aaf1c3bcc4f9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:10:35.672 INFO:journalctl@ceph.osd.3.smithi062.stdout:Sep 12 02:10:35 smithi062 podman[90850]: 2024-09-12 02:10:35.35267129 +0000 UTC m=+0.720020109 container died 3523fc7c02b474e4d2b8bfe81a3a2a3a4a8289f1ecbcd9ab876aaf1c3bcc4f9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:10:35.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:35 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:35.388+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:35.953 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:35 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:35.644+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:35.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:35 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:35.488+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:36.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:35 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:35.671+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:36.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T02:10:36.234 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:36.235 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T02:10:36.235 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T02:10:36.235 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.4 2024-09-12T02:10:36.547 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:36 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:36.345+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:36.547 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:36 smithi077 systemd[1]: Stopping Ceph osd.4 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:10:36.953 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:36 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:36.664+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:36.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:36 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:36.463+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:36.964 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:36 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4[46448]: 2024-09-12T02:10:36.547+0000 7fc91a894640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:36.964 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:36 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4[46448]: 2024-09-12T02:10:36.547+0000 7fc91a894640 -1 osd.4 107 *** Got signal Terminated *** 2024-09-12T02:10:36.964 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:36 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4[46448]: 2024-09-12T02:10:36.547+0000 7fc91a894640 -1 osd.4 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:37.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:36 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:36.703+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:37.690 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:37 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:37.431+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:37.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:37 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:37.328+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:37.953 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:37 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:37.690+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:38.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:37 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:37.707+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:38.648 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:38 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:38.383+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:38.648 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:38 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:38.383+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:38.648 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:38 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:38.647+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:38.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:38 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:38.318+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:38.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:38 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:38.520+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:39.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:38 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:38.682+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:39.634 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:39 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:39.383+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:39.634 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:39 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:39.383+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:39.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:39 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:39.560+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:39.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:39 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:39.322+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:39.928 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:39 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:39.673+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:39.953 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:39 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:39.633+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:40.342 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:40 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:40.062+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:40.614 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:40 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:40.533+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:40.614 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:40 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:40.297+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:40.614 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:40 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:40.297+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:40.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:40 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:40.654+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:40.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:40 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:40.654+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.651497+0000 front 2024-09-12T02:10:15.651568+0000 (oldest deadline 2024-09-12T02:10:39.751598+0000) 2024-09-12T02:10:40.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:40 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:40.411+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:40.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:40 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:40.411+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:40.841 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:40 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:40.671+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:40.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:40 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:40.671+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:40.964 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:40 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4[46448]: 2024-09-12T02:10:40.613+0000 7fc916eaa640 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.152123+0000 front 2024-09-12T02:10:16.152165+0000 (oldest deadline 2024-09-12T02:10:40.252227+0000) 2024-09-12T02:10:41.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:41 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:41.104+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:41.630 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:41 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:41.486+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:41.630 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:41 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:41.271+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:41.630 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:41 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:41.271+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:41.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:41 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:41.433+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:41.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:41 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:41.433+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:41.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:41 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:41.655+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:41.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:41 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:41.655+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.651497+0000 front 2024-09-12T02:10:15.651568+0000 (oldest deadline 2024-09-12T02:10:39.751598+0000) 2024-09-12T02:10:42.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:41 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:41.679+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:42.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:41 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:41.679+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:42.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:41 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:41.851+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:42.214 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:42 smithi077 podman[71257]: 2024-09-12 02:10:42.095604344 +0000 UTC m=+5.663716723 container died aba4758a23dfd42cceffc282b88664010ac9c4e8a33d8c1d3962f9c3e3861921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T02:10:42.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:42 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:42.097+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:42.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:42 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:42.504+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:42.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:42 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:42.282+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:42.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:42 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:42.282+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:42.715 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:42 smithi077 podman[71257]: 2024-09-12 02:10:42.505587325 +0000 UTC m=+6.073699707 container cleanup aba4758a23dfd42cceffc282b88664010ac9c4e8a33d8c1d3962f9c3e3861921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T02:10:42.715 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:42 smithi077 bash[71257]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4 2024-09-12T02:10:42.899 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:42 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:42.649+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:42.899 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:42 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:42.649+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.651497+0000 front 2024-09-12T02:10:15.651568+0000 (oldest deadline 2024-09-12T02:10:39.751598+0000) 2024-09-12T02:10:42.899 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:42 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:42.475+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:42.900 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:42 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:42.475+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:43.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:42 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:42.668+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:43.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:42 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:42.668+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:43.182 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:42 smithi077 podman[71282]: 2024-09-12 02:10:42.745556692 +0000 UTC m=+0.651540081 container remove aba4758a23dfd42cceffc282b88664010ac9c4e8a33d8c1d3962f9c3e3861921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:10:43.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:42 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:42.898+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:43.464 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:43 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:43.325+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:43.464 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:43 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:43.325+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:43.465 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:43 smithi077 podman[71370]: 2024-09-12 02:10:43.183073047 +0000 UTC m=+0.111208213 container create 1a7d5da6c0e36778fa0ec3f3a40c5c556e614c3d53a633f4172a318cc8bd155d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:10:43.465 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:43 smithi077 podman[71370]: 2024-09-12 02:10:43.087885985 +0000 UTC m=+0.016021167 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:43.465 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:43 smithi077 podman[71370]: 2024-09-12 02:10:43.427305199 +0000 UTC m=+0.355440367 container init 1a7d5da6c0e36778fa0ec3f3a40c5c556e614c3d53a633f4172a318cc8bd155d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T02:10:43.465 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:43 smithi077 podman[71370]: 2024-09-12 02:10:43.430644671 +0000 UTC m=+0.358779840 container start 1a7d5da6c0e36778fa0ec3f3a40c5c556e614c3d53a633f4172a318cc8bd155d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T02:10:43.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:43 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:43.144+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:43.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:43 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:43.443+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:43.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:43 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:43.443+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:43.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:43 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:43.643+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:43.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:43 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:43.643+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.651497+0000 front 2024-09-12T02:10:15.651568+0000 (oldest deadline 2024-09-12T02:10:39.751598+0000) 2024-09-12T02:10:43.963 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:43 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:43.540+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:43.963 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:43 smithi077 podman[71370]: 2024-09-12 02:10:43.552526179 +0000 UTC m=+0.480661354 container attach 1a7d5da6c0e36778fa0ec3f3a40c5c556e614c3d53a633f4172a318cc8bd155d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T02:10:43.963 INFO:journalctl@ceph.osd.4.smithi077.stdout:Sep 12 02:10:43 smithi077 podman[71370]: 2024-09-12 02:10:43.616312396 +0000 UTC m=+0.544447563 container died 1a7d5da6c0e36778fa0ec3f3a40c5c556e614c3d53a633f4172a318cc8bd155d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T02:10:44.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:43 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:43.687+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:44.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:43 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:43.687+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:44.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:43 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:43.866+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:44.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T02:10:44.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:44.302 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T02:10:44.302 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T02:10:44.302 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.5 2024-09-12T02:10:44.494 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:44 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:44.330+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:44.495 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:44 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:44.330+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:44.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:44 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:44.152+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:44.606 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:44 smithi107 systemd[1]: Stopping Ceph osd.5 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:10:44.606 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:44 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:44.483+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:44.606 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:44 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:44.483+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:44.953 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:44 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:44.847+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:44.954 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:44 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:44.605+0000 7f300ed08640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:44.954 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:44 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:44.605+0000 7f300ed08640 -1 osd.5 107 *** Got signal Terminated *** 2024-09-12T02:10:44.954 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:44 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:44.605+0000 7f300ed08640 -1 osd.5 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:44.954 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:44 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:44.610+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:44.954 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:44 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:44.610+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.651497+0000 front 2024-09-12T02:10:15.651568+0000 (oldest deadline 2024-09-12T02:10:39.751598+0000) 2024-09-12T02:10:44.964 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:44 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:44.494+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:45.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:44 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:44.640+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:45.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:44 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:44.640+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:45.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:45 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:45.167+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:45.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:45 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:45.335+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:45.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:45 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:45.335+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:45.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:45 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:45.539+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:45.715 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:45 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:45.539+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:45.879 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:45.574+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:45.879 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:45.574+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.651497+0000 front 2024-09-12T02:10:15.651568+0000 (oldest deadline 2024-09-12T02:10:39.751598+0000) 2024-09-12T02:10:45.879 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:45.574+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.452689+0000 front 2024-09-12T02:10:24.452671+0000 (oldest deadline 2024-09-12T02:10:45.552821+0000) 2024-09-12T02:10:45.879 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:45.490+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:45.879 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:45.490+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:46.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:45 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:45.640+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:46.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:45 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:45.640+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:46.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:45 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:45.878+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:46.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:46 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:46.162+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:46.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:46 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:46.531+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:46.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:46 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:46.531+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:46.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:46 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:46.293+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:46.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:46 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:46.293+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:46.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:46 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:46.293+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:46.878 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:46 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:46.529+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:46.878 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:46 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:46.529+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.651497+0000 front 2024-09-12T02:10:15.651568+0000 (oldest deadline 2024-09-12T02:10:39.751598+0000) 2024-09-12T02:10:46.878 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:46 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:46.529+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.452689+0000 front 2024-09-12T02:10:24.452671+0000 (oldest deadline 2024-09-12T02:10:45.552821+0000) 2024-09-12T02:10:46.878 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:46 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:46.495+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:46.878 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:46 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:46.495+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:46.878 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:46 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:46.495+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:47.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:46 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:46.602+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:47.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:46 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:46.602+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:47.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:46 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:46.877+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:47.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:47 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:47.168+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:47.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:47 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:47.261+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:47.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:47 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:47.261+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:47.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:47 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:47.261+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:47.715 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:47 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:47.502+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:47.715 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:47 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:47.502+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:47.877 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:47 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:47.460+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:47.877 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:47 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:47.460+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:47.877 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:47 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:47.460+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:47.878 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:47 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:47.565+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:47.878 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:47 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:47.565+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.651497+0000 front 2024-09-12T02:10:15.651568+0000 (oldest deadline 2024-09-12T02:10:39.751598+0000) 2024-09-12T02:10:47.878 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:47 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:47.565+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.452689+0000 front 2024-09-12T02:10:24.452671+0000 (oldest deadline 2024-09-12T02:10:45.552821+0000) 2024-09-12T02:10:48.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:47 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:47.642+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:48.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:47 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:47.642+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:48.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:47 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:47.642+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:48.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:47 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:47.876+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:48.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:47 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:47.876+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:48.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:48.217+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:48.592 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:48.217+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.060263+0000 front 2024-09-12T02:10:22.060285+0000 (oldest deadline 2024-09-12T02:10:47.360069+0000) 2024-09-12T02:10:48.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:48 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:48.491+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:48.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:48 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:48.491+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:48.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:48 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:48.303+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:48.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:48 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:48.303+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:48.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:48 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:48.303+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:48.896 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:48 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:48.453+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:48.896 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:48 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:48.453+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:48.897 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:48 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:48.453+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:48.897 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:48 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:48.579+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:48.897 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:48 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:48.579+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.651497+0000 front 2024-09-12T02:10:15.651568+0000 (oldest deadline 2024-09-12T02:10:39.751598+0000) 2024-09-12T02:10:48.897 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:48 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:48.579+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.452689+0000 front 2024-09-12T02:10:24.452671+0000 (oldest deadline 2024-09-12T02:10:45.552821+0000) 2024-09-12T02:10:49.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:48.692+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:49.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:48.692+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:49.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:48.692+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:49.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:48 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:48.896+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:49.204 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:48 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:48.896+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:49.592 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:49 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:49.223+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:49.592 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:49 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:49.223+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.060263+0000 front 2024-09-12T02:10:22.060285+0000 (oldest deadline 2024-09-12T02:10:47.360069+0000) 2024-09-12T02:10:49.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:49 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:49.563+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.150078+0000 front 2024-09-12T02:10:05.149871+0000 (oldest deadline 2024-09-12T02:10:30.450100+0000) 2024-09-12T02:10:49.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:49 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:49.563+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.651497+0000 front 2024-09-12T02:10:15.651568+0000 (oldest deadline 2024-09-12T02:10:39.751598+0000) 2024-09-12T02:10:49.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:49 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5[47195]: 2024-09-12T02:10:49.563+0000 7f3007316640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.452689+0000 front 2024-09-12T02:10:24.452671+0000 (oldest deadline 2024-09-12T02:10:45.552821+0000) 2024-09-12T02:10:49.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:49 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:49.420+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:49.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:49 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:49.420+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:49.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:49 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:49.420+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:49.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:49 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:49.479+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:49.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:49 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:49.479+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:49.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:49 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:49.267+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:49.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:49 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:49.267+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:49.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:49 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:49.267+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:50.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:49 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:49.664+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:50.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:49 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:49.664+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:50.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:49 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:49.664+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:50.203 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:49 smithi107 podman[72014]: 2024-09-12 02:10:49.94239273 +0000 UTC m=+5.442305373 container died 0acd70f7713d4e43e5f41082cfa90fa24c9e9628b202ad2c21155c0507586e68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:10:50.204 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:49 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:49.900+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:50.204 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:49 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:49.900+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:50.491 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:50 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:50.234+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:50.491 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:50 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:50.234+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:50.491 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:50 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:50.234+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:50.573 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:50 smithi107 podman[72014]: 2024-09-12 02:10:50.321967916 +0000 UTC m=+5.821880554 container cleanup 0acd70f7713d4e43e5f41082cfa90fa24c9e9628b202ad2c21155c0507586e68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:50.573 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:50 smithi107 bash[72014]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5 2024-09-12T02:10:50.573 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:50 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:50.421+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:50.573 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:50 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:50.421+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:50.574 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:50 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:50.421+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:50.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:50 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:50.252+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:50.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:50 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:50.252+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.060263+0000 front 2024-09-12T02:10:22.060285+0000 (oldest deadline 2024-09-12T02:10:47.360069+0000) 2024-09-12T02:10:50.858 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:50 smithi107 podman[72029]: 2024-09-12 02:10:50.573605323 +0000 UTC m=+0.627580303 container remove 0acd70f7713d4e43e5f41082cfa90fa24c9e9628b202ad2c21155c0507586e68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:10:50.964 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:50 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:50.491+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:50.964 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:50 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:50.491+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:51.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:50 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:50.635+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:51.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:50 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:50.635+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:51.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:50 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:50.635+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:51.114 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:50 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:50.858+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:51.115 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:50 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:50.858+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:51.115 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:50 smithi107 podman[72120]: 2024-09-12 02:10:50.830476985 +0000 UTC m=+0.015656475 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:51.115 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:50 smithi107 podman[72120]: 2024-09-12 02:10:50.966068378 +0000 UTC m=+0.151247854 container create 21a2e1f7466e2e6bf2af149463eb97e80cb06830b038bc3a1d60cd840733a510 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T02:10:51.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:51.216+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:51.592 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:51.216+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.060263+0000 front 2024-09-12T02:10:22.060285+0000 (oldest deadline 2024-09-12T02:10:47.360069+0000) 2024-09-12T02:10:51.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:51 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:51.432+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:51.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:51 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:51.432+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:51.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:51 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:51.432+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:51.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:51 smithi107 podman[72120]: 2024-09-12 02:10:51.235439244 +0000 UTC m=+0.420618730 container init 21a2e1f7466e2e6bf2af149463eb97e80cb06830b038bc3a1d60cd840733a510 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:10:51.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:51 smithi107 podman[72120]: 2024-09-12 02:10:51.238663111 +0000 UTC m=+0.423842587 container start 21a2e1f7466e2e6bf2af149463eb97e80cb06830b038bc3a1d60cd840733a510 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T02:10:51.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:51 smithi107 podman[72120]: 2024-09-12 02:10:51.343499469 +0000 UTC m=+0.528678947 container attach 21a2e1f7466e2e6bf2af149463eb97e80cb06830b038bc3a1d60cd840733a510 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:10:51.704 INFO:journalctl@ceph.osd.5.smithi107.stdout:Sep 12 02:10:51 smithi107 podman[72120]: 2024-09-12 02:10:51.438441323 +0000 UTC m=+0.623620798 container died 21a2e1f7466e2e6bf2af149463eb97e80cb06830b038bc3a1d60cd840733a510 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T02:10:51.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:51 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:51.243+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:51.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:51 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:51.243+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:51.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:51 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:51.243+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:51.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:51 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:51.450+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:51.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:51 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:51.450+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:52.063 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:51 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:51.888+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:52.063 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:51 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:51.888+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:52.078 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T02:10:52.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:51.661+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:52.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:51.661+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:52.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:51 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:51.661+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:52.115 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:10:52.115 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T02:10:52.115 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T02:10:52.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.6 2024-09-12T02:10:52.527 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:52.166+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:52.527 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:52.166+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.060263+0000 front 2024-09-12T02:10:22.060285+0000 (oldest deadline 2024-09-12T02:10:47.360069+0000) 2024-09-12T02:10:52.527 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:52 smithi062 systemd[1]: Stopping Ceph osd.6 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:10:52.528 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:52.526+0000 7fa089200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:10:52.528 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:52.526+0000 7fa089200640 -1 osd.6 107 *** Got signal Terminated *** 2024-09-12T02:10:52.528 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:52.526+0000 7fa089200640 -1 osd.6 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:10:52.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:52 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:52.447+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:52.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:52 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:52.447+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:52.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:52 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:52.447+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:52.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:52 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:52.420+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:52.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:52 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:52.420+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:52.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:52 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:52.274+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:52.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:52 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:52.274+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:52.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:52 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:52.274+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:52.841 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:52.627+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:52.841 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:52.627+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:52.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:52 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:52.627+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:53.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:52 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:52.937+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:53.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:52 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:52.937+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:53.595 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:53 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:53.196+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:53.595 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:53 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:53.196+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.060263+0000 front 2024-09-12T02:10:22.060285+0000 (oldest deadline 2024-09-12T02:10:47.360069+0000) 2024-09-12T02:10:53.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:53 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:53.420+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:53.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:53 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:53.420+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:53.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:53 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:53.420+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:53.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:53 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:53.386+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:53.715 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:53 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:53.386+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:53.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:53 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:53.296+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:53.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:53 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:53.296+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:53.716 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:53 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:53.296+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:54.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:53 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:53.617+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:54.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:53 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:53.617+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:54.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:53 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:53.617+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:54.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:53 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:53.617+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:10:54.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:53 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:53.946+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:54.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:53 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:53.946+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:54.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:53 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:53.946+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:10:54.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:54 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:54.222+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:54.592 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:54 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:54.222+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.060263+0000 front 2024-09-12T02:10:22.060285+0000 (oldest deadline 2024-09-12T02:10:47.360069+0000) 2024-09-12T02:10:54.592 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:54 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:54.222+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.961588+0000 front 2024-09-12T02:10:31.961645+0000 (oldest deadline 2024-09-12T02:10:54.162264+0000) 2024-09-12T02:10:54.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:54 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:54.429+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:54.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:54 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:54.429+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:54.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:54 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:54.429+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:54.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:54 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:54.389+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:54.716 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:54 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:54.389+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:54.716 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:54 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:54.290+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:54.716 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:54 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:54.290+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:54.717 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:54 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:54.290+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:55.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:54 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:54.591+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:55.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:54 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:54.591+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:55.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:54 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:54.591+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:55.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:54 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:54.591+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:10:55.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:54 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:54.934+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:55.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:54 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:54.934+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:55.204 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:54 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:54.934+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:10:55.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:55 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:55.268+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:55.592 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:55 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:55.268+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.060263+0000 front 2024-09-12T02:10:22.060285+0000 (oldest deadline 2024-09-12T02:10:47.360069+0000) 2024-09-12T02:10:55.592 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:55 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:55.268+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.961588+0000 front 2024-09-12T02:10:31.961645+0000 (oldest deadline 2024-09-12T02:10:54.162264+0000) 2024-09-12T02:10:55.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:55 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:55.435+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:55.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:55 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:55.435+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:55.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:55 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:55.435+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:55.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:55 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:55.264+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:55.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:55 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:55.264+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:55.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:55 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:55.264+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:55.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:55 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:55.426+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:55.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:55 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:55.426+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:55.715 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:55 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:55.426+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:10:56.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:55 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:55.635+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:56.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:55 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:55.635+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:56.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:55 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:55.635+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:56.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:55 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:55.635+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:10:56.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:55 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:55.922+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:56.204 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:55 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:55.922+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:56.204 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:55 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:55.922+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:10:56.591 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:56.245+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:56.592 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:56.245+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.060263+0000 front 2024-09-12T02:10:22.060285+0000 (oldest deadline 2024-09-12T02:10:47.360069+0000) 2024-09-12T02:10:56.592 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:56.245+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.961588+0000 front 2024-09-12T02:10:31.961645+0000 (oldest deadline 2024-09-12T02:10:54.162264+0000) 2024-09-12T02:10:56.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:56 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:56.388+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:56.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:56 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:56.388+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:56.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:56 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:56.388+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:56.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:56 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:56.391+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:56.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:56 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:56.391+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:56.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:56 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:56.391+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:10:56.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:56 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:56.273+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:56.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:56 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:56.273+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:56.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:56 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:56.273+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:56.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:56 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:56.273+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:10:57.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:56.621+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:57.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:56.621+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:57.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:56.621+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:57.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:56 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:56.621+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:10:57.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:56 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:56.919+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:57.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:56 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:56.919+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:57.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:56 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:56.919+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:10:57.445 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:57 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:57.229+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:16.958494+0000 front 2024-09-12T02:10:16.958563+0000 (oldest deadline 2024-09-12T02:10:39.258100+0000) 2024-09-12T02:10:57.445 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:57 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:57.229+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.060263+0000 front 2024-09-12T02:10:22.060285+0000 (oldest deadline 2024-09-12T02:10:47.360069+0000) 2024-09-12T02:10:57.445 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:57 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6[58233]: 2024-09-12T02:10:57.229+0000 7fa084c00640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.961588+0000 front 2024-09-12T02:10:31.961645+0000 (oldest deadline 2024-09-12T02:10:54.162264+0000) 2024-09-12T02:10:57.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:57 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:57.340+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:57.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:57 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:57.340+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:57.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:57 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:57.340+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:57.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:57 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:57.345+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:57.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:57 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:57.345+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:57.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:57 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:57.345+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:10:57.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:57 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:57.293+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:57.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:57 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:57.293+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:57.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:57 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:57.293+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:57.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:57 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:57.293+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:10:57.763 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:57 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:57.626+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:57.763 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:57 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:57.626+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:57.763 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:57 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:57.626+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:57.763 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:57 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:57.626+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:10:58.092 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:57 smithi062 podman[90951]: 2024-09-12 02:10:57.880782299 +0000 UTC m=+5.472905675 container stop bc9ecf714e9fa64522a5bfb73ddf716d897bebc59f6da12d9aa2b7566c633e6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T02:10:58.092 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:57 smithi062 podman[90951]: 2024-09-12 02:10:57.910317868 +0000 UTC m=+5.502441253 container died bc9ecf714e9fa64522a5bfb73ddf716d897bebc59f6da12d9aa2b7566c633e6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:10:58.326 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:57 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:57.966+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:58.326 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:57 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:57.966+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:58.326 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:57 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:57.966+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:10:58.541 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:58 smithi062 podman[90951]: 2024-09-12 02:10:58.29035495 +0000 UTC m=+5.882478319 container cleanup bc9ecf714e9fa64522a5bfb73ddf716d897bebc59f6da12d9aa2b7566c633e6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:10:58.542 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:58 smithi062 bash[90951]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6 2024-09-12T02:10:58.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:58 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:58.326+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:58.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:58 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:58.326+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:58.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:58 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:58.326+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:58.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:58 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:58.332+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:58.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:58 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:58.332+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:58.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:58 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:58.332+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:58.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:58 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:58.332+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:10:58.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:58 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:58.344+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:58.715 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:58 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:58.344+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:58.715 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:58 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:58.344+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:10:58.842 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:58 smithi062 podman[90977]: 2024-09-12 02:10:58.542032633 +0000 UTC m=+0.646627099 container remove bc9ecf714e9fa64522a5bfb73ddf716d897bebc59f6da12d9aa2b7566c633e6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T02:10:58.843 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:58.621+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:58.843 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:58.622+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:58.843 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:58.622+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:58.843 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:58 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:58.622+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:10:59.353 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:59 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:59.004+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:10:59.353 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:59 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:59.004+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:10:59.353 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:10:59 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:10:59.004+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:10:59.386 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:59 smithi062 podman[91067]: 2024-09-12 02:10:59.036582695 +0000 UTC m=+0.027566569 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:10:59.386 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:59 smithi062 podman[91067]: 2024-09-12 02:10:59.176569582 +0000 UTC m=+0.167553454 container create 5809f0faf11c798b15f1e827bba037b86637ff7c66ec8356f40289abdf914821 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:59.387 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:59 smithi062 podman[91067]: 2024-09-12 02:10:59.387229817 +0000 UTC m=+0.378213690 container init 5809f0faf11c798b15f1e827bba037b86637ff7c66ec8356f40289abdf914821 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T02:10:59.657 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:59 smithi062 podman[91067]: 2024-09-12 02:10:59.39417353 +0000 UTC m=+0.385157406 container start 5809f0faf11c798b15f1e827bba037b86637ff7c66ec8356f40289abdf914821 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T02:10:59.658 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:59 smithi062 podman[91067]: 2024-09-12 02:10:59.487141284 +0000 UTC m=+0.478125168 container attach 5809f0faf11c798b15f1e827bba037b86637ff7c66ec8356f40289abdf914821 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:10:59.658 INFO:journalctl@ceph.osd.6.smithi062.stdout:Sep 12 02:10:59 smithi062 podman[91067]: 2024-09-12 02:10:59.657879498 +0000 UTC m=+0.648863385 container died 5809f0faf11c798b15f1e827bba037b86637ff7c66ec8356f40289abdf914821 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:10:59.658 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:59 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:59.600+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:10:59.658 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:59 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:59.600+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:10:59.658 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:59 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:59.600+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:10:59.658 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:10:59 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:10:59.600+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:10:59.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:59 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:59.353+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:10:59.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:59 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:59.353+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:10:59.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:10:59 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:10:59.353+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:10:59.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:59 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:59.392+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:10:59.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:59 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:59.392+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:10:59.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:10:59 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:10:59.392+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:10:59.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:59 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:59.364+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:10:59.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:59 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:59.364+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:10:59.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:59 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:59.364+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:10:59.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:10:59 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:10:59.364+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:00.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T02:11:00.386 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:00 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:00.048+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:00.386 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:00 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:00.048+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:00.386 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:00 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:00.048+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:00.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:00.417 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T02:11:00.417 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T02:11:00.417 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.7 2024-09-12T02:11:00.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:00 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:00.386+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:00.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:00 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:00.386+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:00.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:00 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:00.386+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:00.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:00 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:00.398+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:11:00.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:00 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:00.398+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:11:00.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:00 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:00.398+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:11:00.715 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:00 smithi077 systemd[1]: Stopping Ceph osd.7 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:00.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:00 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:00.377+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:00.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:00 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:00.377+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:00.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:00 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:00.377+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:00.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:00 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:00.377+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:01.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:00 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:00.626+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:01.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:00 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:00.626+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:01.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:00 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:00.626+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:01.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:00 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:00.626+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:01.214 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:00 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:00.725+0000 7fd7abc4a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:01.214 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:00 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:00.725+0000 7fd7abc4a640 -1 osd.7 107 *** Got signal Terminated *** 2024-09-12T02:11:01.214 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:00 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:00.725+0000 7fd7abc4a640 -1 osd.7 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:11:01.387 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:01 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:01.033+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:01.387 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:01 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:01.033+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:01.388 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:01 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:01.033+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:01.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:01 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:01.387+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:01.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:01 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:01.387+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:01.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:01 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:01.387+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:01.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:01 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:01.407+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:11:01.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:01 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:01.407+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:11:01.715 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:01 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:01.407+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:11:01.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:01 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:01.421+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:01.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:01 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:01.421+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:01.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:01 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:01.421+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:01.716 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:01 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:01.421+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:02.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:01 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:01.617+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:02.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:01 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:01.618+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:02.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:01 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:01.618+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:02.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:01 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:01.618+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:02.414 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:02.036+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:02.414 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:02.036+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:02.414 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:02.036+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:02.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:02.414+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:02.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:02.414+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:02.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:02.414+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:02.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:02.414+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:02.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:02.383+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:11:02.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:02.383+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:11:02.715 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:02.383+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:11:02.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:02.464+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:02.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:02.464+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:02.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:02.464+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:02.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:02.464+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:02.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:02.464+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:03.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:02.627+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:03.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:02.627+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:03.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:02.627+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:03.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:02 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:02.627+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:03.453 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:02.995+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:03.453 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:02.995+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:03.453 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:02 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:02.995+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:03.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:03.381+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:11:03.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:03.381+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:11:03.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:03.381+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:11:03.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:03.427+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:03.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:03.427+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:03.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:03.427+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:03.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:03.427+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:03.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:03 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:03.427+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:03.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:03 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:03.460+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:03.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:03 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:03.460+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:03.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:03 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:03.460+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:03.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:03 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:03.460+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:04.026 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:04.024+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:04.026 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:04.024+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:04.026 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:04.024+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:04.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:03.667+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:04.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:03.667+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:04.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:03.667+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:04.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:03 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:03.667+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:04.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:04 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:04.371+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:11:04.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:04 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:04.371+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:11:04.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:04 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:04.371+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:11:04.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:04 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:04.393+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:04.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:04 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:04.393+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:04.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:04 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:04.393+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:04.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:04 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:04.393+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:04.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:04 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:04.393+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:04.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:04.472+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:04.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:04.472+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:04.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:04.472+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:04.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:04 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:04.472+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:05.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:04 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:04.713+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:05.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:04 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:04.713+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:05.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:04 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:04.713+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:05.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:04 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:04.713+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:05.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:04 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:04.713+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:05.445 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:05.049+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:05.445 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:05.049+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:05.445 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:05.049+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:05.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:05.445+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:05.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:05.445+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:05.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:05.445+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:05.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:05 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:05.445+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:05.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:05.345+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:13.337535+0000 front 2024-09-12T02:10:13.337592+0000 (oldest deadline 2024-09-12T02:10:38.037723+0000) 2024-09-12T02:11:05.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:05.345+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:23.839391+0000 front 2024-09-12T02:10:23.839459+0000 (oldest deadline 2024-09-12T02:10:45.539436+0000) 2024-09-12T02:11:05.714 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7[53089]: 2024-09-12T02:11:05.345+0000 7fd7a4258640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:32.540987+0000 front 2024-09-12T02:10:32.541030+0000 (oldest deadline 2024-09-12T02:10:54.840889+0000) 2024-09-12T02:11:05.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:05.350+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:05.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:05.350+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:05.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:05.350+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:05.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:05.350+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:05.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:05 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:05.350+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:06.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:05 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:05.704+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:06.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:05 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:05.704+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:06.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:05 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:05.704+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:06.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:05 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:05.704+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:06.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:05 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:05.704+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:06.430 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:06.014+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:06.430 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:06.014+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:06.430 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:06.014+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:06.509 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:06 smithi077 podman[71475]: 2024-09-12 02:11:06.220317828 +0000 UTC m=+5.612375805 container died abbbba64419ca319ec02ddb69a8fb084b2d88ac44c818283d25714ffe6e4cccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T02:11:06.510 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:06.357+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:06.510 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:06.357+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:06.510 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:06.357+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:06.510 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:06.357+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:06.510 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:06.357+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:06.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:06.429+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:06.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:06.429+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:06.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:06.429+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:06.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:06 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:06.429+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:06.851 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:06 smithi077 podman[71475]: 2024-09-12 02:11:06.625474326 +0000 UTC m=+6.017532304 container cleanup abbbba64419ca319ec02ddb69a8fb084b2d88ac44c818283d25714ffe6e4cccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:11:06.851 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:06 smithi077 bash[71475]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7 2024-09-12T02:11:07.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:06.657+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:07.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:06.657+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:07.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:06.657+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:07.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:06.657+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:07.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:06 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:06.657+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:07.166 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:06 smithi077 podman[71491]: 2024-09-12 02:11:06.851653832 +0000 UTC m=+0.620277554 container remove abbbba64419ca319ec02ddb69a8fb084b2d88ac44c818283d25714ffe6e4cccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T02:11:07.411 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:07.006+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:07.411 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:07.006+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:07.411 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:07.006+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:07.464 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:07 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:07.322+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:07.464 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:07 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:07.322+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:07.465 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:07 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:07.322+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:07.465 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:07 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:07.322+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:07.465 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:07 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:07.322+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:07.465 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:07 smithi077 podman[71575]: 2024-09-12 02:11:07.069966974 +0000 UTC m=+0.015413290 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:07.465 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:07 smithi077 podman[71575]: 2024-09-12 02:11:07.168956696 +0000 UTC m=+0.114403042 container create 21b00c10d5411757e6c516c8a08eccd76766737fd262ef734a4ccf3a23144b11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T02:11:07.465 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:07 smithi077 podman[71575]: 2024-09-12 02:11:07.387917048 +0000 UTC m=+0.333363358 container init 21b00c10d5411757e6c516c8a08eccd76766737fd262ef734a4ccf3a23144b11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T02:11:07.465 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:07 smithi077 podman[71575]: 2024-09-12 02:11:07.391209267 +0000 UTC m=+0.336655578 container start 21b00c10d5411757e6c516c8a08eccd76766737fd262ef734a4ccf3a23144b11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T02:11:07.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:07.411+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:07.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:07.411+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:07.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:07.411+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:07.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:07.411+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:07.964 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:07 smithi077 podman[71575]: 2024-09-12 02:11:07.48349205 +0000 UTC m=+0.428938371 container attach 21b00c10d5411757e6c516c8a08eccd76766737fd262ef734a4ccf3a23144b11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:11:07.964 INFO:journalctl@ceph.osd.7.smithi077.stdout:Sep 12 02:11:07 smithi077 podman[71575]: 2024-09-12 02:11:07.583296894 +0000 UTC m=+0.528743218 container died 21b00c10d5411757e6c516c8a08eccd76766737fd262ef734a4ccf3a23144b11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:11:08.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:07.622+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:08.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:07.622+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:08.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:07.622+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:08.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:07.622+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:08.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:07 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:07.622+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:08.334 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T02:11:08.364 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:07.996+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:08.364 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:07.996+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:08.364 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:07.996+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:08.364 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:07 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:07.996+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:36.622710+0000 front 2024-09-12T02:10:36.622730+0000 (oldest deadline 2024-09-12T02:11:07.823515+0000) 2024-09-12T02:11:08.374 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:08.374 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T02:11:08.374 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T02:11:08.374 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.8 2024-09-12T02:11:08.584 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:08 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:08.300+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:08.584 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:08 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:08.300+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:08.584 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:08 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:08.300+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:08.584 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:08 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:08.300+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:08.584 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:08 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:08.300+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:08.673 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:08 smithi107 systemd[1]: Stopping Ceph osd.8 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:08.673 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:08 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:08.364+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:08.673 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:08 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:08.364+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:08.674 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:08 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:08.364+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:08.674 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:08 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:08.364+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:08.841 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:08 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:08.583+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:08.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:08 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:08.583+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:08.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:08 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:08.583+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:08.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:08 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:08.583+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:08.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:08 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:08.583+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:08.953 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:08 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:08.672+0000 7f61867e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:08.953 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:08 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:08.672+0000 7f61867e0640 -1 osd.8 107 *** Got signal Terminated *** 2024-09-12T02:11:08.954 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:08 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:08.672+0000 7f61867e0640 -1 osd.8 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:11:09.324 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:09.007+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:09.325 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:09.007+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:09.325 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:09.007+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:09.325 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:09.007+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:36.622710+0000 front 2024-09-12T02:10:36.622730+0000 (oldest deadline 2024-09-12T02:11:07.823515+0000) 2024-09-12T02:11:09.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:09.325+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:09.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:09.325+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:09.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:09.325+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:09.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:09.325+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:09.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:09 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:09.347+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:09.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:09 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:09.347+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:09.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:09 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:09.347+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:09.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:09 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:09.347+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:09.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:09 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:09.347+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:09.841 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:09.574+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:09.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:09.574+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:09.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:09.574+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:09.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:09.574+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:09.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:09 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:09.574+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:10.331 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:09.964+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:10.332 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:09.964+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:10.332 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:09.964+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:10.332 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:09 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:09.964+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:36.622710+0000 front 2024-09-12T02:10:36.622730+0000 (oldest deadline 2024-09-12T02:11:07.823515+0000) 2024-09-12T02:11:10.613 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:10 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:10.331+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:10.613 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:10 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:10.331+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:10.613 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:10 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:10.331+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:10.613 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:10 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:10.331+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:10.616 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:10 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:10.336+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:10.616 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:10 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:10.336+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:10.616 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:10 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:10.336+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:10.616 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:10 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:10.336+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:10.616 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:10 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:10.336+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:11.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:10 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:10.624+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:11.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:10 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:10.624+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:11.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:10 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:10.624+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:11.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:10 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:10.624+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:11.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:10 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:10.624+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:11.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:10 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:10.914+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:11.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:10 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:10.914+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:11.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:10 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:10.914+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:11.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:10 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:10.914+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:36.622710+0000 front 2024-09-12T02:10:36.622730+0000 (oldest deadline 2024-09-12T02:11:07.823515+0000) 2024-09-12T02:11:11.559 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:11.300+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:11.559 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:11.300+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:11.559 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:11.300+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:11.559 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:11.300+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:11.559 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:11.300+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:11.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:11 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:11.337+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:11.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:11 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:11.337+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:11.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:11 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:11.337+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:11.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:11 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:11.337+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:11.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:11 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:11.337+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:12.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:11.634+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:12.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:11.634+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:12.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:11.634+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:12.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:11.634+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:12.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:11.634+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:12.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:11 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:11.634+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:12.203 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:11.935+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:12.204 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:11.935+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:12.204 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:11.935+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:12.204 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:11.935+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:36.622710+0000 front 2024-09-12T02:10:36.622730+0000 (oldest deadline 2024-09-12T02:11:07.823515+0000) 2024-09-12T02:11:12.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:12 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:12.324+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:12.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:12 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:12.324+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:12.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:12 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:12.324+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:12.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:12 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:12.324+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:12.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:12 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:12.324+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:12.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:12 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:12.320+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:12.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:12 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:12.320+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:12.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:12 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:12.320+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:12.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:12 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:12.320+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:12.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:12 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:12.320+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:13.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:12 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:12.594+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:13.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:12 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:12.594+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:13.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:12 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:12.594+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:13.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:12 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:12.594+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:13.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:12 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:12.594+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:13.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:12 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:12.594+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:13.375 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:12 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:12.954+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:12.317480+0000 front 2024-09-12T02:10:12.317562+0000 (oldest deadline 2024-09-12T02:10:41.118175+0000) 2024-09-12T02:11:13.375 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:12 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:12.954+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.519768+0000 front 2024-09-12T02:10:24.519871+0000 (oldest deadline 2024-09-12T02:10:47.419980+0000) 2024-09-12T02:11:13.375 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:12 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:12.954+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:30.221399+0000 front 2024-09-12T02:10:30.221358+0000 (oldest deadline 2024-09-12T02:10:53.721474+0000) 2024-09-12T02:11:13.375 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:12 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8[53694]: 2024-09-12T02:11:12.954+0000 7f6182df6640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:36.622710+0000 front 2024-09-12T02:10:36.622730+0000 (oldest deadline 2024-09-12T02:11:07.823515+0000) 2024-09-12T02:11:13.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:13 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:13.375+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:13.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:13 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:13.375+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:13.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:13 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:13.375+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:13.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:13 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:13.375+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:13.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:13 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:13.375+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:13.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:13 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:13.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:13.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:13 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:13.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:13.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:13 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:13.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:13.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:13 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:13.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:13.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:13 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:13.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:13.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:13 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:13.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:13.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:13 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:13.565+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:13.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:13 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:13.565+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:13.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:13 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:13.565+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:13.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:13 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:13.565+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:13.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:13 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:13.565+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:13.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:13 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:13.565+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:14.363 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:14 smithi107 podman[72223]: 2024-09-12 02:11:14.07313673 +0000 UTC m=+5.509537597 container died b3995a1e2862eaaec7c9ab166e99506599ec1e0e7ba50bfea4428c0c8f2c0223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2) 2024-09-12T02:11:14.703 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:14 smithi107 podman[72223]: 2024-09-12 02:11:14.481239291 +0000 UTC m=+5.917640157 container cleanup b3995a1e2862eaaec7c9ab166e99506599ec1e0e7ba50bfea4428c0c8f2c0223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T02:11:14.704 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:14 smithi107 bash[72223]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8 2024-09-12T02:11:14.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:14 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:14.363+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:14.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:14 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:14.363+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:14.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:14 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:14.363+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:14.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:14 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:14.363+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:14.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:14 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:14.363+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:14.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:14 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:14.273+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:14.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:14 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:14.273+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:14.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:14 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:14.273+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:14.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:14 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:14.273+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:14.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:14 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:14.273+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:14.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:14 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:14.273+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:14.841 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:14 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:14.582+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:14.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:14 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:14.582+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:14.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:14 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:14.582+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:14.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:14 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:14.582+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:14.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:14 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:14.582+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:14.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:14 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:14.582+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:15.145 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:14 smithi107 podman[72251]: 2024-09-12 02:11:14.724060616 +0000 UTC m=+0.652889057 container remove b3995a1e2862eaaec7c9ab166e99506599ec1e0e7ba50bfea4428c0c8f2c0223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T02:11:15.402 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:15 smithi107 podman[72338]: 2024-09-12 02:11:15.048279906 +0000 UTC m=+0.015834845 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:15.402 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:15 smithi107 podman[72338]: 2024-09-12 02:11:15.157923418 +0000 UTC m=+0.125478345 container create abab9d97b3443ad1cce479d6e513afe94ef785d42ccf0780f131f26e252ea90a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T02:11:15.402 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:15 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:15.376+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:15.402 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:15 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:15.376+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:15.402 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:15 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:15.376+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:15.402 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:15 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:15.376+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:15.403 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:15 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:15.376+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:15.704 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:15 smithi107 podman[72338]: 2024-09-12 02:11:15.402379504 +0000 UTC m=+0.369934429 container init abab9d97b3443ad1cce479d6e513afe94ef785d42ccf0780f131f26e252ea90a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T02:11:15.704 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:15 smithi107 podman[72338]: 2024-09-12 02:11:15.405851888 +0000 UTC m=+0.373406831 container start abab9d97b3443ad1cce479d6e513afe94ef785d42ccf0780f131f26e252ea90a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T02:11:15.704 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:15 smithi107 podman[72338]: 2024-09-12 02:11:15.460491623 +0000 UTC m=+0.428046554 container attach abab9d97b3443ad1cce479d6e513afe94ef785d42ccf0780f131f26e252ea90a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T02:11:15.704 INFO:journalctl@ceph.osd.8.smithi107.stdout:Sep 12 02:11:15 smithi107 podman[72338]: 2024-09-12 02:11:15.603151119 +0000 UTC m=+0.570706055 container died abab9d97b3443ad1cce479d6e513afe94ef785d42ccf0780f131f26e252ea90a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:11:15.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:15 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:15.242+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:15.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:15 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:15.242+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:15.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:15 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:15.242+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:15.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:15 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:15.242+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:15.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:15 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:15.242+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:15.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:15 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:15.242+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:15.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:15.575+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:15.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:15.575+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:15.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:15.575+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:15.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:15.575+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:15.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:15.575+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:15.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:15 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:15.575+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:16.230 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T02:11:16.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:16.270 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T02:11:16.270 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T02:11:16.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.9 2024-09-12T02:11:16.591 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:16 smithi062 systemd[1]: Stopping Ceph osd.9 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:16.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:16 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:16.423+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:16.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:16 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:16.423+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:16.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:16 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:16.423+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:16.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:16 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:16.423+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:16.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:16 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:16.423+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:16.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:16 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:16.254+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:16.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:16 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:16.254+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:16.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:16 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:16.254+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:16.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:16 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:16.254+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:16.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:16 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:16.254+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:16.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:16 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:16.254+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:17.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:16.615+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:17.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:16.615+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:17.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:16.615+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:17.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:16.615+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:17.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:16.615+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:17.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:16.615+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:17.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:16.688+0000 7f7cef400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:17.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:16.688+0000 7f7cef400640 -1 osd.9 107 *** Got signal Terminated *** 2024-09-12T02:11:17.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:16 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:16.688+0000 7f7cef400640 -1 osd.9 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:11:17.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:17 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:17.383+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:17.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:17 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:17.383+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:17.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:17 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:17.383+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:17.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:17 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:17.383+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:17.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:17 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:17.383+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:17.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:17 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:17.265+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:17.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:17 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:17.265+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:17.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:17 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:17.265+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:17.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:17 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:17.265+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:17.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:17 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:17.265+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:17.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:17 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:17.265+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:18.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:17 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:17.606+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:18.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:17 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:17.606+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:18.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:17 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:17.606+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:18.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:17 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:17.606+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:18.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:17 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:17.606+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:18.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:17 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:17.606+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:18.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:18 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:18.345+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:18.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:18 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:18.345+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:18.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:18 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:18.345+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:18.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:18 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:18.345+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:18.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:18 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:18.345+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:18.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:18 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:18.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:18.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:18 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:18.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:18.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:18 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:18.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:18.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:18 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:18.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:18.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:18 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:18.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:18.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:18 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:18.309+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:19.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:18 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:18.613+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:19.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:18 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:18.613+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:19.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:18 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:18.613+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:19.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:18 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:18.613+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:19.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:18 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:18.613+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:19.092 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:18 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:18.613+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:19.604 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:19 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:19.329+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:19.605 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:19 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:19.329+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:19.605 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:19 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:19.329+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:19.605 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:19 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:19.329+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:19.605 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:19 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:19.329+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:19.605 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:19 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:19.329+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:19.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:19 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:19.337+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:19.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:19 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:19.337+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:19.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:19 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:19.337+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:19.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:19 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:19.337+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:19.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:19 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:19.337+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:19.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:19.569+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:19.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:19.569+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:19.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:19.569+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:19.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:19.569+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:19.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:19.569+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:19.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:19 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:19.569+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:20.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:20.377+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:20.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:20.377+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:20.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:20.377+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:20.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:20.377+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:20.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:20.377+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:20.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:20.377+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:20.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:20 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:20.348+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:20.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:20 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:20.348+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:20.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:20 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:20.348+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:20.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:20 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:20.348+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:20.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:20 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:20.348+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:20.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:20 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:20.348+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:20.841 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:20.543+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:20.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:20.543+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:20.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:20.543+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:20.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:20.543+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:20.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:20.543+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:20.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:20 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:20.543+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:21.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:21 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:21.427+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:21.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:21 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:21.427+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:21.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:21 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:21.427+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:21.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:21 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:21.427+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:21.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:21 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:21.427+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:21.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:21 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:21.427+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:21.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:21 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:21.380+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:21.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:21 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:21.380+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:21.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:21 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:21.380+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:21.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:21 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:21.381+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:21.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:21 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:21.381+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:21.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:21 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:21.381+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:21.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:21 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:21.381+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:52.851573+0000 front 2024-09-12T02:10:52.851504+0000 (oldest deadline 2024-09-12T02:11:20.451628+0000) 2024-09-12T02:11:21.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:21 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:21.502+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.944496+0000 front 2024-09-12T02:10:05.944597+0000 (oldest deadline 2024-09-12T02:10:31.244682+0000) 2024-09-12T02:11:21.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:21 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:21.502+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.346256+0000 front 2024-09-12T02:10:15.346343+0000 (oldest deadline 2024-09-12T02:10:40.046007+0000) 2024-09-12T02:11:21.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:21 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:21.502+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:24.648082+0000 front 2024-09-12T02:10:24.648121+0000 (oldest deadline 2024-09-12T02:10:47.548085+0000) 2024-09-12T02:11:21.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:21 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:21.502+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:27.548538+0000 front 2024-09-12T02:10:27.548565+0000 (oldest deadline 2024-09-12T02:10:53.448508+0000) 2024-09-12T02:11:21.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:21 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:21.502+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.850024+0000 front 2024-09-12T02:10:39.850081+0000 (oldest deadline 2024-09-12T02:11:03.949918+0000) 2024-09-12T02:11:21.842 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:21 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9[65234]: 2024-09-12T02:11:21.502+0000 7f7ceae00640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:44.451345+0000 front 2024-09-12T02:10:44.451307+0000 (oldest deadline 2024-09-12T02:11:10.851796+0000) 2024-09-12T02:11:22.411 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:22 smithi062 podman[91168]: 2024-09-12 02:11:22.124198065 +0000 UTC m=+5.566551995 container died b787c50ff9053e757292ab4236627059a7ee5f8d49cbf3681ee9469b03b7d798 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T02:11:22.686 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:22 smithi062 podman[91168]: 2024-09-12 02:11:22.518703715 +0000 UTC m=+5.961057644 container cleanup b787c50ff9053e757292ab4236627059a7ee5f8d49cbf3681ee9469b03b7d798 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T02:11:22.686 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:22 smithi062 bash[91168]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9 2024-09-12T02:11:22.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:22 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:22.334+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:22.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:22 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:22.334+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:22.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:22 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:22.334+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:22.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:22 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:22.334+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:22.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:22 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:22.334+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:22.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:22 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:22.334+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:22.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:22 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:22.334+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:52.851573+0000 front 2024-09-12T02:10:52.851504+0000 (oldest deadline 2024-09-12T02:11:20.451628+0000) 2024-09-12T02:11:22.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:22 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:22.468+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:22.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:22 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:22.468+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:22.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:22 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:22.468+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:22.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:22 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:22.468+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:22.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:22 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:22.468+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:22.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:22 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:22.468+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:23.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:22 smithi062 podman[91184]: 2024-09-12 02:11:22.686423997 +0000 UTC m=+0.555755145 container remove b787c50ff9053e757292ab4236627059a7ee5f8d49cbf3681ee9469b03b7d798 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T02:11:23.498 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:23 smithi062 podman[91270]: 2024-09-12 02:11:23.130022343 +0000 UTC m=+0.027447503 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:23.498 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:23 smithi062 podman[91270]: 2024-09-12 02:11:23.237255455 +0000 UTC m=+0.134680611 container create 42498b073510ce9e99323f2ff1e0ef1860cc84c21a1fb1ee7c6178336b5ed2f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:11:23.498 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:23 smithi062 podman[91270]: 2024-09-12 02:11:23.498549079 +0000 UTC m=+0.395974238 container init 42498b073510ce9e99323f2ff1e0ef1860cc84c21a1fb1ee7c6178336b5ed2f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:11:23.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:23 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:23.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:23.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:23 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:23.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:23.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:23 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:23.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:23.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:23 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:23.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:23.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:23 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:23.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:23.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:23 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:23.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:23.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:23 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:23.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:52.851573+0000 front 2024-09-12T02:10:52.851504+0000 (oldest deadline 2024-09-12T02:11:20.451628+0000) 2024-09-12T02:11:23.767 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:23 smithi062 podman[91270]: 2024-09-12 02:11:23.50530223 +0000 UTC m=+0.402727390 container start 42498b073510ce9e99323f2ff1e0ef1860cc84c21a1fb1ee7c6178336b5ed2f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T02:11:23.767 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:23 smithi062 podman[91270]: 2024-09-12 02:11:23.598094084 +0000 UTC m=+0.495519255 container attach 42498b073510ce9e99323f2ff1e0ef1860cc84c21a1fb1ee7c6178336b5ed2f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:11:23.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:23.471+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:23.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:23.471+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:23.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:23.471+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:23.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:23.471+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:23.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:23.471+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:23.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:23 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:23.471+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:24.091 INFO:journalctl@ceph.osd.9.smithi062.stdout:Sep 12 02:11:23 smithi062 podman[91270]: 2024-09-12 02:11:23.768148898 +0000 UTC m=+0.665574070 container died 42498b073510ce9e99323f2ff1e0ef1860cc84c21a1fb1ee7c6178336b5ed2f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T02:11:24.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T02:11:24.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:24.550 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T02:11:24.550 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T02:11:24.551 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.10 2024-09-12T02:11:24.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:24 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:24.428+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:24.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:24 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:24.428+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:24.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:24 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:24.428+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:24.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:24 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:24.428+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:24.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:24 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:24.428+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:24.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:24 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:24.428+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:24.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:24.349+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:24.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:24.349+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:24.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:24.349+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:24.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:24.349+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:24.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:24.349+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:24.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:24.349+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:24.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:24.349+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:52.851573+0000 front 2024-09-12T02:10:52.851504+0000 (oldest deadline 2024-09-12T02:11:20.451628+0000) 2024-09-12T02:11:24.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 systemd[1]: Stopping Ceph osd.10 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:25.214 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:24.868+0000 7f9199328640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:25.214 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:24.868+0000 7f9199328640 -1 osd.10 107 *** Got signal Terminated *** 2024-09-12T02:11:25.214 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:24 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:24.868+0000 7f9199328640 -1 osd.10 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:11:25.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:25 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:25.409+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:25.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:25 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:25.409+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:25.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:25 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:25.409+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:25.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:25 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:25.409+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:25.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:25 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:25.409+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:25.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:25 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:25.409+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:25.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:25 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:25.367+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:25.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:25 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:25.367+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:25.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:25 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:25.367+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:25.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:25 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:25.367+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:25.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:25 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:25.367+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:25.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:25 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:25.367+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:25.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:25 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:25.367+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:52.851573+0000 front 2024-09-12T02:10:52.851504+0000 (oldest deadline 2024-09-12T02:11:20.451628+0000) 2024-09-12T02:11:26.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:26.410+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:26.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:26.410+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:26.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:26.410+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:26.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:26.410+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:26.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:26.410+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:26.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:26 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:26.410+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:26.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:26.382+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:26.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:26.382+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:26.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:26.382+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:26.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:26.382+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:26.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:26.382+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:26.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:26.382+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:26.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:26 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:26.382+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:52.851573+0000 front 2024-09-12T02:10:52.851504+0000 (oldest deadline 2024-09-12T02:11:20.451628+0000) 2024-09-12T02:11:27.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:27.435+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:27.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:27.435+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:27.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:27.435+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:27.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:27.435+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:27.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:27.435+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:27.704 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:27 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:27.435+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:27.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:27 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:27.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:27.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:27 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:27.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:27.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:27 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:27.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:27.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:27 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:27.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:27.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:27 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:27.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:27.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:27 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:27.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:27.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:27 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:27.340+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:52.851573+0000 front 2024-09-12T02:10:52.851504+0000 (oldest deadline 2024-09-12T02:11:20.451628+0000) 2024-09-12T02:11:28.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:28.338+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:28.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:28.338+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:28.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:28.338+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:28.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:28.338+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:28.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:28.338+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:28.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:28.338+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:28.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:28 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:28.338+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:52.851573+0000 front 2024-09-12T02:10:52.851504+0000 (oldest deadline 2024-09-12T02:11:20.451628+0000) 2024-09-12T02:11:28.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:28 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:28.459+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:28.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:28 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:28.459+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:28.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:28 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:28.459+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:28.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:28 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:28.459+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:28.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:28 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:28.459+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:28.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:28 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:28.459+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:29.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:29.368+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:07.345922+0000 front 2024-09-12T02:10:07.345743+0000 (oldest deadline 2024-09-12T02:10:29.645691+0000) 2024-09-12T02:11:29.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:29.368+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:14.946543+0000 front 2024-09-12T02:10:14.946503+0000 (oldest deadline 2024-09-12T02:10:40.246661+0000) 2024-09-12T02:11:29.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:29.368+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:20.247128+0000 front 2024-09-12T02:10:20.247319+0000 (oldest deadline 2024-09-12T02:10:46.147094+0000) 2024-09-12T02:11:29.714 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:29.368+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6814 osd.3 since back 2024-09-12T02:10:31.448165+0000 front 2024-09-12T02:10:31.448323+0000 (oldest deadline 2024-09-12T02:10:56.147975+0000) 2024-09-12T02:11:29.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:29.368+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.549079+0000 front 2024-09-12T02:10:39.549113+0000 (oldest deadline 2024-09-12T02:11:02.449121+0000) 2024-09-12T02:11:29.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:29.368+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:48.150959+0000 front 2024-09-12T02:10:48.151015+0000 (oldest deadline 2024-09-12T02:11:12.850760+0000) 2024-09-12T02:11:29.715 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:29 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10[59941]: 2024-09-12T02:11:29.368+0000 7f9191936640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:52.851573+0000 front 2024-09-12T02:10:52.851504+0000 (oldest deadline 2024-09-12T02:11:20.451628+0000) 2024-09-12T02:11:29.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:29 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:29.502+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:29.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:29 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:29.502+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:29.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:29 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:29.502+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:29.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:29 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:29.502+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:29.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:29 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:29.502+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:29.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:29 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:29.502+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:30.477 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:30 smithi077 podman[71692]: 2024-09-12 02:11:30.222326273 +0000 UTC m=+5.478012418 container died b1e1265fdd0b833205c240406a19159f591838ee224e6559248412d8b0454383 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:11:30.860 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:30 smithi077 podman[71692]: 2024-09-12 02:11:30.568106472 +0000 UTC m=+5.823792614 container cleanup b1e1265fdd0b833205c240406a19159f591838ee224e6559248412d8b0454383 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T02:11:30.861 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:30 smithi077 bash[71692]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10 2024-09-12T02:11:30.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:30 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:30.529+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:30.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:30 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:30.529+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:30.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:30 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:30.529+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:30.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:30 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:30.529+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:30.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:30 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:30.529+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:30.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:30 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:30.529+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:30.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:30 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:30.529+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-09-12T02:11:03.783049+0000 front 2024-09-12T02:11:03.783000+0000 (oldest deadline 2024-09-12T02:11:29.682958+0000) 2024-09-12T02:11:31.176 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:30 smithi077 podman[71707]: 2024-09-12 02:11:30.861146919 +0000 UTC m=+0.636162250 container remove b1e1265fdd0b833205c240406a19159f591838ee224e6559248412d8b0454383 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:11:31.464 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:31 smithi077 podman[71797]: 2024-09-12 02:11:31.079469957 +0000 UTC m=+0.015749083 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:31.464 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:31 smithi077 podman[71797]: 2024-09-12 02:11:31.178398276 +0000 UTC m=+0.114677384 container create e347a0a660c822c839bef78db9a34a1df89f06905565f3495e8a81940a3be3c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T02:11:31.465 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:31 smithi077 podman[71797]: 2024-09-12 02:11:31.397339118 +0000 UTC m=+0.333618226 container init e347a0a660c822c839bef78db9a34a1df89f06905565f3495e8a81940a3be3c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T02:11:31.465 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:31 smithi077 podman[71797]: 2024-09-12 02:11:31.400491562 +0000 UTC m=+0.336770681 container start e347a0a660c822c839bef78db9a34a1df89f06905565f3495e8a81940a3be3c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T02:11:31.891 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:31 smithi077 podman[71797]: 2024-09-12 02:11:31.490211195 +0000 UTC m=+0.426490304 container attach e347a0a660c822c839bef78db9a34a1df89f06905565f3495e8a81940a3be3c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:11:31.891 INFO:journalctl@ceph.osd.10.smithi077.stdout:Sep 12 02:11:31 smithi077 podman[71797]: 2024-09-12 02:11:31.592409466 +0000 UTC m=+0.528688585 container died e347a0a660c822c839bef78db9a34a1df89f06905565f3495e8a81940a3be3c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T02:11:31.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:31 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:31.555+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:31.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:31 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:31.555+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:31.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:31 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:31.555+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:31.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:31 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:31.555+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:31.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:31 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:31.555+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:31.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:31 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:31.555+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:31.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:31 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:31.555+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-09-12T02:11:03.783049+0000 front 2024-09-12T02:11:03.783000+0000 (oldest deadline 2024-09-12T02:11:29.682958+0000) 2024-09-12T02:11:32.221 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T02:11:32.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:32.261 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T02:11:32.261 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T02:11:32.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.11 2024-09-12T02:11:32.556 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 systemd[1]: Stopping Ceph osd.11 for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:32.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:32.555+0000 7fe4cd748640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:32.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:32.555+0000 7fe4cd748640 -1 osd.11 107 *** Got signal Terminated *** 2024-09-12T02:11:32.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:32.555+0000 7fe4cd748640 -1 osd.11 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:11:32.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:32.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:32.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:32.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:32.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:32.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:32.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:32.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:32.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:32.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:32.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:32.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:32.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:32 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:32.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-09-12T02:11:03.783049+0000 front 2024-09-12T02:11:03.783000+0000 (oldest deadline 2024-09-12T02:11:29.682958+0000) 2024-09-12T02:11:33.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:33 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:33.593+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:33.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:33 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:33.593+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:33.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:33 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:33.593+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:33.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:33 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:33.593+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:33.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:33 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:33.593+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:33.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:33 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:33.593+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:33.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:33 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:33.593+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-09-12T02:11:03.783049+0000 front 2024-09-12T02:11:03.783000+0000 (oldest deadline 2024-09-12T02:11:29.682958+0000) 2024-09-12T02:11:34.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:34 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:34.615+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:34.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:34 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:34.615+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:34.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:34 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:34.615+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:34.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:34 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:34.615+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:34.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:34 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:34.615+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:34.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:34 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:34.615+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:34.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:34 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:34.615+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-09-12T02:11:03.783049+0000 front 2024-09-12T02:11:03.783000+0000 (oldest deadline 2024-09-12T02:11:29.682958+0000) 2024-09-12T02:11:35.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:35 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:35.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:35.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:35 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:35.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:35.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:35 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:35.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:35.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:35 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:35.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:35.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:35 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:35.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:35.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:35 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:35.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:35.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:35 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:35.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-09-12T02:11:03.783049+0000 front 2024-09-12T02:11:03.783000+0000 (oldest deadline 2024-09-12T02:11:29.682958+0000) 2024-09-12T02:11:35.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:35 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:35.579+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6820 osd.8 since back 2024-09-12T02:11:11.383725+0000 front 2024-09-12T02:11:11.383696+0000 (oldest deadline 2024-09-12T02:11:34.883723+0000) 2024-09-12T02:11:36.953 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:36 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:36.547+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6806 osd.0 since back 2024-09-12T02:10:05.974941+0000 front 2024-09-12T02:10:05.974922+0000 (oldest deadline 2024-09-12T02:10:30.674921+0000) 2024-09-12T02:11:36.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:36 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:36.547+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-09-12T02:10:15.376113+0000 front 2024-09-12T02:10:15.375921+0000 (oldest deadline 2024-09-12T02:10:37.675986+0000) 2024-09-12T02:11:36.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:36 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:36.547+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6804 osd.2 since back 2024-09-12T02:10:22.377256+0000 front 2024-09-12T02:10:22.377235+0000 (oldest deadline 2024-09-12T02:10:46.477354+0000) 2024-09-12T02:11:36.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:36 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:36.547+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-09-12T02:10:39.979474+0000 front 2024-09-12T02:10:39.979497+0000 (oldest deadline 2024-09-12T02:11:02.279363+0000) 2024-09-12T02:11:36.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:36 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:36.547+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6812 osd.5 since back 2024-09-12T02:10:46.980292+0000 front 2024-09-12T02:10:46.980327+0000 (oldest deadline 2024-09-12T02:11:10.480353+0000) 2024-09-12T02:11:36.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:36 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:36.547+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.62:6822 osd.6 since back 2024-09-12T02:10:56.182235+0000 front 2024-09-12T02:10:56.182337+0000 (oldest deadline 2024-09-12T02:11:19.682083+0000) 2024-09-12T02:11:36.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:36 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:36.547+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-09-12T02:11:03.783049+0000 front 2024-09-12T02:11:03.783000+0000 (oldest deadline 2024-09-12T02:11:29.682958+0000) 2024-09-12T02:11:36.954 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:36 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11[60704]: 2024-09-12T02:11:36.547+0000 7fe4c9d5e640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.107:6820 osd.8 since back 2024-09-12T02:11:11.383725+0000 front 2024-09-12T02:11:11.383696+0000 (oldest deadline 2024-09-12T02:11:34.883723+0000) 2024-09-12T02:11:38.388 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:38 smithi107 podman[72439]: 2024-09-12 02:11:38.088984321 +0000 UTC m=+5.632926298 container died f96120a3b344d3fabd37c5e1a6ef7782b866d25fa89a548a1c807a9330dbec50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:11:38.388 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:38 smithi107 podman[72439]: 2024-09-12 02:11:38.38856429 +0000 UTC m=+5.932506259 container cleanup f96120a3b344d3fabd37c5e1a6ef7782b866d25fa89a548a1c807a9330dbec50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:11:38.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:38 smithi107 bash[72439]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11 2024-09-12T02:11:38.703 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:38 smithi107 podman[72455]: 2024-09-12 02:11:38.614652248 +0000 UTC m=+0.524006841 container remove f96120a3b344d3fabd37c5e1a6ef7782b866d25fa89a548a1c807a9330dbec50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T02:11:39.203 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:38 smithi107 podman[72542]: 2024-09-12 02:11:38.844229614 +0000 UTC m=+0.015329793 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:39.203 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:38 smithi107 podman[72542]: 2024-09-12 02:11:38.957099044 +0000 UTC m=+0.128199212 container create 9c2ce93cf44d21ee8b64e76493f3bcbc809000df0a91e8873e7e4ed0f4789891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:11:39.204 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:39 smithi107 podman[72542]: 2024-09-12 02:11:39.184237216 +0000 UTC m=+0.355337388 container init 9c2ce93cf44d21ee8b64e76493f3bcbc809000df0a91e8873e7e4ed0f4789891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:11:39.204 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:39 smithi107 podman[72542]: 2024-09-12 02:11:39.187529937 +0000 UTC m=+0.358630104 container start 9c2ce93cf44d21ee8b64e76493f3bcbc809000df0a91e8873e7e4ed0f4789891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:11:39.669 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:39 smithi107 podman[72542]: 2024-09-12 02:11:39.29257811 +0000 UTC m=+0.463678279 container attach 9c2ce93cf44d21ee8b64e76493f3bcbc809000df0a91e8873e7e4ed0f4789891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T02:11:39.669 INFO:journalctl@ceph.osd.11.smithi107.stdout:Sep 12 02:11:39 smithi107 podman[72542]: 2024-09-12 02:11:39.38037753 +0000 UTC m=+0.551477698 container died 9c2ce93cf44d21ee8b64e76493f3bcbc809000df0a91e8873e7e4ed0f4789891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T02:11:39.968 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T02:11:40.009 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:40.009 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T02:11:40.009 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T02:11:40.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.a 2024-09-12T02:11:40.342 INFO:journalctl@ceph.mds.a.smithi062.stdout:Sep 12 02:11:40 smithi062 systemd[1]: Stopping Ceph mds.a for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:40.842 INFO:journalctl@ceph.mds.a.smithi062.stdout:Sep 12 02:11:40 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-a[72141]: 2024-09-12T02:11:40.481+0000 7fc703a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:40.842 INFO:journalctl@ceph.mds.a.smithi062.stdout:Sep 12 02:11:40 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-a[72141]: 2024-09-12T02:11:40.481+0000 7fc703a00640 -1 mds.a *** got signal Terminated *** 2024-09-12T02:11:44.092 INFO:journalctl@ceph.mds.a.smithi062.stdout:Sep 12 02:11:43 smithi062 podman[91385]: 2024-09-12 02:11:43.679688576 +0000 UTC m=+3.375059244 container died 927db4987c1ce1525fc379c4d50f18c24195ff4699bcfd5018fe57454c0c0c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T02:11:44.446 INFO:journalctl@ceph.mds.a.smithi062.stdout:Sep 12 02:11:44 smithi062 podman[91385]: 2024-09-12 02:11:44.21973035 +0000 UTC m=+3.915101017 container cleanup 927db4987c1ce1525fc379c4d50f18c24195ff4699bcfd5018fe57454c0c0c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:11:44.446 INFO:journalctl@ceph.mds.a.smithi062.stdout:Sep 12 02:11:44 smithi062 bash[91385]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-a 2024-09-12T02:11:44.703 INFO:journalctl@ceph.mds.a.smithi062.stdout:Sep 12 02:11:44 smithi062 podman[91397]: 2024-09-12 02:11:44.446228928 +0000 UTC m=+0.753052486 container remove 927db4987c1ce1525fc379c4d50f18c24195ff4699bcfd5018fe57454c0c0c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T02:11:44.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T02:11:44.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:44.786 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T02:11:44.786 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T02:11:44.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.d 2024-09-12T02:11:45.091 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 02:11:44 smithi062 systemd[1]: Stopping Ceph mds.d for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:45.591 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 02:11:45 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-d[70976]: 2024-09-12T02:11:45.184+0000 7fe73b200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:45.591 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 02:11:45 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-d[70976]: 2024-09-12T02:11:45.184+0000 7fe73b200640 -1 mds.d *** got signal Terminated *** 2024-09-12T02:11:47.026 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 02:11:46 smithi062 podman[91499]: 2024-09-12 02:11:46.654832539 +0000 UTC m=+1.600206260 container died c011d2c1515f3813ddf35cc61628d7baa5e9d387327c3002e9062dc6076903c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T02:11:47.342 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 02:11:47 smithi062 podman[91499]: 2024-09-12 02:11:47.132203239 +0000 UTC m=+2.077576967 container cleanup c011d2c1515f3813ddf35cc61628d7baa5e9d387327c3002e9062dc6076903c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T02:11:47.342 INFO:journalctl@ceph.mds.d.smithi062.stdout:Sep 12 02:11:47 smithi062 bash[91499]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-d 2024-09-12T02:11:47.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T02:11:47.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:47.637 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T02:11:47.637 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T02:11:47.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.g 2024-09-12T02:11:48.022 INFO:journalctl@ceph.mds.g.smithi062.stdout:Sep 12 02:11:47 smithi062 systemd[1]: Stopping Ceph mds.g for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:48.341 INFO:journalctl@ceph.mds.g.smithi062.stdout:Sep 12 02:11:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-g[71733]: 2024-09-12T02:11:48.021+0000 7ff868e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:48.342 INFO:journalctl@ceph.mds.g.smithi062.stdout:Sep 12 02:11:48 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-g[71733]: 2024-09-12T02:11:48.021+0000 7ff868e00640 -1 mds.g *** got signal Terminated *** 2024-09-12T02:11:52.342 INFO:journalctl@ceph.mds.g.smithi062.stdout:Sep 12 02:11:51 smithi062 podman[91620]: 2024-09-12 02:11:51.918623873 +0000 UTC m=+4.004066064 container died 0e9f16d8fc642cabaee2287966febea8d4f4137f107c4f39ea9e71180ea3be78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-g, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T02:11:52.737 INFO:journalctl@ceph.mds.g.smithi062.stdout:Sep 12 02:11:52 smithi062 podman[91620]: 2024-09-12 02:11:52.577191266 +0000 UTC m=+4.662633453 container cleanup 0e9f16d8fc642cabaee2287966febea8d4f4137f107c4f39ea9e71180ea3be78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T02:11:52.737 INFO:journalctl@ceph.mds.g.smithi062.stdout:Sep 12 02:11:52 smithi062 bash[91620]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-g 2024-09-12T02:11:53.005 INFO:journalctl@ceph.mds.g.smithi062.stdout:Sep 12 02:11:52 smithi062 podman[91632]: 2024-09-12 02:11:52.736909553 +0000 UTC m=+0.809965805 container remove 0e9f16d8fc642cabaee2287966febea8d4f4137f107c4f39ea9e71180ea3be78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T02:11:53.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T02:11:53.082 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:53.082 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T02:11:53.083 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T02:11:53.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.j 2024-09-12T02:11:53.341 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 02:11:53 smithi062 systemd[1]: Stopping Ceph mds.j for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:53.841 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 02:11:53 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-j[70566]: 2024-09-12T02:11:53.517+0000 7f892e600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:53.841 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 02:11:53 smithi062 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-j[70566]: 2024-09-12T02:11:53.517+0000 7f892e600640 -1 mds.j *** got signal Terminated *** 2024-09-12T02:11:54.782 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 02:11:54 smithi062 podman[91737]: 2024-09-12 02:11:54.50017781 +0000 UTC m=+1.150343079 container died ac2606fdddeac63eb5982cf2a2ca732665dcc79e5f78a6f73c87e338652afaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-12T02:11:55.342 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 02:11:55 smithi062 podman[91737]: 2024-09-12 02:11:55.039815578 +0000 UTC m=+1.689980836 container cleanup ac2606fdddeac63eb5982cf2a2ca732665dcc79e5f78a6f73c87e338652afaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:11:55.342 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 02:11:55 smithi062 bash[91737]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-j 2024-09-12T02:11:55.342 INFO:journalctl@ceph.mds.j.smithi062.stdout:Sep 12 02:11:55 smithi062 podman[91749]: 2024-09-12 02:11:55.207408724 +0000 UTC m=+0.699002686 container remove ac2606fdddeac63eb5982cf2a2ca732665dcc79e5f78a6f73c87e338652afaeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T02:11:55.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T02:11:55.560 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:55.560 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T02:11:55.560 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T02:11:55.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.b 2024-09-12T02:11:55.889 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 02:11:55 smithi077 systemd[1]: Stopping Ceph mds.b for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:55.890 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 02:11:55 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b[65305]: 2024-09-12T02:11:55.834+0000 7ff75b414640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:55.890 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 02:11:55 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b[65305]: 2024-09-12T02:11:55.834+0000 7ff75b414640 -1 mds.b *** got signal Terminated *** 2024-09-12T02:11:58.135 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 02:11:57 smithi077 podman[71899]: 2024-09-12 02:11:57.840475891 +0000 UTC m=+2.083365737 container died 68f5bc005918a752e561a3136e57fcb2af15700503df3a44562d48c2cb243e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:11:58.460 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 02:11:58 smithi077 podman[71899]: 2024-09-12 02:11:58.226529816 +0000 UTC m=+2.469419651 container cleanup 68f5bc005918a752e561a3136e57fcb2af15700503df3a44562d48c2cb243e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T02:11:58.460 INFO:journalctl@ceph.mds.b.smithi077.stdout:Sep 12 02:11:58 smithi077 bash[71899]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-b 2024-09-12T02:11:58.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T02:11:58.627 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:11:58.627 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T02:11:58.628 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T02:11:58.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.e 2024-09-12T02:11:58.714 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 02:11:58 smithi077 systemd[1]: Stopping Ceph mds.e for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:11:59.214 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 02:11:58 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-e[64700]: 2024-09-12T02:11:58.945+0000 7f96ff538640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:11:59.214 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 02:11:58 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-e[64700]: 2024-09-12T02:11:58.945+0000 7f96ff538640 -1 mds.e *** got signal Terminated *** 2024-09-12T02:12:01.613 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 02:12:01 smithi077 podman[72032]: 2024-09-12 02:12:01.342443005 +0000 UTC m=+2.498923629 container died f0ed852c57957521dbe25803349637081b3f98c04b4bea3aa9d9675c46bcb2ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:12:01.963 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 02:12:01 smithi077 podman[72032]: 2024-09-12 02:12:01.713063636 +0000 UTC m=+2.869544260 container cleanup f0ed852c57957521dbe25803349637081b3f98c04b4bea3aa9d9675c46bcb2ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T02:12:01.963 INFO:journalctl@ceph.mds.e.smithi077.stdout:Sep 12 02:12:01 smithi077 bash[72032]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-e 2024-09-12T02:12:02.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T02:12:02.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:02.131 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T02:12:02.132 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T02:12:02.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.h 2024-09-12T02:12:02.714 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 02:12:02 smithi077 systemd[1]: Stopping Ceph mds.h for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:12:02.714 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 02:12:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-h[65003]: 2024-09-12T02:12:02.432+0000 7fbe58a93640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:12:02.715 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 02:12:02 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-h[65003]: 2024-09-12T02:12:02.432+0000 7fbe58a93640 -1 mds.h *** got signal Terminated *** 2024-09-12T02:12:05.464 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 02:12:05 smithi077 podman[72152]: 2024-09-12 02:12:05.167653857 +0000 UTC m=+2.810540128 container died 566c45f3f9ba3f9690b9043920c7f94a16ce1c11957257862de942cee3823b9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:12:05.889 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 02:12:05 smithi077 podman[72152]: 2024-09-12 02:12:05.508190245 +0000 UTC m=+3.151076521 container cleanup 566c45f3f9ba3f9690b9043920c7f94a16ce1c11957257862de942cee3823b9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T02:12:05.889 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 02:12:05 smithi077 bash[72152]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-h 2024-09-12T02:12:05.889 INFO:journalctl@ceph.mds.h.smithi077.stdout:Sep 12 02:12:05 smithi077 podman[72164]: 2024-09-12 02:12:05.684141394 +0000 UTC m=+0.518668810 container remove 566c45f3f9ba3f9690b9043920c7f94a16ce1c11957257862de942cee3823b9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T02:12:05.904 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T02:12:05.936 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:05.936 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T02:12:05.936 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T02:12:05.936 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.k 2024-09-12T02:12:06.214 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 02:12:06 smithi077 systemd[1]: Stopping Ceph mds.k for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:12:06.616 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 02:12:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-k[64392]: 2024-09-12T02:12:06.244+0000 7f3fad512640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:12:06.616 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 02:12:06 smithi077 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-k[64392]: 2024-09-12T02:12:06.244+0000 7f3fad512640 -1 mds.k *** got signal Terminated *** 2024-09-12T02:12:10.637 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 02:12:10 smithi077 podman[72274]: 2024-09-12 02:12:10.256170502 +0000 UTC m=+4.108616553 container died dce792c92bc6fbf978603227c224f498e8c2eb8de97732ffa3b454b8e3163eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T02:12:10.953 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 02:12:10 smithi077 podman[72274]: 2024-09-12 02:12:10.728081021 +0000 UTC m=+4.580527058 container cleanup dce792c92bc6fbf978603227c224f498e8c2eb8de97732ffa3b454b8e3163eb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:12:10.953 INFO:journalctl@ceph.mds.k.smithi077.stdout:Sep 12 02:12:10 smithi077 bash[72274]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-k 2024-09-12T02:12:11.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T02:12:11.130 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:11.130 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T02:12:11.130 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T02:12:11.130 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.c 2024-09-12T02:12:11.418 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 02:12:11 smithi107 systemd[1]: Stopping Ceph mds.c for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:12:11.703 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 02:12:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-c[65552]: 2024-09-12T02:12:11.417+0000 7fe7c8a16640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:12:11.704 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 02:12:11 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-c[65552]: 2024-09-12T02:12:11.417+0000 7fe7c8a16640 -1 mds.c *** got signal Terminated *** 2024-09-12T02:12:14.791 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 02:12:14 smithi107 podman[72656]: 2024-09-12 02:12:14.460932461 +0000 UTC m=+3.134915584 container died efd3a644ad094ede63d470ea37d25fa5c8a916a76adf52231cbd8ef2dbfe8535 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T02:12:15.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 02:12:14 smithi107 podman[72656]: 2024-09-12 02:12:14.792400994 +0000 UTC m=+3.466384102 container cleanup efd3a644ad094ede63d470ea37d25fa5c8a916a76adf52231cbd8ef2dbfe8535 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T02:12:15.172 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 02:12:14 smithi107 bash[72656]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-c 2024-09-12T02:12:15.173 INFO:journalctl@ceph.mds.c.smithi107.stdout:Sep 12 02:12:14 smithi107 podman[72670]: 2024-09-12 02:12:14.960163137 +0000 UTC m=+0.493201944 container remove efd3a644ad094ede63d470ea37d25fa5c8a916a76adf52231cbd8ef2dbfe8535 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:12:15.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T02:12:15.223 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:15.223 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T02:12:15.224 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T02:12:15.224 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.f 2024-09-12T02:12:15.456 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 02:12:15 smithi107 systemd[1]: Stopping Ceph mds.f for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:12:15.953 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 02:12:15 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-f[65248]: 2024-09-12T02:12:15.562+0000 7f8256784640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:12:15.953 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 02:12:15 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-f[65248]: 2024-09-12T02:12:15.562+0000 7f8256784640 -1 mds.f *** got signal Terminated *** 2024-09-12T02:12:19.828 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 02:12:19 smithi107 podman[72776]: 2024-09-12 02:12:19.577701222 +0000 UTC m=+4.140012058 container died 588b9e99331b3ec698968a2872d11d62ad2174a1fdba5b4b552c28d8ef6b1b45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:12:20.204 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 02:12:19 smithi107 podman[72776]: 2024-09-12 02:12:19.92043949 +0000 UTC m=+4.482750325 container cleanup 588b9e99331b3ec698968a2872d11d62ad2174a1fdba5b4b552c28d8ef6b1b45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T02:12:20.204 INFO:journalctl@ceph.mds.f.smithi107.stdout:Sep 12 02:12:19 smithi107 bash[72776]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-f 2024-09-12T02:12:20.342 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T02:12:20.375 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:20.375 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T02:12:20.375 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T02:12:20.376 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.i 2024-09-12T02:12:20.674 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 02:12:20 smithi107 systemd[1]: Stopping Ceph mds.i for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:12:20.953 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 02:12:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i[65848]: 2024-09-12T02:12:20.673+0000 7f3321796640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:12:20.995 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 02:12:20 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i[65848]: 2024-09-12T02:12:20.673+0000 7f3321796640 -1 mds.i *** got signal Terminated *** 2024-09-12T02:12:22.133 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 02:12:21 smithi107 podman[72896]: 2024-09-12 02:12:21.841747752 +0000 UTC m=+1.254452529 container died c8c800cfffdf407eef49d27597fd95709877e9389699e0ee2e5db5b4dc77c453 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T02:12:22.453 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 02:12:22 smithi107 podman[72896]: 2024-09-12 02:12:22.2153945 +0000 UTC m=+1.628099301 container cleanup c8c800cfffdf407eef49d27597fd95709877e9389699e0ee2e5db5b4dc77c453 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:12:22.453 INFO:journalctl@ceph.mds.i.smithi107.stdout:Sep 12 02:12:22 smithi107 bash[72896]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-i 2024-09-12T02:12:22.638 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T02:12:22.671 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:22.671 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T02:12:22.671 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T02:12:22.671 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.l 2024-09-12T02:12:23.203 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 02:12:22 smithi107 systemd[1]: Stopping Ceph mds.l for f18ee350-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:12:23.204 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 02:12:22 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-l[64938]: 2024-09-12T02:12:22.976+0000 7f5df129f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:12:23.204 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 02:12:22 smithi107 ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-l[64938]: 2024-09-12T02:12:22.976+0000 7f5df129f640 -1 mds.l *** got signal Terminated *** 2024-09-12T02:12:27.268 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 02:12:26 smithi107 podman[73015]: 2024-09-12 02:12:26.990811756 +0000 UTC m=+4.107608299 container died 4b7050e0c909c9b9598570613a9b89c1bb316a35f99e12eb9b57911d01230d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T02:12:27.585 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 02:12:27 smithi107 podman[73015]: 2024-09-12 02:12:27.368132103 +0000 UTC m=+4.484928640 container cleanup 4b7050e0c909c9b9598570613a9b89c1bb316a35f99e12eb9b57911d01230d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T02:12:27.585 INFO:journalctl@ceph.mds.l.smithi107.stdout:Sep 12 02:12:27 smithi107 bash[73015]: ceph-f18ee350-70a8-11ef-bcea-c7b262605968-mds-l 2024-09-12T02:12:27.721 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f18ee350-70a8-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T02:12:27.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:12:27.753 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T02:12:27.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f18ee350-70a8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:12:28.037 INFO:teuthology.orchestra.run.smithi062.stdout:Deleting cluster with fsid: f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T02:12:31.979 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f18ee350-70a8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:12:32.180 INFO:teuthology.orchestra.run.smithi077.stdout:Deleting cluster with fsid: f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T02:12:34.741 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f18ee350-70a8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:12:34.942 INFO:teuthology.orchestra.run.smithi107.stdout:Deleting cluster with fsid: f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T02:12:37.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:12:37.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:12:37.406 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:12:37.432 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T02:12:37.434 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570/remote/smithi062/crash 2024-09-12T02:12:37.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:12:37.497 INFO:teuthology.orchestra.run.smithi062.stderr:tar: /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:12:37.497 INFO:teuthology.orchestra.run.smithi062.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:12:37.500 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570/remote/smithi077/crash 2024-09-12T02:12:37.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:12:37.540 INFO:teuthology.orchestra.run.smithi077.stderr:tar: /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:12:37.540 INFO:teuthology.orchestra.run.smithi077.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:12:37.542 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570/remote/smithi107/crash 2024-09-12T02:12:37.543 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:12:37.582 INFO:teuthology.orchestra.run.smithi107.stderr:tar: /var/lib/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:12:37.582 INFO:teuthology.orchestra.run.smithi107.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:12:37.584 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T02:12:37.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-12T02:12:37.666 INFO:tasks.cephadm:Compressing logs... 2024-09-12T02:12:37.666 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:12:37.670 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:12:37.673 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:12:37.698 INFO:teuthology.orchestra.run.smithi107.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:12:37.698 INFO:teuthology.orchestra.run.smithi107.stderr:: No such file or directory 2024-09-12T02:12:37.698 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:12:37.699 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T02:12:37.699 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T02:12:37.699 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:12:37.699 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T02:12:37.699 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T02:12:37.710 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.11.log: 81.7% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:12:37.710 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T02:12:37.710 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:12:37.710 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T02:12:37.710 INFO:teuthology.orchestra.run.smithi107.stderr: 90.5% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.audit.log.gz/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.log: 2024-09-12T02:12:37.710 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:12:37.710 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T02:12:37.711 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T02:12:37.711 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.8.log: 94.6% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T02:12:37.712 INFO:teuthology.orchestra.run.smithi107.stderr: 90.9% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:12:37.717 INFO:teuthology.orchestra.run.smithi077.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T02:12:37.717 INFO:teuthology.orchestra.run.smithi077.stderr:: No such file or directory 2024-09-12T02:12:37.717 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T02:12:37.717 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T02:12:37.717 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:12:37.717 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T02:12:37.717 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 94.5% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log: 81.8%/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mgr.y.log: -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.log: 87.6% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:12:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T02:12:37.719 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:12:37.719 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T02:12:37.720 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T02:12:37.720 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T02:12:37.721 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mon.b.log: 94.4% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T02:12:37.721 INFO:teuthology.orchestra.run.smithi077.stderr: 91.9% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T02:12:37.721 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:12:37.722 INFO:teuthology.orchestra.run.smithi062.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T02:12:37.722 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-12T02:12:37.722 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:12:37.723 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T02:12:37.723 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T02:12:37.725 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.c.log: 94.6% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T02:12:37.725 INFO:teuthology.orchestra.run.smithi077.stderr: 94.5% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T02:12:37.726 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:12:37.726 INFO:teuthology.orchestra.run.smithi062.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-12T02:12:37.726 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:12:37.727 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T02:12:37.728 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:12:37.729 INFO:teuthology.orchestra.run.smithi107.stderr: 92.0% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T02:12:37.730 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T02:12:37.730 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:12:37.732 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log: 84.4% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:12:37.733 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:12:37.733 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mon.a.log: 90.3% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:12:37.733 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T02:12:37.734 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T02:12:37.735 INFO:teuthology.orchestra.run.smithi107.stderr: 94.6% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T02:12:37.735 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.g.log: 94.3% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T02:12:37.738 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:12:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T02:12:37.740 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.log: 94.5%gzip -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.g.log.gz -5 2024-09-12T02:12:37.740 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T02:12:37.742 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T02:12:37.743 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mgr.x.log: 91.0% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:12:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.d.log: 87.7% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:12:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T02:12:37.748 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:12:37.749 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.3.log: 94.5% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T02:12:37.753 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T02:12:37.759 INFO:teuthology.orchestra.run.smithi107.stderr: 93.9% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T02:12:37.760 INFO:teuthology.orchestra.run.smithi062.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:12:38.006 INFO:teuthology.orchestra.run.smithi107.stderr: 91.7% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T02:12:38.037 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T02:12:38.075 INFO:teuthology.orchestra.run.smithi077.stderr: 91.7% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T02:12:38.129 INFO:teuthology.orchestra.run.smithi062.stderr: 90.1% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T02:12:38.655 INFO:teuthology.orchestra.run.smithi062.stderr: 90.5% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T02:12:40.214 INFO:teuthology.orchestra.run.smithi107.stderr: 91.9% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T02:12:40.534 INFO:teuthology.orchestra.run.smithi107.stderr: 91.8% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T02:12:40.653 INFO:teuthology.orchestra.run.smithi077.stderr: 91.9% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T02:12:40.899 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T02:12:41.127 INFO:teuthology.orchestra.run.smithi062.stderr: 91.8% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T02:12:41.318 INFO:teuthology.orchestra.run.smithi107.stderr: 91.6% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T02:12:41.738 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T02:12:42.028 INFO:teuthology.orchestra.run.smithi077.stderr: 91.6% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T02:12:42.029 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-12T02:12:42.030 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m4.341s 2024-09-12T02:12:42.030 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m14.762s 2024-09-12T02:12:42.030 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m0.500s 2024-09-12T02:12:42.350 INFO:teuthology.orchestra.run.smithi062.stderr: 92.2% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T02:12:43.094 INFO:teuthology.orchestra.run.smithi107.stderr: 91.8% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T02:12:43.096 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T02:12:43.096 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m5.408s 2024-09-12T02:12:43.096 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m14.296s 2024-09-12T02:12:43.096 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.479s 2024-09-12T02:12:43.110 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T02:12:44.396 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/f18ee350-70a8-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T02:12:44.399 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T02:12:44.399 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m6.700s 2024-09-12T02:12:44.399 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m19.850s 2024-09-12T02:12:44.399 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m1.638s 2024-09-12T02:12:44.401 INFO:tasks.cephadm:Archiving logs... 2024-09-12T02:12:44.401 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570/remote/smithi062/log 2024-09-12T02:12:44.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:12:47.496 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570/remote/smithi077/log 2024-09-12T02:12:47.497 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:12:49.957 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570/remote/smithi107/log 2024-09-12T02:12:49.958 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:12:52.367 INFO:tasks.cephadm:Removing cluster... 2024-09-12T02:12:52.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f18ee350-70a8-11ef-bcea-c7b262605968 --force 2024-09-12T02:12:52.649 INFO:teuthology.orchestra.run.smithi062.stdout:Deleting cluster with fsid: f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T02:12:53.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f18ee350-70a8-11ef-bcea-c7b262605968 --force 2024-09-12T02:12:53.361 INFO:teuthology.orchestra.run.smithi077.stdout:Deleting cluster with fsid: f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T02:12:53.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f18ee350-70a8-11ef-bcea-c7b262605968 --force 2024-09-12T02:12:53.839 INFO:teuthology.orchestra.run.smithi107.stdout:Deleting cluster with fsid: f18ee350-70a8-11ef-bcea-c7b262605968 2024-09-12T02:12:54.119 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T02:12:54.119 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:12:54.158 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:12:54.177 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:12:54.193 INFO:tasks.cephadm:Teardown complete 2024-09-12T02:12:54.193 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:12:54.204 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:12:54.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:12:54.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:12:54.219 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:12:54.362 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:12:54.371 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:12:54.371 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:12:54.376 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:12:54.380 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:12:54.391 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:12:54.395 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:12:54.396 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:12:54.396 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-12T02:12:54.396 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 -2636us[-2645us] +/- 43ms 2024-09-12T02:12:54.396 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +1119us[+1119us] +/- 54ms 2024-09-12T02:12:54.396 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +3420us[+3411us] +/- 83ms 2024-09-12T02:12:54.396 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:12:54.399 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:12:54.399 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-12T02:12:54.399 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 -2645us[-2719us] +/- 43ms 2024-09-12T02:12:54.399 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 +1102us[+1102us] +/- 54ms 2024-09-12T02:12:54.399 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +3419us[+3344us] +/- 83ms 2024-09-12T02:12:54.399 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:12:54.407 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:12:54.414 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:12:54.414 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-09-12T02:12:54.414 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv01.front.sepia.ceph.com 3 6 377 24 -2642us[-2648us] +/- 43ms 2024-09-12T02:12:54.415 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 +1096us[+1090us] +/- 54ms 2024-09-12T02:12:54.415 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +3394us[+3388us] +/- 83ms 2024-09-12T02:12:54.415 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:12:54.416 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:12:54.426 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:12:54.426 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:12:54.436 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:12:54.589 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:12:54.659 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:12:54.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:12:54.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:54.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:12:54.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:54.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:12:54.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:54.845 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:12:54.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:12:54.867 INFO:teuthology.task.internal:Duration was 1937.108524 seconds 2024-09-12T02:12:54.867 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:12:54.880 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:12:54.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:12:54.885 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:12:54.888 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:12:54.925 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:12:54.926 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:12:54.968 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:12:55.252 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:12:55.252 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T02:12:55.252 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:12:55.302 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T02:12:55.302 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:12:55.327 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T02:12:55.327 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:12:55.358 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:12:55.358 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:12:55.362 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:12:55.369 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:12:55.425 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:12:55.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:12:55.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:12:55.435 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:12:55.967 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:12:55.978 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:12:55.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:12:56.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:12:56.060 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:12:56.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:12:56.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:56.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:56.102 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:56.123 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-09-12T02:12:56.148 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-09-12T02:12:56.167 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-09-12T02:12:56.197 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:56.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:56.230 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:56.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:56.245 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:12:56.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:56.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:12:56.271 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:12:56.272 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570/remote/smithi062 2024-09-12T02:12:56.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:12:56.352 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570/remote/smithi077 2024-09-12T02:12:56.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:12:56.388 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901570/remote/smithi107 2024-09-12T02:12:56.388 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:12:56.425 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:12:56.425 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:12:56.429 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:12:56.432 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:12:56.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:12:56.487 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:12:56.487 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:12:56.498 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:12:56.498 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:12:56.505 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:12:56.507 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:12:56.520 INFO:teuthology.orchestra.run.smithi077.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:12 /home/ubuntu/cephtest 2024-09-12T02:12:56.528 INFO:teuthology.orchestra.run.smithi107.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:12 /home/ubuntu/cephtest 2024-09-12T02:12:56.536 INFO:teuthology.orchestra.run.smithi062.stdout: 393475 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:12 /home/ubuntu/cephtest 2024-09-12T02:12:56.538 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:12:56.550 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:12:56.575 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} duration: 1937.1085240840912 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T02:12:56.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:12:56.682 INFO:teuthology.run:pass